SUBMITTED FOR REVIEW
1
From Traditional Automation to Embodied Wireless Intelligence: Vision-Language-Action Empowered Physics-Aware Communication Networks
arXiv:2606.13458v1 [cs.NI] 11 Jun 2026
Genze Jiang, Kezhi Wang, Senior Member, IEEE, Xiaomin Chen, Yizhou Huang
Abstract—Wireless network automation has progressed from rule-based self-organising networks (SON) to data-driven optimisation, yet existing systems remain fundamentally disembodied, optimising performance indicators without perceiving the physical environment that governs radio propagation. We propose the embodied intelligent empowered base station (eBS), a paradigm that adopts a Vision-Language-Action (VLA) pipeline to transform base stations into autonomous agents capable of situated perception, causal physical reasoning, and physics-aware action generation. The eBS employs a two-tier asynchronous architecture: a Semantic Planner powered by a frontier VisionLanguage Model (VLM) generates structured action directives on human timescales, whilst a Tactical Controller executes real-time adaptation. Case studies demonstrate that a single VLA pipeline, without task-specific training, can perform zero-shot material reasoning, generalise across viewpoints, and predict dynamic events before signal degradation occurs, illustrating a paradigm shift from traditional rule-following network automation to embodied intelligence empowered future wireless networks. Index Terms—Vision-Language-Action Models, Embodied AI, Autonomous Network Control, 6G
I. I NTRODUCTION Future wireless networks aim for more than efficient bit transport. Instead, they promise infrastructure that actively perceives and interacts with the physical world. Yet despite successive generations of network automation, from rule-based self-organisation to data-driven optimisation, today’s systems still react to performance metrics without understanding the physical environment around them. Bridging this gap requires a fundamental shift from traditional automation to embodied intelligence. A. From Traditional Automation to Embodied Intelligence In manufacturing, early industrial robots operated by executing fixed, preprogrammed procedures, achieving automation but not intelligence. They could not perceive their environment, reason about unexpected situations, or adapt their behaviour to novel conditions. The emergence of embodied intelligence has transformed this paradigm. For example, modern robots, powered by foundation models such as VisionLanguage-Action (VLA) architectures [1], observe their surroundings through cameras and sensors, reason about objects Genze Jiang, Kezhi Wang and Yizhou Huang are with the Department of Computer Science, Brunel University London, UK (e-mail: [email protected], [email protected], [email protected]). Xiaomin Chen is with the Department of Computer Science, University of Reading, UK (e-mail: [email protected])
and spatial relationships using natural language, and generate adaptive actions grounded in physical understanding [2]. This transition represents a fundamental shift from systems that follow rules to intelligent agents that understand the world. Wireless network management has followed a remarkably parallel trajectory, yet remains delayed at the intelligent stage. Self-organising networks (SON), introduced during the 4G era, automate network operations through predefined rules and threshold-based triggers [3]. More recently, data-driven approaches have applied machine learning (ML) to network optimisation [4], and concepts such as radio access network intelligent controllers (O-RAN RIC) have further advanced this automation. However, all of these approaches operate without genuine environmental awareness. A base station equipped with such systems can detect that signal quality has degraded, but cannot perceive the physical cause of the degradation, reason about the electromagnetic properties of surrounding materials, or predict that a moving object will disrupt a propagation path in the near future. In short, current “autonomous” networks automate reactions to symptoms without diagnosing the underlying physical causes. The critical insight motivating this work is that the same embodied intelligence paradigm transforming robotics can also bridge this gap in wireless communication. By equipping base stations (BS) with the capability to perceive, reason about, and act on their physical environment using foundation models, we can move beyond rule-following automation toward genuinely intelligent, autonomous operation, in which BS can observe, understand, and continuously optimise their own behaviour. B. Vision-Language-Action (VLA) Paradigm Recent work has begun to apply vision and language models to wireless communications, but these efforts fall short of embodied intelligence. Supervised deep learning (DL) approaches train task-specific models on paired sensor-channel data that cannot generalise beyond their training distribution or adapt to novel deployments without retraining. More recent work has integrated VLMs and LLMs into wireless systems, whether through contrastive learning frameworks [5], fine-tuned multimodal models [6], LLM-based network agents [7], or large multi-modal models as enhanced feature extractors [8]. However, none implements a complete perception-reasoning-action loop. These models serve as enhanced processing components within traditional pipelines rather than as embodied agents capable of autonomous decision-making.
SUBMITTED FOR REVIEW
The robotics community has established the paradigm needed to close this gap. Early work demonstrated that prompting general-purpose language models to generate structured action representations (i.e., via executable code, JSON commands, or spatial value maps) enables embodied agents to perform complex tasks without task-specific training [2]. This prompting-based approach was subsequently formalised by VLA models [1], which unify visual perception, languagebased reasoning, and action generation within a single architecture. Recent proposals for embodied intelligence in future networks [9] provide high-level architectural visions but lack concrete physical-layer implementations that demonstrate how embodied intelligence translates into network control actions. This paper bridges the gap between the robotics VLA paradigm and wireless infrastructure by proposing the first complete VLA pipeline for autonomous BS operation.
C. Contribution: Embodied Intelligence Empowered BS We propose an embodied intelligence empowered BS (eBS) paradigm that implements a VLA pipeline for autonomous network control, where a frontier VLM serves as the central perception-reasoning-action engine. The eBS paradigm embodies three defining characteristics that fundamentally distinguish it from both rule-based network automation (e.g., SON) and existing data-driven AI approaches. Situated perception: The eBS constructs coherent semantic representations of its local environment through multimodal sensing, identifying objects, materials, spatial relationships, and dynamic trajectories via natural language reasoning rather than treating sensor data as isolated feature vectors. Causal reasoning: The eBS infers physical consequences from visual observations without explicit electromagnetic simulation, reasoning about how material properties affect signal propagation, how spatial geometry constrains coverage, and how dynamic objects will alter channel conditions, all through chain-of-thought reasoning grounded in pre-trained world knowledge. Autonomous action: The eBS closes the perceptionreasoning-action loop by autonomously translating environmental understanding into structured control actions, from selecting transmission strategies based on identified material properties to initiating proactive handover based on predicted mobility patterns. The eBS reasons from first principles and generates appropriate actions for situations never previously encountered, whilst supporting operator guidance through natural language instructions when desired. The fundamental engineering challenge lies in reconciling two incompatible timescales. VLMs operate on human cognitive timescales, requiring 1–2 seconds for inference, whilst physical layer control demands responses within 10 milliseconds. The eBS resolves this through a two-tier asynchronous architecture that decouples strategic reasoning from tactical execution, enabling the system to leverage VLM intelligence without violating real-time constraints. Section II details the eBS design, including its system architecture, VLA agent formulation, and safety mechanisms.
2
II. E MBODIED I NTELLIGENT BASE S TATION A. Two-Tier System Architecture Since 6G channels exhibit coherence times of 10–50 milliseconds [10] whilst foundation models require over 1 second for inference, direct VLM integration proves infeasible. We resolve this through a two-tier decomposition, partitioning intelligence across tiers optimised for distinct temporal scales, as illustrated in Fig. 1. Tier 1: The Semantic Planner: This component embeds a frontier VLM functioning as the perception-reasoning stage of the VLA pipeline, processing multimodal data including camera imagery, historical traffic patterns, and operator instructions. Operating asynchronously at update rates of 0.5– 2.0 Hz, the planner does not directly compute physicallayer parameters. Rather, it employs semantic reasoning to translate visual observations into structured control directives, generating high-level intent vectors that constrain the tactical controller’s action space. In the beam management context explored in this work, this translates visual observations (for instance, “user in right lane”) into spatial constraints that define the beam search space. Tier 2: The Tactical Controller: This component implements a lightweight real-time executor operating within the 10 millisecond radio frame constraint. The controller receives intent vectors from Tier 1 and restricts its optimisation to the semantically defined subset of the action space. For beam management, this means restricting the pilot search to a subset of beam indices. For other physical-layer functions (e.g., power control, handover, scheduling), the same architecture applies with task-appropriate executors. This design enables the system to respond to fast-fading channels whilst operating within the strategic constraints defined by the VLA pipeline. B. Information Flow and Asynchronous Coupling The critical architectural innovation lies in the asynchronous coupling between tiers. The Tactical Controller maintains local state and continues to optimise physical-layer configurations using real-time feedback, even while the Semantic Planner processes a new frame. This design ensures that physicallayer control never blocks while waiting for VLM inference completion. The architecture exhibits three desirable properties that enhance robustness and flexibility: • Graceful degradation: If VLM inference is delayed or the visual link becomes obstructed, the Tactical Controller reverts to conventional operation (e.g., exhaustive beam search), ensuring that system reliability never falls below baseline. • Progressive refinement: As the Planner accumulates observations, it progressively narrows the Tactical Controller’s action space, reducing the beam search sector from 30° to 5° and lowering pilot overhead accordingly. • Operator-in-the-loop control: Network engineers can inject natural language instructions (such as “prioritise the emergency vehicle”), which the VLM translates into immediate intent vector updates without requiring direct manipulation of physical layer parameters.
SUBMITTED FOR REVIEW
3
VLM Inputs BS Vision Operator Instruction
Tier 1: Semantic Planner (VLA Engine) Human Timescale (0.5 - 2s)
Physics Priors (Textual Domain Knowledge)
Frontier VLM Situated Perception & Casual Reasoning (Chain-of-Thought)
JSON Intent Vector
Action Generation (Structured Directives)
Safety Validation (Check Parameters & Confidence)
{
}
"semantic_state": "…" "action": "ACTIVATE_SECTOR", "target_beams": [38-42], … "reasoning": "…"
Tier 2: Tactical Controller (Real-Time Executor) Radio Frame Timescale (~10ms) Intent Vector Buffer Real-Time Feedback (Channel State, etc)
Tactical Controller Restrict Action Space (Based on Intent)
Real-Time Optimisation & Execution
Physical Layer Actions (e.g., Beam Selection, Power Control)
Physical Wireless Environment
Fig. 1: The eBS system architecture. The Semantic Planner (Tier 1) operates on human timescales to generate semantically informed control directives, enabling the Tactical Controller (Tier 2) to execute real-time physical-layer adaptation within the 10-millisecond radio frame constraint.
C. Intent Vector Representation We define the intent vector as the structured interface between the VLA pipeline’s semantic reasoning and physical layer execution: a JSON-formatted payload that converts natural-language reasoning into constraints compatible with physical layer algorithms. In the beam management context, it encodes beam-priority masks, reflection annotations, and temporal validity. For example, upon identifying a user vehicle in the right traffic lane, the VLM generates: { "semantic_state": "User in Right Lane", "action": "ACTIVATE_SECTOR", "target_beams": [38, 39, 40, 41, 42], "exclusion_zone": [0, 1, ..., 20], "reasoning": "Vehicle constrained to lane geometry; Building at 50deg provides NLoS backup." }
The Tactical Controller parses this vector and restricts the pilot transmission to indices 38–42 in subsequent transmission frames, effectively reducing the search space by 92% compared to full 64-beam sweeps. D. VLA-based Agent Design Applying VLA principles to wireless infrastructure requires defining three elements absent from the traditional robotics domain: an observation space grounded in RF-relevant scene semantics, an action space mapped to physical layer control parameters, and a policy that bridges visual perception to control commands. We instantiate these design choices for beam management, though the framework generalises to other physical-layer functions. 1) Observation Space: The agent’s observation at each planning cycle comprises an RGB image from the basestation-mounted camera concatenated with a textual physics prior that injects domain knowledge absent from the VLM’s general pre-training:
SYSTEM: You are controlling a 6G base station at 28 GHz. Your goal is to maintain high-SNR connectivity. PHYSICS PRIORS: - 28 GHz signals are blocked by Concrete/Metal (>20dB ,→ loss). - 28 GHz signals penetrate Glass (3-6dB loss). - Reflection off flat surfaces is viable for NLoS paths. OUTPUT FORMAT: JSON only. No conversational preamble.
This hybrid observation (visual + textual) enables the VLM to apply pre-trained world knowledge spanning electromagnetic material properties, projective geometry, and causal reasoning to the wireless domain. 2) Action Space: The wireless VLA agent operates over discrete, structured control parameters rather than the continuous joint torques of robotic agents. For beam management, the action space comprises the set of all valid intent vectors, each specifying a beam priority mask over the 64-element codebook, a transmission strategy (direct, reflect, or penetrate), and associated power and beamwidth parameters. The same intent vector framework accommodates other physical layer actions by extending the JSON schema. 3) Policy Specification via Structured Prompting: In endto-end VLA models such as RT-2 [1], the policy is learned implicitly through supervised fine-tuning on vision-action pairs. In our prompting-based approach, the policy is specified explicitly through the prompt structure via two mechanisms. First, we enforce chain-of-thought action derivation by requiring the VLM to populate a reasoning field prior to the action field in its JSON output, ensuring the model articulates its physical interpretation before committing to an action. Second, we inject task-specific observation queries that focus the agent’s attention on the relevant physical dimension: • Material reasoning (Case Study A): “Identify the blockage material and determine whether direct transmission or reflection paths are optimal at 28 GHz.”
SUBMITTED FOR REVIEW
Spatial reasoning (Case Study B): “Estimate the user equipment’s semantic spatial position (left, centre, right lane) and map to corresponding beam sector indices.” • Temporal reasoning (Case Study C): “Analyse dynamic object trajectories and determine whether any will intersect the line-of-sight path within 500 milliseconds.” •
4
SCENARIO A1: CONCRETE
SCENARIO A2: GLASS
USER [ID: 01]
USER [ID: 01]
SCANNING OBJECT... TYPE: OBSTACLE MATERIAL: CONCRETE (OPAQUE) RF PROP: REFLECT (BOUNCE)
SCANNING OBJECT... TYPE: OBSTACLE MATERIAL: GLASS (DIELECTRIC) RF PROP: TRANSMIT (BOOST)
E. Closed-Loop Safety and Fallback In wireless deployment, an incorrect control action causes immediate performance degradation such as throughput loss and dropped connections. The Semantic Planner therefore validates every generated action before forwarding it to the Tactical Controller. The parser verifies that recommended parameters fall within valid ranges (e.g., beam indices 0–63) and evaluates the VLM’s stated confidence level. If confidence falls below a predefined threshold (0.7 in our implementation) or the output contains malformed JSON, the system reverts to conventional operation, ensuring that performance never degrades below baseline. F. Multi-Station Coordination In conventional cooperative schemes, BS exchange raw channel state information, imposing stringent backhaul bandwidth and latency requirements that scale poorly with network density. By contrast, the eBS Semantic Planner already produces structured intent vectors that encode environmental understanding in compact, human-readable form. These vectors can be shared between neighbouring eBS nodes over standard backhaul interfaces, enabling semantic-level coordination. For instance, a source eBS that observes a vehicle approaching a cell boundary can transmit a trajectory prediction and material description to the target eBS, which pre-configures its beam before handover occurs. This semantic coordination operates at the Planner’s low update rate (0.5–2 Hz), placing negligible additional load on existing backhaul infrastructure whilst enabling a richer form of inter-cell cooperation than numerical parameter exchange alone. III. C ASE S TUDIES To validate the eBS as a VLA agent, we conduct three case studies using NVIDIA Sionna [11] for physics-compliant raytracing simulations and the Vision-Wireless (ViWi) dataset [12] for dynamic vehicular scenarios. Each study stresses a distinct capability of the VLA pipeline, namely material reasoning, viewpoint-invariant spatial reasoning, and temporal reasoning, demonstrating that embodied intelligence emerges from the foundation model’s pre-trained world knowledge rather than from task-specific pattern matching. A. Case Study A: Material Reasoning for Beam Strategy 1) Challenge: The Semantic Gap in Channel Estimation: In high-frequency bands such as mmWave and THz, the electromagnetic properties of obstacles fundamentally determine link viability. Conventional channel estimators treat blockages as binary, assuming that either line-of-sight exists or it does not, and therefore cannot distinguish between a concrete wall
Fig. 2: The embodied agent identifies material properties from visual cues. Left: Detecting concrete triggers a REFLECT strategy. Right: Detecting glass triggers a PENETRATE strategy. requiring alternative reflective paths and a glass window that permits attenuated transmission. This semantic gap leads to suboptimal beam selection. 2) Experimental Setup: We constructed a high-fidelity digital twin using the Sionna ray-tracer. The scene depicts an urban canyon with a base station positioned at 25m height and a user vehicle at 40m distance. We introduced a variable blockage directly in the line-of-sight path: • Scenario A1 (Concrete): A solid concrete barrier (ϵr ≈ 5.31, high loss tangent). • Scenario A2 (Glass): A transparent glass panel (ϵr ≈ 6.27, low loss tangent). The embodied agent (Tier 1: Semantic Planner) receives RGB images of the scene with the prompt: “Analyse this base station’s camera image. A user equipment is located behind the visible obstacle. Identify the blockage material and recommend a transmission strategy considering 28 GHz millimetre wave propagation.” 3) Results: The VLM successfully bridges the semantic gap through zero-shot material inference, as shown in Fig. 2. In Scenario A1 (Concrete), the agent identifies the barrier as “opaque and solid.” The reasoning trace states: “Reflection is necessary... a wide beam is used due to potential distortion from the surface.” Consequently, the agent issued a directive to REFLECT with HIGH power and a WIDE beam width to maximise signal capture from non-line-of-sight bounces. In Scenario A2 (Glass), the agent recognises the transparency. The reasoning trace adapts: “Glass allows for penetration with slight attenuation... the view is clear, allowing for a narrow beam width for precision.” The agent commands a PENETRATE strategy with MEDIUM power and a NARROW beam width to minimise interference. TABLE I: VLM Decision Matrix for Material Reasoning Scene
Material
Strategy
Power
Beam Width
A1 A2
Concrete (Opaque) Glass (Dielectric)
REFLECT PENETRATE
HIGH MEDIUM
WIDE NARROW
These decisions, summarised in Table I, match the groundtruth optimal configuration. Sionna simulations confirm that the REFLECT strategy avoids a 20dB loss through the concrete, while the PENETRATE strategy successfully maintains
SUBMITTED FOR REVIEW
5