English

Vision-Language Models on the Edge for Real-Time Robotic Perception

Robotics 2026-01-22 v1 Artificial Intelligence

Abstract

Vision-Language Models (VLMs) enable multimodal reasoning for robotic perception and interaction, but their deployment in real-world systems remains constrained by latency, limited onboard resources, and privacy risks of cloud offloading. Edge intelligence within 6G, particularly Open RAN and Multi-access Edge Computing (MEC), offers a pathway to address these challenges by bringing computation closer to the data source. This work investigates the deployment of VLMs on ORAN/MEC infrastructure using the Unitree G1 humanoid robot as an embodied testbed. We design a WebRTC-based pipeline that streams multimodal data to an edge node and evaluate LLaMA-3.2-11B-Vision-Instruct deployed at the edge versus in the cloud under real-time conditions. Our results show that edge deployment preserves near-cloud accuracy while reducing end-to-end latency by 5\%. We further evaluate Qwen2-VL-2B-Instruct, a compact model optimized for resource-constrained environments, which achieves sub-second responsiveness, cutting latency by more than half but at the cost of accuracy.

Keywords

Cite

@article{arxiv.2601.14921,
  title  = {Vision-Language Models on the Edge for Real-Time Robotic Perception},
  author = {Sarat Ahmad and Maryam Hafeez and Syed Ali Raza Zaidi},
  journal= {arXiv preprint arXiv:2601.14921},
  year   = {2026}
}
R2 v1 2026-07-01T09:13:58.862Z