English
Related papers

Related papers: Edge-Based Multimodal Sensor Data Fusion with Visi…

200 papers

Multi-view cooperative perception and multimodal fusion are essential for reliable 3D spatiotemporal understanding in autonomous driving, especially under occlusions, limited viewpoints, and communication delays in V2X scenarios. This paper…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Zhenwei Yang , Yibo Ai , Weidong Zhang

Vision-Language Models (VLMs) enable multimodal reasoning for robotic perception and interaction, but their deployment in real-world systems remains constrained by latency, limited onboard resources, and privacy risks of cloud offloading.…

Robotics · Computer Science 2026-01-22 Sarat Ahmad , Maryam Hafeez , Syed Ali Raza Zaidi

Cooperative perception enhances autonomous driving by leveraging Vehicle-to-Everything (V2X) communication for multi-agent sensor fusion. However, most existing methods rely on single-modal data sharing, limiting fusion performance,…

Robotics · Computer Science 2025-09-25 Lantao Li , Kang Yang , Wenqi Zhang , Xiaoxue Wang , Chen Sun

This paper introduces VLMFusionOcc3D, a robust multimodal framework for dense 3D semantic occupancy prediction in autonomous driving. Current voxel-based occupancy models often struggle with semantic ambiguity in sparse geometric grids and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 A. Enes Doruk , Hasan F. Ates

Environmental perception is a key element of autonomous driving because the information received from the perception module influences core driving decisions. An outstanding challenge in real-time perception for autonomous driving lies in…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Faisal Hawlader , François Robinet , Raphaël Frank

Vision-Language-Action (VLA) models have emerged as a promising paradigm for end-to-end autonomous driving, yet their reliance on implicit parametric knowledge limits generalization in long-tail scenarios. While Retrieval-Augmented…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Rui Zhao , Haofeng Hu , Zhenhai Gao , Jiaqiao Liu , Gao Fei

Neural Networks (NNs) trained through supervised learning struggle with managing edge-case scenarios common in real-world driving due to the intractability of exhaustive datasets covering all edge-cases, making knowledge-driven approaches,…

Artificial Intelligence · Computer Science 2025-04-17 Nicolas Baumann , Cheng Hu , Paviththiren Sivasothilingam , Haotong Qin , Lei Xie , Michele Magno , Luca Benini

Temporal perception, defined as the capability to detect and track objects across temporal sequences, serves as a fundamental component in autonomous driving systems. While single-vehicle perception systems encounter limitations, stemming…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Zhenwei Yang , Jilei Mao , Wenxian Yang , Yibo Ai , Yu Kong , Haibao Yu , Weidong Zhang

Recent advancements in end-to-end autonomous driving systems (ADSs) underscore their potential for perception and planning capabilities. However, challenges remain. Complex driving scenarios contain rich semantic information, yet ambiguous…

Robotics · Computer Science 2025-11-18 Haowen Jiang , Xinyu Huang , You Lu , Dingji Wang , Yuheng Cao , Chaofeng Sha , Bihuan Chen , Keyu Chen , Xin Peng

Autonomous cars need geometric accuracy and semantic understanding to navigate complex environments, yet most stacks handle them separately. We present XYZ-Drive, a single vision-language model that reads a front-camera frame, a 25m…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Santosh Patapati , Trisanth Srinivasan , Murari Ambati

Real-time urban traffic surveillance is vital for Intelligent Transportation Systems (ITS) to ensure road safety, optimize traffic flow, track vehicle trajectories, and prevent collisions in smart cities. Deploying edge cameras across urban…

Networking and Internet Architecture · Computer Science 2025-09-26 Murat Arda Onsu , Poonam Lohan , Burak Kantarci , Aisha Syed , Matthew Andrews , Sean Kennedy

This paper presents EdgeLoc, an infrastructure-assisted, real-time localization system for autonomous driving that addresses the incompatibility between traditional localization methods and deep learning approaches. The system is built on…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-11 Boyi Liu , Jingwen Tong , Yufan Zhuang

Effectively integrating Large Language Models (LLMs) into autonomous driving requires a balance between leveraging high-level reasoning and maintaining real-time efficiency. Existing approaches either activate LLMs too frequently, causing…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Ruifei Zhang , Junlin Xie , Wei Zhang , Weikai Chen , Xiao Tan , Xiang Wan , Guanbin Li

For end-to-end autonomous driving (E2E-AD), the evaluation system remains an open problem. Existing closed-loop evaluation protocols usually rely on simulators like CARLA being less realistic; while NAVSIM using real-world vision data, yet…

Robotics · Computer Science 2024-12-16 Junqi You , Xiaosong Jia , Zhiyuan Zhang , Yutao Zhu , Junchi Yan

This paper addresses the problem of 3D referring expression comprehension (REC) in autonomous driving scenario, which aims to ground a natural language to the targeted region in LiDAR point clouds. Previous approaches for REC usually focus…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Wenhao Cheng , Junbo Yin , Wei Li , Ruigang Yang , Jianbing Shen

Recently, data-driven trajectory prediction methods have achieved remarkable results, significantly advancing the development of autonomous driving. However, the instability of single-vehicle perception introduces certain limitations to…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Kangyu Wu , Jiaqi Qiao , Ya Zhang

A key challenge for autonomous driving lies in maintaining real-time situational awareness regarding surrounding obstacles under strict latency constraints. The high processing requirements coupled with limited onboard computational…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Faisal Hawladera , Rui Meireles , Gamal Elghazaly , Ana Aguiar , Raphaël Frank

Vision-Language-Action (VLA) driving augments end-to-end (E2E) planning with language-enabled backbones, yet it remains unclear what changes beyond the usual accuracy--cost trade-off. We revisit this question with 3--RQ analysis in…

End-to-End (E2E) solutions have emerged as a mainstream approach for autonomous driving systems, with Vision-Language-Action (VLA) models representing a new paradigm that leverages pre-trained multimodal knowledge from Vision-Language…

Robotics · Computer Science 2025-09-25 Pengxiang Li , Yinan Zheng , Yue Wang , Huimin Wang , Hang Zhao , Jingjing Liu , Xianyuan Zhan , Kun Zhan , Xianpeng Lang

Multimodal large language models (MLLMs) have shown strong capability in semantic understanding and visual reasoning, yet their use on continuous video streams in bandwidth-constrained edge-cloud systems incurs prohibitive computation and…

Multimedia · Computer Science 2026-04-08 Qi Guo , Zheming Yang , Yunqing Hu , Chang Zhao , Wen Ji