English
Related papers

Related papers: Edge-Based Multimodal Sensor Data Fusion with Visi…

200 papers

Emerging Internet of Things (IoT) and mobile computing applications are expected to support latency-sensitive deep neural network (DNN) workloads. To realize this vision, the Internet is evolving towards an edge-computing architecture,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Anurag Ghosh , Srinivasan Iyengar , Stephen Lee , Anuj Rathore , Venkat N Padmanabhan

Recent advancements in open-source Visual Language Models (VLMs) such as LLaVA, Qwen-VL, and Llama have catalyzed extensive research on their integration with diverse systems. The internet-scale general knowledge encapsulated within these…

Robotics · Computer Science 2025-07-03 Cristian Gariboldi , Hayato Tokida , Ken Kinjo , Yuki Asada , Alexander Carballo

Temporal understanding in autonomous driving (AD) remains a significant challenge, even for recent state-of-the-art (SoTA) Vision-Language Models (VLMs). Prior work has introduced datasets and benchmarks aimed at improving temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Kevin Cannons , Saeed Ranjbar Alvar , Mohammad Asiful Hossain , Ahmad Rezaei , Mohsen Gholami , Alireza Heidarikhazaei , Zhou Weimin , Yong Zhang , Mohammad Akbari

Perception for automated driving is largely based on onboard environmental sensors, such as cameras and radar, which are cost-effective but limited by line-of-sight and field-of-view constraints. These inherent limitations may cause onboard…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Lukas Ostendorf , Lennart Reiher , Onn Haran , Lutz Eckstein

End-to-end autonomous driving systems built on Vision Language Models (VLMs) have shown significant promise, yet their reliance on autoregressive architectures introduces some limitations for real-world applications. The sequential,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Can Cui , Yupeng Zhou , Juntong Peng , Sung-Yeon Park , Zichong Yang , Prashanth Sankaranarayanan , Jiaru Zhang , Ruqi Zhang , Ziran Wang

Environment sensing and fusion via onboard sensors are envisioned to be widely applied in future autonomous driving networks. This paper considers a vehicular system with multiple self-driving vehicles that is assisted by multi-access edge…

Machine Learning · Computer Science 2025-03-26 Xueyao Zhang , Bo Yang , Xuelin Cao , Zhiwen Yu , George C. Alexandropoulos , Yan Zhang , Merouane Debbah , Chau Yuen

The integration of Large Language Models (LLMs) into autonomous driving systems demonstrates strong common sense and reasoning abilities, effectively addressing the pitfalls of purely data-driven methods. Current LLM-based agents require…

Robotics · Computer Science 2024-10-22 Sihao Wu , Jiaxu Liu , Xiangyu Yin , Guangliang Cheng , Xingyu Zhao , Meng Fang , Xinping Yi , Xiaowei Huang

Autonomous driving holds transformative potential but remains fundamentally constrained by the limited perception and isolated decision-making with standalone intelligence. While recent multi-agent approaches introduce cooperation, they…

Robotics · Computer Science 2025-11-13 Ziyi Song , Chen Xia , Chenbing Wang , Haibao Yu , Sheng Zhou , Zhisheng Niu

Traditional autonomous driving systems often struggle with reasoning in complex, unexpected scenarios due to limited comprehension of spatial relationships. In response, this study introduces a Large Language Model (LLM)-based Autonomous…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Namhee Kim , Woojin Park

End-to-end autonomous driving has great potential in the transportation industry. However, the lack of transparency and interpretability of the automatic decision-making process hinders its industrial adoption in practice. There have been…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Bu Jin , Xinyu Liu , Yupeng Zheng , Pengfei Li , Hao Zhao , Tong Zhang , Yuhang Zheng , Guyue Zhou , Jingjing Liu

Reactive collision avoidance is essential for agile robots navigating complex and dynamic environments, enabling real-time obstacle response. However, this task is inherently challenging because it requires a tight integration of…

Robotics · Computer Science 2025-06-06 Alessandro Saviolo , Niko Picello , Jeffrey Mao , Rishabh Verma , Giuseppe Loianno

We introduce DriveAgent, a novel multi-agent autonomous driving framework that leverages large language model (LLM) reasoning combined with multimodal sensor fusion to enhance situational understanding and decision-making. DriveAgent…

Robotics · Computer Science 2025-05-06 Xinmeng Hou , Wuqi Wang , Long Yang , Hao Lin , Jinglun Feng , Haigen Min , Xiangmo Zhao

Accurately predicting traffic accidents in real-time is a critical challenge in autonomous driving, particularly in resource-constrained environments. Existing solutions often suffer from high computational overhead or fail to adequately…

Computational Engineering, Finance, and Science · Computer Science 2025-04-11 Jiaxun Zhang , Yanchen Guan , Chengyue Wang , Haicheng Liao , Guohui Zhang , Zhenning Li

Recent studies have explored leveraging the world knowledge and cognitive capabilities of Vision-Language Models (VLMs) to address the long-tail problem in end-to-end autonomous driving. However, existing methods typically formulate…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yongkang Li , Kaixin Xiong , Xiangyu Guo , Fang Li , Sixu Yan , Gangwei Xu , Lijun Zhou , Long Chen , Haiyang Sun , Bing Wang , Kun Ma , Guang Chen , Hangjun Ye , Wenyu Liu , Xinggang Wang

Large vision-language models (VLMs) have shown promising capabilities in scene understanding, enhancing the explainability of driving behaviors and interactivity with users. Existing methods primarily fine-tune VLMs on on-board multi-view…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Nan Song , Bozhou Zhang , Xiatian Zhu , Jiankang Deng , Li Zhang

The advent of Vision-Language Models (VLMs) has significantly advanced end-to-end autonomous driving, demonstrating powerful reasoning abilities for high-level behavior planning tasks. However, existing methods are often constrained by a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Weicheng Zheng , Xiaofei Mao , Nanfei Ye , Pengxiang Li , Kun Zhan , Xianpeng Lang , Hang Zhao

Vision-Language Models (VLMs) have recently emerged as a promising paradigm in autonomous driving (AD). However, current performance evaluation protocols for VLM-based AD systems (ADVLMs) are predominantly confined to open-loop settings…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Tianyuan Zhang , Ting Jin , Lu Wang , Jiangfan Liu , Siyuan Liang , Mingchuan Zhang , Aishan Liu , Xianglong Liu

The comprehensiveness of vehicle-to-everything (V2X) recognition enriches and holistically shapes the global Birds-Eye-View (BEV) perception, incorporating rich semantics and integrating driving scene information, thereby serving features…

Robotics · Computer Science 2024-04-23 Fukang Li , Wenlin Ou , Kunpeng Gao , Yuwen Pang , Yifei Li , Henry Fan

Rear end collisions are deadliest in nature and cause most of traffic casualties and injuries. In the existing research, many rear end collision avoidance solutions have been proposed. However, the problem with these proposed solutions is…

Artificial Intelligence · Computer Science 2017-11-07 Faisal Riaz , Muaz A. Niazi

This paper presents Edge-based Mixture of Experts (MoE) Collaborative Computing (EMC2), an optimal computing system designed for autonomous vehicles (AVs) that simultaneously achieves low-latency and high-accuracy 3D object detection.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Linshen Liu , Boyan Su , Junyue Jiang , Guanlin Wu , Cong Guo , Ceyu Xu , Hao Frank Yang