English
Related papers

Related papers: Edge-Based Multimodal Sensor Data Fusion with Visi…

200 papers

Accurate motion forecasting is crucial for safe autonomous driving (AD). This study proposes CoT-Drive, a novel approach that enhances motion forecasting by leveraging large language models (LLMs) and a chain-of-thought (CoT) prompting…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Haicheng Liao , Hanlin Kong , Bonan Wang , Chengyue Wang , Wang Ye , Zhengbing He , Chengzhong Xu , Zhenning Li

For 3D perception systems to operate reliably in real-world environments, they must remain robust to evolving sensor characteristics and changes in object taxonomies. However, existing adaptive learning paradigms struggle in LiDAR settings…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Subeen Lee , Siyeong Lee , Namil Kim , Jaesik Choi

With the growing demand for large-scale and high-quality data in edge intelligence systems, mobile robots are increasingly deployed to collect data proactively, particularly in complex environments. However, existing robot-assisted data…

Robotics · Computer Science 2026-04-07 Tingting Huang , Yingyang Chen , Sixian Qin , Zhijian Lin , Jun Li , Li Wang

Autonomous Vehicles (AVs) collect and pseudo-label terabytes of multi-modal data localized to HD maps during normal fleet testing. However, identifying interesting and safety-critical scenarios from uncurated driving logs remains a…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Cainan Davidson , Deva Ramanan , Neehar Peri

Generating safety-critical scenarios in high-fidelity simulations offers a promising and cost-effective approach for efficient testing of autonomous vehicles. Existing methods typically rely on manipulating a single vehicle's trajectory…

Machine Learning · Computer Science 2025-05-07 Jiawei Wang , Xintao Yan , Yao Mu , Haowei Sun , Zhong Cao , Henry X. Liu

Fusing sensors with complementary modalities is crucial for maintaining a stable and comprehensive understanding of abnormal driving scenes. However, Multimodal Large Language Models (MLLMs) are underexplored for leveraging multi-sensor…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Mingzhe Tao , Ruiping Liu , Junwei Zheng , Yufan Chen , Kedi Ying , M. Saquib Sarfraz , Kailun Yang , Jiaming Zhang , Rainer Stiefelhagen

Deploying Vision-Language Models (VLMs) on edge devices remains challenging due to their substantial computational and memory demands, which exceed the capabilities of resource-constrained embedded platforms. Conversely, fully offloading…

Machine Learning · Computer Science 2026-04-30 Cyril Shih-Huan Hsu , Wig Yuan-Cheng Cheng , Chrysa Papagianni

Deploying autonomous vision systems on edge devices faces a critical challenge: resource constraints prevent real-time and predictable execution of comprehensive safety tests. Existing validation methods depend on static datasets or manual…

Machine Learning · Computer Science 2026-04-10 Faezeh Pasandideh , Achim Rettberg

Vision-Language Models (VLMs) exhibit remarkable common-sense and semantic reasoning capabilities. However, they lack a grounded understanding of physical dynamics. This limitation arises from training VLMs on static internet-scale…

Robotics · Computer Science 2026-04-01 Haowen Liu , Shaoxiong Yao , Haonan Chen , Jiawei Gao , Jiayuan Mao , Jia-Bin Huang , Yilun Du

Recent advancements in autonomous driving (AD) have explored the use of vision-language models (VLMs) within visual question answering (VQA) frameworks for direct driving decision-making. However, these approaches often depend on…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Xin Hu , Taotao Jing , Renran Tian , Zhengming Ding

While autonomous driving technology has made remarkable strides, data-driven approaches still struggle with complex scenarios due to their limited reasoning capabilities. Meanwhile, knowledge-driven autonomous driving systems have evolved…

Artificial Intelligence · Computer Science 2025-01-15 Yukai Ma , Tiantian Wei , Naiting Zhong , Jianbiao Mei , Tao Hu , Licheng Wen , Xuemeng Yang , Botian Shi , Yong Liu

Ensuring safe decision-making in autonomous vehicles remains a fundamental challenge despite rapid advances in end-to-end learning approaches. Traditional reinforcement learning (RL) methods rely on manually engineered rewards or sparse…

Robotics · Computer Science 2026-03-20 Zilin Huang , Zihao Sheng , Zhengyang Wan , Yansong Qu , Junwei You , Sicong Jiang , Sikai Chen

Large vision-language models (VLMs) are increasingly used in autonomous-vehicle (AV) stacks, but hallucination limits their reliability in safety-critical pipelines. We present Shapley-credited Context-Aware Dawid-Skene with Agreement, a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Yuxiang Feng , Keyang Zhang , Hassane Ouchouid , Ashwil Kaniamparambil , Ioannis Souflas , Panagiotis Angeloudis

Expected to provide higher transportation efficiency and security, autonomous driving has attracted substantial attentions from both industry and academia. Meanwhile, the emergence of edge intelligence has further introduced significant…

Signal Processing · Electrical Eng. & Systems 2024-09-25 Yunqi Feng , Hesheng Shen , Zhendong Shan , Qianqian Yang , Xiufang Shi

Vision-and-Language Navigation (VLN) requires the agent to navigate by following natural instructions under partial observability, making it difficult to align perception with language. Recent methods mitigate this by imagining future…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Pingrui Zhang , Yifei Su , Pengyuan Wu , Dong An , Li Zhang , Zhigang Wang , Dong Wang , Yan Ding , Bin Zhao , Xuelong Li

Although fusing multiple sensor modalities can enhance object detection performance, existing fusion approaches often overlook subtle variations in environmental conditions and sensor inputs. As a result, they struggle to adaptively weight…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Aditya Taparia , Noel Ngu , Mario Leiva , Joshua Shay Kricheli , John Corcoran , Nathaniel D. Bastian , Gerardo Simari , Paulo Shakarian , Ransalu Senanayake

Vision-Language Models(VLMs) excel at autoregressive text generation, yet end-to-end autonomous driving requires multi-task learning with structured outputs and heterogeneous decoding behaviors, such as autoregressive language generation,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Yiwei Zhang , Xuesong Chen , Jin Gao , Hanshi Wang , Fudong Ge , Weiming Hu , Shaoshuai Shi , Zhipeng Zhang

Understanding and addressing corner cases is essential for ensuring the safety and reliability of autonomous driving systems. Vision-language models (VLMs) play a crucial role in enhancing scenario comprehension, yet they face significant…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Yujin Wang , Quanfeng Liu , Jiaqi Fan , Jinlong Hong , Hongqing Chu , Mengjian Tian , Bingzhao Gao , Hong Chen

Efficient information exchange and reliable contextual reasoning are essential for vehicle-to-everything (V2X) networks. Conventional communication schemes often incur significant transmission overhead and latency, while existing trajectory…

Artificial Intelligence · Computer Science 2025-12-02 Lin Zhu , Kezhi Wang , Luping Xiang , Kun Yang

Personalized driving refers to an autonomous vehicle's ability to adapt its driving behavior or control strategies to match individual users' preferences and driving styles while maintaining safety and comfort standards. However, existing…