English
Related papers

Related papers: Edge-Based Multimodal Sensor Data Fusion with Visi…

200 papers

Vision-Language Models (VLMs) and Multi-Modal Language models (MMLMs) have become prominent in autonomous driving research, as these models can provide interpretable textual reasoning and responses for end-to-end autonomous driving safety…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Akshay Gopalkrishnan , Ross Greer , Mohan Trivedi

Formation control of wheeled mobile robots (WMRs) has been extensively studied due to its broad applications in fields such as logistics transportation, environmental monitoring, and search and rescue. However, most existing works mainly…

Robotics · Computer Science 2026-05-19 Jianghong Dong , Yifeng Zhang , Jiawei Wang , Mengchi Cai , Keqiang Li , Guillaume Sartoretti

Autonomous edge computing in robotics, smart cities, and autonomous vehicles relies on the seamless integration of sensing, processing, and actuation for real-time decision-making in dynamic environments. At its core is the…

The safe deployment of autonomous driving systems (ADSs) relies on comprehensive testing and evaluation. However, safety-critical scenarios that can effectively expose system vulnerabilities are extremely sparse in the real world. Existing…

Robotics · Computer Science 2025-12-03 Xinzheng Wu , Junyi Chen , Naiting Zhong , Yong Shen

In this paper, we propose a novel framework for enhancing visual comprehension in autonomous driving systems by integrating visual language models (VLMs) with additional visual perception module specialised in object detection. We extend…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Linfeng He , Yiming Sun , Sihao Wu , Jiaxu Liu , Xiaowei Huang

Embodied outdoor scene understanding forms the foundation for autonomous agents to perceive, analyze, and react to dynamic driving environments. However, existing 3D understanding is predominantly based on 2D Vision-Language Models (VLMs),…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Runwei Guan , Jianan Liu , Ningwei Ouyang , Shaofeng Liang , Daizong Liu , Xiaolou Sun , Lianqing Zheng , Ming Xu , Yutao Yue , Guoqiang Mao , Hui Xiong

Moving Object Detection (MOD) is a critical vision task for successfully achieving safe autonomous driving. Despite plausible results of deep learning methods, most existing approaches are only frame-based and may fail to reach reasonable…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Zhuyun Zhou , Zongwei Wu , Rémi Boutteau , Fan Yang , Cédric Demonceaux , Dominique Ginhac

Accurate accident anticipation is essential for enhancing the safety of autonomous vehicles (AVs). However, existing methods often assume ideal conditions, overlooking challenges such as sensor failures, environmental disturbances, and data…

Artificial Intelligence · Computer Science 2025-11-11 Xingcheng Liu , Yanchen Guan , Haicheng Liao , Zhengbing He , Zhenning Li

Traffic collision reconstruction traditionally relies on human expertise and can be accurate, but pre-crash reconstruction is more challenging. This study develops a multi-agent AI framework that reconstructs pre-crash scenarios and infers…

Artificial Intelligence · Computer Science 2026-04-03 Gerui Xu , Boyou Chen , Huizhong Guo , Dave LeBlanc , Arpan Kusari , Efe Yarbasi , Ananna Ahmed , Zhaonan Sun , Shan Bao

Integrating large language models (LLMs) into autonomous driving motion planning has recently emerged as a promising direction, offering enhanced interpretability, better controllability, and improved generalization in rare and long-tail…

Artificial Intelligence · Computer Science 2025-07-29 Zhipeng Tang , Sha Zhang , Jiajun Deng , Chenjie Wang , Guoliang You , Yuting Huang , Xinrui Lin , Yanyong Zhang

V2X cooperation, through the integration of sensor data from both vehicles and infrastructure, is considered a pivotal approach to advancing autonomous driving technology. Current research primarily focuses on enhancing perception accuracy,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Zhiwei Li , Bozhen Zhang , Lei Yang , Tianyu Shen , Nuo Xu , Ruosen Hao , Weiting Li , Tao Yan , Huaping Liu

In this work, we study how vision-language models (VLMs) can be utilized to enhance the safety for the autonomous driving system, including perception, situational understanding, and path planning. However, existing research has largely…

Artificial Intelligence · Computer Science 2025-07-30 Hao Ye , Mengshi Qi , Zhaohong Liu , Liang Liu , Huadong Ma

Current LLM-based driving agents that rely on unstructured plain-text memory suffer from low-precision scene retrieval and inefficient reflection. To address this limitation, we present RESPOND, a structured decision-making framework for…

Human-Computer Interaction · Computer Science 2025-12-24 Dan Chen , Heye Huang , Tiantian Chen , Zheng Li , Yongji Li , Yuhui Xu , Sikai Chen

End-to-end autonomous driving systems promise stronger performance through unified optimization of perception, motion forecasting, and planning. However, vision-based approaches face fundamental limitations in adverse weather conditions,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Philipp Wolters , Johannes Gilg , Torben Teepe , Gerhard Rigoll

Reinforcement Learning (RL) has emerged as a dominant paradigm for end-to-end autonomous driving (AD). However, RL suffers from sample inefficiency and a lack of semantic interpretability in complex scenarios. Foundation Models,…

Artificial Intelligence · Computer Science 2026-02-12 Yansong Qu , Zihao Sheng , Zilin Huang , Jiancong Chen , Yuhao Luo , Tianyi Wang , Yiheng Feng , Samuel Labi , Sikai Chen

Vision-language models (VLMs) serve as general-purpose end-to-end models in autonomous driving, performing subtasks such as prediction, planning, and perception through question-and-answer interactions. However, most existing methods rely…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Enming Zhang , Xingyuan Dai , Min Huang , Yisheng Lv , Qinghai Miao

Single-vehicle Vision-Language Models (VLMs) are fundamentally constrained by sensor occlusions. While Vehicle-to-Everything (V2X) systems mitigate this, current benchmarks lack the cooperative reasoning required for resolving ambiguities…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Kevin Richard , Alphin Varghese , Colin Pham , David Oh , Srijan Das

End-to-end autonomous driving (AD) systems increasingly adopt vision-language-action (VLA) models, yet they typically ignore the passenger's emotional state, which is central to comfort and AD acceptance. We introduce Open-Domain End-to-End…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Yihong Tang , Haicheng Liao , Tong Nie , Junlin He , Ao Qu , Kehua Chen , Wei Ma , Zhenning Li , Lijun Sun , Chengzhong Xu

Vision-Language Action (VLA) models unify perception, reasoning, and trajectory generation for autonomous driving, but suffer from significant inference latency due to deep transformer stacks. We present DeeAD, a training-free,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Haibo HU , Lianming Huang , Nan Guan , Chun Jason Xue

Occlusion is a major challenge for LiDAR-based object detection methods. This challenge becomes safety-critical in urban traffic where the ego vehicle must have reliable object detection to avoid collision while its field of view is…

Robotics · Computer Science 2023-09-20 Minh-Quan Dao , Julie Stephany Berrio , Vincent Frémont , Mao Shan , Elwan Héry , Stewart Worrall