中文
相关论文

相关论文: Collision-Aware Vision-Language Learning for End-t…

200 篇论文

Autonomous driving faces critical challenges in rare long-tail events and complex multi-agent interactions, which are scarce in real-world data yet essential for robust safety validation. This paper presents a high-fidelity scenario…

机器学习 · 计算机科学 2025-11-27 Yuhang Wang , Heye Huang , Zhenhua Xu , Kailai Sun , Baoshen Guo , Jinhua Zhao

Autonomous vehicles (AVs) are poised to redefine transportation by enhancing road safety, minimizing human error, and optimizing traffic efficiency. The success of AVs depends on their ability to interpret complex, dynamic environments…

多媒体 · 计算机科学 2025-07-11 Abolfazl Zarghani , Amirhossein Ebrahimi , Amir Malekesfandiari

The rapid development of Vision-Language models (VLMs) and Multimodal Language Models (MLLMs) in autonomous driving research has significantly reshaped the landscape by enabling richer scene understanding, context-aware reasoning, and more…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Karthik Mohan , Sonam Singh , Amit Arvind Kale

Integrating vision-language models (VLMs) into end-to-end (E2E) autonomous driving (AD) systems has shown promise in improving scene understanding. However, existing integration strategies suffer from several limitations: they either…

计算机视觉与模式识别 · 计算机科学 2026-05-15 Wenhui Huang , Songyan Zhang , Qihang Huang , Zhidong Wang , Zhiqi Mao , Collister Chua , Zhan Chen , Long Chen , Chen Lv

In the pursuit of robust autonomous driving systems, models trained on real-world datasets often struggle to adapt to new environments, particularly when confronted with corner cases such as extreme weather conditions. Collecting these…

计算机视觉与模式识别 · 计算机科学 2025-07-24 Jiacheng Zuo , Haibo Hu , Zikang Zhou , Yufei Cui , Ziquan Liu , Jianping Wang , Nan Guan , Jin Wang , Chun Jason Xue

Traffic accident prediction and detection are critical for enhancing road safety, and vision-based traffic accident anticipation (Vision-TAA) has emerged as a promising approach in the era of deep learning. This paper reviews 147 recent…

计算机视觉与模式识别 · 计算机科学 2025-09-05 Ruonan Lin , Tao Tang , Yongtai Liu , Wenye Zhou , Xin Yang , Hao Zheng , Jianpu Lin , Yi Zhang

Ensuring the safety of vision-language models (VLMs) in autonomous driving systems is of paramount importance, yet existing research has largely focused on conventional benchmarks rather than safety-critical evaluation. In this work, we…

计算机视觉与模式识别 · 计算机科学 2025-10-30 Enming Zhang , Peizhe Gong , Xingyuan Dai , Min Huang , Yisheng Lv , Qinghai Miao

Traffic collision reconstruction traditionally relies on human expertise and can be accurate, but pre-crash reconstruction is more challenging. This study develops a multi-agent AI framework that reconstructs pre-crash scenarios and infers…

人工智能 · 计算机科学 2026-04-03 Gerui Xu , Boyou Chen , Huizhong Guo , Dave LeBlanc , Arpan Kusari , Efe Yarbasi , Ananna Ahmed , Zhaonan Sun , Shan Bao

End-to-end autonomous driving systems excel in common scenarios but struggle with safety-critical long-tail cases. Vision-Language-Action (VLA) models are promising due to their strong reasoning capabilities. However, most VLA-based…

机器人学 · 计算机科学 2026-05-20 Kefei Tian , Yuansheng Lian , Kai Yang , Xiangdong Chen , Shen Li

Accurate driving behavior recognition and reasoning are critical for autonomous driving video understanding. However, existing methods often tend to dig out the shallow causal, fail to address spurious correlations across modalities, and…

计算机视觉与模式识别 · 计算机科学 2025-07-09 Tongtong Cheng , Rongzhen Li , Yixin Xiong , Tao Zhang , Jing Wang , Kai Liu

Recent research on Large Language Models for autonomous driving shows promise in planning and control. However, high computational demands and hallucinations still challenge accurate trajectory prediction and control signal generation.…

机器人学 · 计算机科学 2024-10-03 Ziang Guo , Zakhar Yagudin , Artem Lykov , Mikhail Konenkov , Dzmitry Tsetserukou

Existing end-to-end autonomous driving (AD) algorithms typically follow the Imitation Learning (IL) paradigm, which faces challenges such as causal confusion and an open-loop gap. In this work, we propose RAD, a 3DGS-based closed-loop…

计算机视觉与模式识别 · 计算机科学 2025-10-22 Hao Gao , Shaoyu Chen , Bo Jiang , Bencheng Liao , Yiang Shi , Xiaoyang Guo , Yuechuan Pu , Haoran Yin , Xiangyu Li , Xinbang Zhang , Ying Zhang , Wenyu Liu , Qian Zhang , Xinggang Wang

Unlike popular modularized framework, end-to-end autonomous driving seeks to solve the perception, decision and control problems in an integrated way, which can be more adapting to new scenarios and easier to generalize at scale. However,…

机器人学 · 计算机科学 2020-07-08 Jianyu Chen , Shengbo Eben Li , Masayoshi Tomizuka

End-to-end (E2E) autonomous driving heavily relies on closed-loop simulation, where perception, planning, and control are jointly trained and evaluated in interactive environments. Yet, most existing datasets are collected from the real…

计算机视觉与模式识别 · 计算机科学 2025-11-19 Zhijie Qiao , Zhong Cao , Henry X. Liu

World models have demonstrated significant promise for data synthesis in autonomous driving. However, existing methods predominantly concentrate on single-modality generation, typically focusing on either multi-camera video or LiDAR…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Guosheng Zhao , Yaozeng Wang , Xiaofeng Wang , Zheng Zhu , Tingdong Yu , Guan Huang , Yongchen Zai , Ji Jiao , Changliang Xue , Xiaole Wang , Zhen Yang , Futang Zhu , Xingang Wang

Learning to drive faithfully in highly stochastic urban settings remains an open problem. To that end, we propose a Multi-task Learning from Demonstration (MT-LfD) framework which uses supervised auxiliary task prediction to guide the main…

机器学习 · 计算机科学 2018-08-31 Ashish Mehta , Adithya Subramanian , Anbumani Subramanian

Vision-Language-Action (VLA) models are emerging as a promising paradigm for end-to-end autonomous driving, valued for their potential to leverage world knowledge and reason about complex driving scenes. However, existing methods suffer…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Xinyang Wang , Qian Liu , Wenjie Ding , Zhao Yang , Wei Li , Chang Liu , Bailin Li , Kun Zhan , Xianpeng Lang , Wei Chen

End-to-end autonomous driving has advanced significantly, offering benefits such as system simplicity and stronger driving performance in both open-loop and closed-loop settings than conventional pipelines. However, existing frameworks…

机器人学 · 计算机科学 2025-06-04 Wei Liu , Jiyuan Zhang , Binxiong Zheng , Yufeng Hu , Yingzhan Lin , Zengfeng Zeng

Accurately understanding and deciding high-level meta-actions is essential for ensuring reliable and safe autonomous driving systems. While vision-language models (VLMs) have shown significant potential in various autonomous driving tasks,…

计算机视觉与模式识别 · 计算机科学 2025-03-19 Yujin Wang , Quanfeng Liu , Zhengxin Jiang , Tianyi Wang , Junfeng Jiao , Hongqing Chu , Bingzhao Gao , Hong Chen

Large Vision Language Models (LVLMs) have shown strong capabilities in understanding and analyzing visual scenes across various domains. However, in the context of autonomous driving, their limited comprehension of 3D environments restricts…

计算机视觉与模式识别 · 计算机科学 2025-05-02 Jannik Lübberstedt , Esteban Rivera , Nico Uhlemann , Markus Lienkamp