English
Related papers

Related papers: DualAD: Dual-Layer Planning for Reasoning in Auton…

200 papers

Effectively integrating Large Language Models (LLMs) into autonomous driving requires a balance between leveraging high-level reasoning and maintaining real-time efficiency. Existing approaches either activate LLMs too frequently, causing…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Ruifei Zhang , Junlin Xie , Wei Zhang , Weikai Chen , Xiao Tan , Xiang Wan , Guanbin Li

Coarse-to-fine path decision-making requires predicting a valid taxonomy path in which earlier decisions constrain later ones. However, existing benchmarks score each level independently, obscuring cross-level validity and consistency. To…

Multimedia · Computer Science 2026-03-20 Wei Yang , Yiran Zhu , Zilin Li , Xunjia Zhang , Jun Xia , Hongtao Wang

Multimodal Large Language Models (MLLMs) are rapidly becoming the intelligence brain of end-to-end autonomous driving systems. A key challenge is to assess whether MLLMs can truly understand and follow complex real-world traffic rules.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Enhui Ma , Jiahuan Zhang , Guantian Zheng , Tao Tang , Shengbo Eben Li , Yuhang Lu , Xia Zhou , Xueyang Zhang , Yifei Zhan , Kun Zhan , Zhihui Hao , Xianpeng Lang , Kaicheng Yu

The advances in vision-language models (VLMs) have led to a growing interest in autonomous driving to leverage their strong reasoning capabilities. However, extending these capabilities from 2D to full 3D understanding is crucial for…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Shihao Wang , Zhiding Yu , Xiaohui Jiang , Shiyi Lan , Min Shi , Nadine Chang , Jan Kautz , Ying Li , Jose M. Alvarez

The advances in vision-language models (VLMs) have led to a growing interest in autonomous driving to leverage their strong reasoning capabilities. However, extending these capabilities from 2D to full 3D understanding is crucial for…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Shihao Wang , Zhiding Yu , Xiaohui Jiang , Shiyi Lan , Min Shi , Nadine Chang , Jan Kautz , Ying Li , Jose M. Alvarez

Autonomous driving (AD) has achieved significant progress, yet single-vehicle perception remains constrained by sensing range and occlusions. Vehicle-to-Everything (V2X) communication addresses these limits by enabling collaboration across…

Artificial Intelligence · Computer Science 2025-10-06 Xuewen Luo , Fengze Yang , Fan Ding , Xiangbo Gao , Shuo Xing , Yang Zhou , Zhengzhong Tu , Chenxi Liu

Current approaches of Reinforcement Learning (RL) applied in urban Autonomous Driving (AD) focus on decoupling the perception training from the driving policy training. The main reason is to avoid training a convolution encoder alongside a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Daniel Coelho , Miguel Oliveira , Vitor Santos

End-to-end autonomous driving systems map sensor data directly to control commands, but remain opaque, lack interpretability, and offer no formal safety guarantees. While recent vision-language-guided reinforcement learning (RL) methods…

Many fields could benefit from the rapid development of the large language models (LLMs). The end-to-end autonomous driving (e2eAD) is one of the typically fields facing new opportunities as the LLMs have supported more and more modalities.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Peiru Zheng , Yun Zhao , Zhan Gong , Hong Zhu , Shaohua Wu

Recent advancements in large language models (LLMs) have shown promise in multi-step reasoning tasks, yet their reliance on extensive manual labeling to provide procedural feedback remains a significant impediment. To address this…

Computation and Language · Computer Science 2024-02-20 Zhaorun Chen , Zhuokai Zhao , Zhihong Zhu , Ruiqi Zhang , Xiang Li , Bhiksha Raj , Huaxiu Yao

Vision-based autonomous driving has gained much attention due to its low costs and excellent performance. Compared with dense BEV (Bird's Eye View) or sparse query models, Gaussian-centric method is a comprehensive yet sparse representation…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Yiyao Zhu , Ying Xue , Haiming Zhang , Guangfeng Jiang , Wending Zhou , Xu Yan , Jiantao Gao , Yingjie Cai , Bingbing Liu , Zhen Li , Shaojie Shen

While anomaly detection has made significant progress, generating detailed analyses that incorporate industrial knowledge remains a challenge. To address this gap, we introduce OmniAD, a novel framework that unifies anomaly detection and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Shifang Zhao , Yiheng Lin , Lu Han , Yao Zhao , Yunchao Wei

Accurate trajectory prediction has long been a major challenge for autonomous driving (AD). Traditional data-driven models predominantly rely on statistical correlations, often overlooking the causal relationships that govern traffic…

Artificial Intelligence · Computer Science 2025-05-13 Bonan Wang , Haicheng Liao , Chengyue Wang , Bin Rao , Yanchen Guan , Guyang Yu , Jiaxun Zhang , Songning Lai , Chengzhong Xu , Zhenning Li

Recent studies have explored leveraging the world knowledge and cognitive capabilities of Vision-Language Models (VLMs) to address the long-tail problem in end-to-end autonomous driving. However, existing methods typically formulate…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yongkang Li , Kaixin Xiong , Xiangyu Guo , Fang Li , Sixu Yan , Gangwei Xu , Lijun Zhou , Long Chen , Haiyang Sun , Bing Wang , Kun Ma , Guang Chen , Hangjun Ye , Wenyu Liu , Xinggang Wang

Radar has stronger adaptability in adverse scenarios for autonomous driving environmental perception compared to widely adopted cameras and LiDARs. Compared with commonly used 3D radars, the latest 4D radars have precise vertical resolution…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Xinyu Zhang , Li Wang , Jian Chen , Cheng Fang , Lei Yang , Ziying Song , Guangqi Yang , Yichen Wang , Xiaofei Zhang , Jun Li , Zhiwei Li , Qingshan Yang , Zhenlin Zhang , Shuzhi Sam Ge

With the development of autonomous driving, it is becoming increasingly common for autonomous vehicles (AVs) and human-driven vehicles (HVs) to travel on the same roads. Existing single-vehicle planning algorithms on board struggle to…

Robotics · Computer Science 2023-02-15 Licheng Wen , Pinlong Cai , Daocheng Fu , Song Mao , Yikang Li

Recently, two-stage fine-tuning strategies, e.g., acquiring essential driving knowledge through supervised fine-tuning (SFT) and further enhancing decision-making and planning via reinforcement fine-tuning (RFT), have shown strong potential…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Songyan Zhang , Wenhui Huang , Zhan Chen , Chua Jiahao Collister , Qihang Huang , Chen Lv

The growing number of ADAS-equipped vehicles has led to a dramatic increase in driving data, yet most of them capture routine driving behavior. Identifying and understanding safety-critical corner cases within this vast dataset remains a…

Artificial Intelligence · Computer Science 2025-07-23 Yin Wu , Daniel Slieter , Vivek Subramanian , Ahmed Abouelazm , Robin Bohn , J. Marius Zöllner

Autonomous driving policies are typically trained via open-loop behavior cloning of human demonstrations. However, such policies suffer from covariate shift when deployed in closed loop, leading to compounding errors. We introduce Rollouts…

Recent advances in large language models (LLMs) have shown that Chain-of-Thought (CoT) reasoning can substantially improve performance on complex reasoning tasks. At the same time, In-Context Learning (ICL) has become an important mechanism…

Computation and Language · Computer Science 2026-05-19 Rui Chu