English
Related papers

Related papers: Fail2Drive: Benchmarking Closed-Loop Driving Gener…

200 papers

The primary focus of autonomous driving research is to improve driving accuracy. While great progress has been made, state-of-the-art algorithms still fail at times. Such failures may have catastrophic consequences. It therefore is…

Computer Vision and Pattern Recognition · Computer Science 2018-05-07 Simon Hecker , Dengxin Dai , Luc Van Gool

Human driving behavior is inherently diverse, yet most end-to-end autonomous driving (E2E-AD) systems learn a single average driving style, neglecting individual differences. Achieving personalized E2E-AD faces challenges across three…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Xiaoru Dong , Ruiqin Li , Xiao Han , Zhenxuan Wu , Jiamin Wang , Jian Chen , Qi Jiang , SM Yiu , Xinge Zhu , Yuexin Ma

Despite significant recent progress in the field of autonomous driving, modern methods still struggle and can incur serious accidents when encountering long-tail unforeseen events and challenging urban scenarios. On the one hand, large…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Hao Shao , Yuxuan Hu , Letian Wang , Steven L. Waslander , Yu Liu , Hongsheng Li

Recent advances in autonomous driving research towards motion planners that are robust, safe, and adaptive. However, existing rule-based and data-driven planners lack adaptability to long-tail scenarios, while knowledge-driven methods offer…

Robotics · Computer Science 2026-04-10 Huaiyuan Yao , Pengfei Li , Bu Jin , Yupeng Zheng , An Liu , Lisen Mu , Qing Su , Qian Zhang , Yilun Chen , Peng Li

End-to-end (E2E) models in autonomous driving aim to directly map sensor inputs to control commands, but their ability to generalize to novel and complex scenarios remains a key challenge. The common practice of fully fine-tuning the vision…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Zeyu Dong , Yimin Zhu , Yu Wu , Yu Sun

Generalization of imitation-learned navigation policies to environments unseen in training remains a major challenge. We address this by conducting the first large-scale study of how data quantity and data diversity affect real-world…

Open-loop (OL) to closed-loop (CL) gap (OL-CL gap) exists when OL-pretrained policies scoring high in OL evaluations fail to transfer effectively in closed-loop (CL) deployment. In this paper, we unveil the root causes of this systemic…

The large-scale deployment of autonomous vehicles is yet to come, and one of the major remaining challenges lies in urban dense traffic scenarios. In such cases, it remains challenging to predict the future evolution of the scene and future…

Computer Vision and Pattern Recognition · Computer Science 2023-05-19 Hao Shao , Letian Wang , Ruobing Chen , Steven L. Waslander , Hongsheng Li , Yu Liu

Simulation-based testing is the standard practice for assessing the reliability of self-driving cars' software before deployment. Existing bug-finding techniques are either unreliable or expensive. We build on the insight that near misses…

Software Engineering · Computer Science 2025-12-23 M M Abid Naziri , Stefano Carlo Lambertenghi , Andrea Stocco , Marcelo d'Amorim

Open-loop evaluation offers fast, reproducible assessment of autonomous driving planners, but its ability to predict real closed-loop driving performance remains questionable. Prior work has shown that traditional open-loop metrics such as…

Robotics · Computer Science 2026-05-04 Yiru Wang , Anqing Jiang , Shuo Wang , Yuwen Heng , Hai Yang , Yang Chen , Hao Sun

Reliable testing of autonomous driving systems requires simulation environments that combine large-scale traffic modeling with realistic 3D perception and terrain. Existing tools rarely capture real-world elevation, limiting their…

Robotics · Computer Science 2025-12-15 Chandra Raskoti , Weizi Li

Human-driven vehicles (HVs) exhibit complex and diverse behaviors. Accurately modeling such behavior is crucial for validating Robot Vehicles (RVs) in simulation and realizing the potential of mixed traffic control. However, existing…

Robotics · Computer Science 2024-07-10 Bibek Poudel , Weizi Li , Shuai Li

We present COALA, a vision-centric Federated Learning (FL) platform, and a suite of benchmarks for practical FL scenarios, which we categorize into three levels: task, data, and model. At the task level, COALA extends support from simple…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Weiming Zhuang , Jian Xu , Chen Chen , Jingtao Li , Lingjuan Lyu

While recent developments in autonomous vehicle (AV) technology highlight substantial progress, we lack tools for rigorous and scalable testing. Real-world testing, the $\textit{de facto}$ evaluation environment, places the public in…

Machine Learning · Computer Science 2019-01-15 Matthew O'Kelly , Aman Sinha , Hongseok Namkoong , John Duchi , Russ Tedrake

World models can foresee the outcomes of different actions, which is of paramount importance for autonomous driving. Nevertheless, existing driving world models still have limitations in generalization to unseen environments, prediction…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Shenyuan Gao , Jiazhi Yang , Li Chen , Kashyap Chitta , Yihang Qiu , Andreas Geiger , Jun Zhang , Hongyang Li

Against the backdrop of advancing science and technology, autonomous vehicle technology has emerged as a focal point of intense scrutiny within the academic community. Nevertheless, the challenge persists in guaranteeing the safety and…

Artificial Intelligence · Computer Science 2024-07-03 JiaQi Luo

We tackle the problem of localizing traffic cameras within a 3D reference map and propose a novel image-to-point cloud registration (I2P) method, TrafficLoc, in a coarse-tofine matching fashion. To overcome the lack of large-scale…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Yan Xia , Yunxiang Lu , Rui Song , Oussema Dhaouadi , João F. Henriques , Daniel Cremers

Safe autonomous driving requires robust detection of other traffic participants. However, robust does not mean perfect, and safe systems typically minimize missed detections at the expense of a higher false positive rate. This results in…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Andreas Bühler , Adrien Gaidon , Andrei Cramariuc , Rares Ambrus , Guy Rosman , Wolfram Burgard

To autonomously control vehicles, driving agents use outputs from a combination of machine-learning (ML) models, controller logic, and custom modules. Although numerous prior works have shown that adversarial examples can mislead ML models…

Cryptography and Security · Computer Science 2025-11-20 Henry Wong , Clement Fung , Weiran Lin , Karen Li , Stanley Chen , Lujo Bauer

The car-to-driver handover is a critically important component of safe autonomous vehicle operation when the vehicle is unable to safely proceed on its own. Current implementations of this handover in automobiles take the form of a generic…

Robotics · Computer Science 2020-05-12 Aaquib Tabrez , Matthew B. Luebbers , Bradley Hayes