English
Related papers

Related papers: Bench2Drive-R: Turning Real World Data into Reacti…

200 papers

End-to-end (E2E) autonomous driving heavily relies on closed-loop simulation, where perception, planning, and control are jointly trained and evaluated in interactive environments. Yet, most existing datasets are collected from the real…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Zhijie Qiao , Zhong Cao , Henry X. Liu

Autonomous driving evaluation requires simulation environments that closely replicate actual road conditions, including real-world sensory data and responsive feedback loops. However, many existing simulations need to predict waypoints…

Robotics · Computer Science 2024-11-19 Tianyi Yan , Dongming Wu , Wencheng Han , Junpeng Jiang , Xia Zhou , Kun Zhan , Cheng-zhong Xu , Jianbing Shen

Generative models offer a scalable and flexible paradigm for simulating complex environments, yet current approaches fall short in addressing the domain-specific requirements of autonomous driving - such as multi-agent interactions,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Lloyd Russell , Anthony Hu , Lorenzo Bertoni , George Fedoseev , Jamie Shotton , Elahe Arani , Gianluca Corrado

Autonomous Driving (AD) systems demand the high levels of safety assurance. Despite significant advancements in AD demonstrated on open-source benchmarks like Longest6 and Bench2Drive, existing datasets still lack regulatory-compliant…

Robotics · Computer Science 2025-05-21 Jingzheng Li , Tiancheng Wang , Xingyu Peng , Jiacheng Chen , Zhijun Chen , Bing Li , Xianglong Liu

Reinforcement Learning (RL) can mitigate the causal confusion and distribution shift inherent to imitation learning (IL). However, applying RL to end-to-end autonomous driving (E2E-AD) remains an open problem for its training difficulty,…

Robotics · Computer Science 2025-10-28 Zhenjie Yang , Xiaosong Jia , Qifeng Li , Xue Yang , Maoqing Yao , Junchi Yan

Safety is a long-standing and the final pursuit in the development of autonomous driving systems, with a significant portion of safety challenge arising from perception. How to effectively evaluate the safety as well as the reliability of…

The acquisition of large-scale physical interaction data, a critical prerequisite for modern robot learning, is severely bottlenecked by the prohibitive cost and scalability limits of human-in-the-loop collection paradigms. To break this…

Robotics · Computer Science 2026-03-13 Yongzhong Wang , Keyu Zhu , Yong Zhong , Liqiong Wang , Jinyu Yang , Feng Zheng

Due to the powerful vision-language reasoning and generalization abilities, multimodal large language models (MLLMs) have garnered significant attention in the field of end-to-end (E2E) autonomous driving. However, their application to…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Xueyi Liu , Zuodong Zhong , Yuxin Guo , Yun-Fu Liu , Zhiguo Su , Qichao Zhang , Junli Wang , Yinfeng Gao , Yupeng Zheng , Qiao Lin , Huiyong Chen , Dongbin Zhao

Over the past few years there is a growing interest in the learning-based self driving system. To ensure safety, such systems are first developed and validated in simulators before being deployed in the real world. However, most of the…

Robotics · Computer Science 2021-03-15 Quanyi Li , Zhenghao Peng , Qihang Zhang , Chunxiao Liu , Bolei Zhou

Generalization is a central challenge in autonomous driving, as real-world deployment requires robust performance under unseen scenarios, sensor domains, and environmental conditions. Recent world-model-based planning methods have shown…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Mengmeng Liu , Diankun Zhang , Jiuming Liu , Jianfeng Cui , Hongwei Xie , Guang Chen , Hangjun Ye , Michael Ying Yang , Francesco Nex , Hao Cheng

Open-loop evaluation offers fast, reproducible assessment of autonomous driving planners, but its ability to predict real closed-loop driving performance remains questionable. Prior work has shown that traditional open-loop metrics such as…

Robotics · Computer Science 2026-05-04 Yiru Wang , Anqing Jiang , Shuo Wang , Yuwen Heng , Hai Yang , Yang Chen , Hao Sun

End-to-end autonomous driving aims to generate safe and plausible planning policies from raw sensor input. Driving world models have shown great potential in learning rich representations by predicting the future evolution of a driving…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Xingtai Gui , Meijie Zhang , Tianyi Yan , Wencheng Han , Jiahao Gong , Feiyang Tan , Cheng-zhong Xu , Jianbing Shen

Datasets are essential for training and testing vehicle perception algorithms. However, the collection and annotation of real-world images is time-consuming and expensive. Driving simulators offer a solution by automatically generating…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Haonan Zhao , Yiting Wang , Thomas Bashford-Rogers , Valentina Donzella , Kurt Debattista

In the past few decades, autonomous driving algorithms have made significant progress in perception, planning, and control. However, evaluating individual components does not fully reflect the performance of entire systems, highlighting the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Hongyu Zhou , Longzhong Lin , Jiabao Wang , Yichong Lu , Dongfeng Bai , Bingbing Liu , Yue Wang , Andreas Geiger , Yiyi Liao

Vehicle-to-Everything (V2X) communication has emerged as a promising paradigm for autonomous driving, enabling connected agents to share complementary perception information and negotiate with each other to benefit the final planning.…

Simulation-based testing has emerged as an essential tool for verifying and validating autonomous vehicles (AVs). However, contemporary methodologies, such as deterministic and imitation learning-based driver models, struggle to capture the…

Robotics · Computer Science 2025-11-04 Cheng Wang , Lingxin Kong , Massimiliano Tamborski , Stefano V. Albrecht

Neural Radiance Fields (NeRFs) have emerged as promising tools for advancing autonomous driving (AD) research, offering scalable closed-loop simulation and data augmentation capabilities. However, to trust the results achieved in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Carl Lindström , Georg Hess , Adam Lilja , Maryam Fatemi , Lars Hammarstrand , Christoffer Petersson , Lennart Svensson

Driving simulators play a large role in developing and testing new intelligent vehicle systems. The visual fidelity of the simulation is critical for building vision-based algorithms and conducting human driver experiments. Low visual…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Ekim Yurtsever , Dongfang Yang , Ibrahim Mert Koc , Keith A. Redmill

Simulation is a crucial step in ensuring accurate, efficient, and realistic Connected and Autonomous Vehicles (CAVs) testing and validation. As the adoption of CAV accelerates, the integration of real-world data into simulation environments…

Robotics · Computer Science 2024-09-27 Junwei You , Pei Li , Yang Cheng , Keshu Wu , Rui Gan , Steven T. Parker , Bin Ran

End-to-end autonomous driving solutions, which process multi-modal sensory data to directly generate refined control commands, have become a dominant paradigm in autonomous driving research. However, these approaches predominantly depend on…

Robotics · Computer Science 2025-05-12 Ruidan Xing , Runyi Huang , Qing Xu , Lei He