English
Related papers

Related papers: Bench2Drive-R: Turning Real World Data into Reacti…

200 papers

End-to-end autonomous driving has gained significant attention for its potential to learn robust behavior in interactive scenarios and scale with data. Popular architectures often build on separate modules for perception and planning…

Robotics · Computer Science 2026-03-17 David Holtz , Niklas Hanselmann , Simon Doll , Marius Cordts , Bernt Schiele

End-to-end autonomous driving policies based on Imitation Learning (IL) often struggle in closed-loop execution due to the misalignment between inadequate open-loop training objectives and real driving requirements. While Reinforcement…

We introduce GE-Sim 2.0 (Genie Envisioner World Simulator 2.0), a closed-loop video world simulator for robotic manipulation. Building on the action-conditioned video generation framework of Genie Envisioner, GE-Sim 2.0 is re-trained on…

Real-world autonomous driving (AD) especially urban driving involves many corner cases. The lately released AD simulator CARLA v2 adds 39 common events in the driving scene, and provide more quasi-realistic testbed compared to CARLA v1. It…

Robotics · Computer Science 2024-07-23 Qifeng Li , Xiaosong Jia , Shaobo Wang , Junchi Yan

Vision-Language-Action (VLA) models are emerging as highly effective planning models for end-to-end autonomous driving systems. However, current works mostly rely on imitation learning from sparse trajectory annotations and under-utilize…

Vision-Language-Action (VLA) models in autonomous driving systems have recently demonstrated transformative potential by integrating multimodal perception with decision-making capabilities. However, the interpretability and coherence of the…

Safety-critical scenarios are essential for training and evaluating autonomous driving (AD) systems, yet remain extremely rare in real-world driving datasets. To address this, we propose Real-world Crash Grounding (RCG), a scenario…

Robotics · Computer Science 2025-07-16 Benjamin Stoler , Juliet Yang , Jonathan Francis , Jean Oh

End-to-End (E2E) planning has become a powerful paradigm for autonomous driving, yet current systems remain fundamentally uncertainty-blind. They assume perception outputs are fully reliable, even in ambiguous or poorly observed scenes,…

Robotics · Computer Science 2025-12-01 Wonjeong Ryu , Seungjun Yu , Seokha Moon , Hojun Choi , Junsung Park , Jinkyu Kim , Hyunjung Shim

While the capabilities of autonomous driving have advanced rapidly, merging into dense traffic remains a significant challenge, many motion planning methods for this scenario have been proposed but it is hard to evaluate them. Most existing…

Robotics · Computer Science 2025-04-03 Zhengming Wang , Junli Wang , Pengfei Li , Zhaohan Li , Chunyang Liu , Bo Zhang , Peng Li , Yilun Chen

End-to-end autonomous driving has received increasing attention due to its potential to learn from large amounts of data. However, most existing methods are still open-loop and suffer from weak scalability, lack of high-order interactions,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Wenzhao Zheng , Zetian Xia , Yuanhui Huang , Sicheng Zuo , Jie Zhou , Jiwen Lu

End-to-end autonomous driving (E2E-AD) has emerged as a trend in the field of autonomous driving, promising a data-driven, scalable approach to system design. However, existing E2E-AD methods usually adopt the sequential paradigm of…

Machine Learning · Computer Science 2025-07-14 Xiaosong Jia , Junqi You , Zhiyuan Zhang , Junchi Yan

End-to-end (E2E) autonomous driving models that take only camera images as input and directly predict a future trajectory are appealing for their computational efficiency and potential for improved generalization via unified optimization;…

Robotics · Computer Science 2026-04-10 Chihiro Noguchi , Takaki Yamamoto

End-to-End Autonomous Driving (E2E-AD) systems are typically grouped by the nature of their outputs: (i) waypoint-based models that predict a future trajectory, and (ii) action-based models that directly output throttle, steer and brake.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Jorge Daniel Rodríguez-Vidal , Gabriel Villalonga , Diego Porres , Antonio M. López Peña

In recent years, autonomous parking has made significant advances, yet parking tasks still face challenges in extreme scenarios such as mechanical and dead-end parking slots, often resulting in failures. This is mainly due to traditional…

Robotics · Computer Science 2026-05-12 Changze Li , Zhe Chen , Shaoyu Chen , Lisen Mu , Yijian Li , Yuelong Yu , Qian Zhang , Qing Su , Ming Yang , Tong Qin

Existing end-to-end autonomous driving (AD) algorithms typically follow the Imitation Learning (IL) paradigm, which faces challenges such as causal confusion and an open-loop gap. In this work, we propose RAD, a 3DGS-based closed-loop…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Hao Gao , Shaoyu Chen , Bo Jiang , Bencheng Liao , Yiang Shi , Xiaoyang Guo , Yuechuan Pu , Haoran Yin , Xiangyu Li , Xinbang Zhang , Ying Zhang , Wenyu Liu , Qian Zhang , Xinggang Wang

This paper introduces CRITICAL, a novel closed-loop framework for autonomous vehicle (AV) training and testing. CRITICAL stands out for its ability to generate diverse scenarios, focusing on critical driving situations that target specific…

End-to-End autonomous driving (E2E-AD) has emerged as a new paradigm, where trajectory planning plays a crucial role. Existing studies mainly follow two directions: trajectory generation oriented, which focuses on producing high-quality…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Bin Sun , Yaoguang Cao , Yan Wang , Rui Wang , Jiachen Shang , Xiejie Feng , Jiayi Lu , Jia Shi , Shichun Yang , Xiaoyu Yan , Ziying Song

World models have emerged as promising neural simulators for autonomous driving, with the potential to supplement scarce real-world data and enable closed-loop evaluations. However, current research primarily evaluates these models based on…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Hidehisa Arai , Keishi Ishihara , Tsubasa Takahashi , Yu Yamaguchi

Video generation models, as one form of world models, have emerged as one of the most exciting frontiers in AI, promising agents the ability to imagine the future by modeling the temporal evolution of complex scenes. In autonomous driving,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yang Zhou , Hao Shao , Letian Wang , Zhuofan Zong , Hongsheng Li , Steven L. Waslander

Despite rapid progress in autonomous driving, reliable training and evaluation of driving systems remain fundamentally constrained by the lack of scalable and interactive simulation environments. Recent generative video models achieve…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yaoru Li , Federico Landi , Marco Godi , Xin Jin , Ruiju Fu , Yufei Ma , Muyang Sun , Heyu Si , Qi Guo