English
Related papers

Related papers: DriveE2E: Closed-Loop Benchmark for End-to-End Aut…

200 papers

This paper presents a digital-twin platform for active safety analysis in mixed traffic environments. The platform is built using a multi-modal data-enabled traffic environment constructed from drone-based aerial LiDAR, OpenStreetMap, and…

Robotics · Computer Science 2025-04-28 Hao Zhang , Ximin Yue , Kexin Tian , Sixu Li , Keshu Wu , Zihao Li , Dominique Lord , Yang Zhou

Simulators can generate virtually unlimited driving data, yet imitation learning policies in simulation still struggle to achieve robust closed-loop performance. Motivated by this gap, we empirically study how misalignment between…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Long Nguyen , Micha Fauth , Bernhard Jaeger , Daniel Dauner , Maximilian Igl , Andreas Geiger , Kashyap Chitta

Increasing the implemented SAE level of autonomy in road vehicles requires extensive simulations and verifications in a realistic simulation environment before proving ground and public road testing. The level of detail in the simulation…

Robotics · Computer Science 2023-06-02 Mustafa Ridvan Cantas , Levent Guvenc

Designing a driving policy for autonomous vehicles is a difficult task. Recent studies suggested an end-toend (E2E) training of a policy to predict car actuators directly from raw sensory inputs. It is appealing due to the ease of labeled…

Robotics · Computer Science 2019-01-07 Yonatan Glassner , Liran Gispan , Ariel Ayash , Tal Furman Shohet

Autonomous car racing is a challenging task, as it requires precise applications of control while the vehicle is operating at cornering speeds. Traditional autonomous pipelines require accurate pre-mapping, localization, and planning which…

Robotics · Computer Science 2023-03-07 Dvij Kalaria , Qin Lin , John M. Dolan

Existing evaluation paradigms for Autonomous Vehicles (AVs) face critical limitations. Real-world evaluation is often challenging due to safety concerns and a lack of reproducibility, whereas closed-loop simulation can face insufficient…

Human driving behavior is inherently diverse, yet most end-to-end autonomous driving (E2E-AD) systems learn a single average driving style, neglecting individual differences. Achieving personalized E2E-AD faces challenges across three…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Xiaoru Dong , Ruiqin Li , Xiao Han , Zhenxuan Wu , Jiamin Wang , Jian Chen , Qi Jiang , SM Yiu , Xinge Zhu , Yuexin Ma

Vision-based end-to-end (E2E) driving has garnered significant interest in the research community due to its scalability and synergy with multimodal large language models (MLLMs). However, current E2E driving benchmarks primarily feature…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Runsheng Xu , Hubert Lin , Wonseok Jeon , Hao Feng , Yuliang Zou , Liting Sun , John Gorman , Ekaterina Tolstaya , Sarah Tang , Brandyn White , Ben Sapp , Mingxing Tan , Jyh-Jing Hwang , Dragomir Anguelov

Vision-Language Models (VLMs) have recently emerged as a promising paradigm in autonomous driving (AD). However, current performance evaluation protocols for VLM-based AD systems (ADVLMs) are predominantly confined to open-loop settings…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Tianyuan Zhang , Ting Jin , Lu Wang , Jiangfan Liu , Siyuan Liang , Mingchuan Zhang , Aishan Liu , Xianglong Liu

End-to-end autonomous driving has achieved remarkable progress by integrating perception, prediction, and planning into a fully differentiable framework. Yet, to fully realize its potential, an effective online trajectory evaluation is…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Yingyan Li , Yuqi Wang , Yang Liu , Jiawei He , Lue Fan , Zhaoxiang Zhang

Recent advances in generative models have sparked exciting new possibilities in the field of autonomous vehicles. Specifically, video generation models are now being explored as controllable virtual testing environments. Simultaneously,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Jiahao Wang , Zhenpei Yang , Yijing Bai , Yingwei Li , Yuliang Zou , Bo Sun , Abhijit Kundu , Jose Lezama , Luna Yue Huang , Zehao Zhu , Jyh-Jing Hwang , Dragomir Anguelov , Mingxing Tan , Chiyu Max Jiang

Simulation is one of the most essential parts in the development stage of automotive software. However, purely virtual simulations often struggle to accurately capture all real-world factors due to limitations in modeling. To address this…

The end-to-end autonomous driving paradigm has recently attracted lots of attention due to its scalability. However, existing methods are constrained by the limited scale of real-world data, which hinders a comprehensive exploration of the…

Testing Automated Driving Systems (ADS) in simulation with realistic driving scenarios is important for verifying their performance. However, converting real-world driving videos into simulation scenarios is a significant challenge due to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Yan Miao , Georgios Fainekos , Bardh Hoxha , Hideki Okamoto , Danil Prokhorov , Sayan Mitra

Digital twins of urban environments play a critical role in advancing autonomous vehicle (AV) research by enabling simulation, validation, and integration with emerging generative world models. While existing tools have demonstrated value,…

Robotics · Computer Science 2025-12-01 Alex Richardson , Jonathan Sprinkle

While recent developments in autonomous vehicle (AV) technology highlight substantial progress, we lack tools for rigorous and scalable testing. Real-world testing, the $\textit{de facto}$ evaluation environment, places the public in…

Machine Learning · Computer Science 2019-01-15 Matthew O'Kelly , Aman Sinha , Hongseok Namkoong , John Duchi , Russ Tedrake

End-to-end autonomous driving has received increasing attention due to its potential to learn from large amounts of data. However, most existing methods are still open-loop and suffer from weak scalability, lack of high-order interactions,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Wenzhao Zheng , Zetian Xia , Yuanhui Huang , Sicheng Zuo , Jie Zhou , Jiwen Lu

Autonomous vehicles need safe development and testing environments. Many traffic scenarios are such that they cannot be tested in the real world. We see hybrid photorealistic simulation as a viable tool for developing AI (artificial…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-10 Jussi Hanhirova , Anton Debner , Matias Hyyppä , Vesa Hirvisalo

Robustness is a critical requirement for deploying autonomous driving systems in the real world. Existing robustness benchmarks for autonomous driving have made important progress in studying the effects of image-level corruptions, such as…

Driving simulation plays a crucial role in developing reliable driving agents by providing controlled, evaluative environments. To enable meaningful assessments, a high-quality driving simulator must satisfy several key requirements:…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Junzhe Jiang , Nan Song , Jingyu Li , Xiatian Zhu , Li Zhang