English
Related papers

Related papers: Improving the Generalization of End-to-End Driving…

200 papers

Most self-driving systems rely on hand-coded perception outputs and engineered driving rules. Learning directly from human driving data with an end-to-end method can allow for a training architecture that is simpler and scales well with…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Mitchell Goff , Greg Hogan , George Hotz , Armand du Parc Locmaria , Kacper Raczy , Harald Schäfer , Adeeb Shihadeh , Weixing Zhang , Yassine Yousfi

End-to-end autonomous driving systems, predominantly trained through imitation learning, have demonstrated considerable effectiveness in leveraging large-scale expert driving data. Despite their success in open-loop evaluations, these…

Robotics · Computer Science 2025-11-12 Yi Huang , Zhan Qu , Lihui Jiang , Bingbing Liu , Hongbo Zhang

Autonomous driving systems have witnessed a significant development during the past years thanks to the advance in machine learning-enabled sensing and decision-making algorithms. One critical challenge for their massive deployment in the…

Robotics · Computer Science 2023-06-22 Wenhao Ding , Chejian Xu , Mansur Arief , Haohong Lin , Bo Li , Ding Zhao

Driving simulation plays a crucial role in developing reliable driving agents by providing controlled, evaluative environments. To enable meaningful assessments, a high-quality driving simulator must satisfy several key requirements:…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Junzhe Jiang , Nan Song , Jingyu Li , Xiatian Zhu , Li Zhang

Autonomous driving is of great interest to industry and academia alike. The use of machine learning approaches for autonomous driving has long been studied, but mostly in the context of perception. In this paper we take a deeper look on the…

Artificial Intelligence · Computer Science 2021-03-03 Ardi Tampuu , Maksym Semikin , Naveed Muhammad , Dmytro Fishman , Tambet Matiisen

The generation of realistic and diverse traffic scenarios in simulation is essential for developing and evaluating autonomous driving systems. However, most simulation frameworks rely on rule-based or simplified models for scene generation,…

Multiagent Systems · Computer Science 2025-12-02 Jiaguo Tian , Zhengbang Zhu , Shenyu Zhang , Li Xu , Bo Zheng , Xu Liu , Weiji Peng , Shizeng Yao , Weinan Zhang

Recent advancements in driving world models enable controllable generation of high-quality RGB videos or multimodal videos. Existing methods primarily focus on metrics related to generation quality and controllability. However, they often…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Kai Zeng , Zhanqian Wu , Kaixin Xiong , Xiaobao Wei , Xiangyu Guo , Zhenxin Zhu , Kalok Ho , Lijun Zhou , Bohan Zeng , Ming Lu , Haiyang Sun , Bing Wang , Guang Chen , Hangjun Ye , Wentao Zhang

Video generation models, as one form of world models, have emerged as one of the most exciting frontiers in AI, promising agents the ability to imagine the future by modeling the temporal evolution of complex scenes. In autonomous driving,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yang Zhou , Hao Shao , Letian Wang , Zhuofan Zong , Hongsheng Li , Steven L. Waslander

Safety remains one of the most critical challenges in autonomous driving systems. In recent years, the end-to-end driving has shown great promise in advancing vehicle autonomy in a scalable manner. However, existing approaches often face…

Robotics · Computer Science 2025-05-12 Zhiwei Zhang , Ruichen Yang , Ke Wu , Zijun Xu , Jingchu Liu , Lisen Mu , Zhongxue Gan , Wenchao Ding

Machine learning based autonomous driving systems often face challenges with safety-critical scenarios that are rare in real-world data, hindering their large-scale deployment. While increasing real-world training data coverage could…

Machine Learning · Computer Science 2024-09-13 Yuan Yin , Pegah Khayatan , Éloi Zablocki , Alexandre Boulch , Matthieu Cord

An ideal traffic simulator replicates the realistic long-term point-to-point trip that a self-driving system experiences during deployment. Prior models and benchmarks focus on closed-loop motion simulation for initial agents in a scene.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Xiuyu Yang , Shuhan Tan , Philipp Krähenbühl

End-to-end (E2E) autonomous driving (AD) models require diverse, high-quality data to perform well across various driving scenarios. However, collecting large-scale real-world data is expensive and time-consuming, making high-fidelity…

Robotics · Computer Science 2025-03-25 Junhao Ge , Zuhong Liu , Longteng Fan , Yifan Jiang , Jiaqi Su , Yiming Li , Zhejun Zhang , Siheng Chen

Automated lane changing is a critical feature for advanced autonomous driving systems. In recent years, reinforcement learning (RL) algorithms trained on traffic simulators yielded successful results in computing lane changing policies that…

Robotics · Computer Science 2021-03-16 Anil Ozturk , Mustafa Burak Gunel , Melih Dal , Ugur Yavas , Nazim Kemal Ure

Simulation-based testing has emerged as an essential tool for verifying and validating autonomous vehicles (AVs). However, contemporary methodologies, such as deterministic and imitation learning-based driver models, struggle to capture the…

Robotics · Computer Science 2025-11-04 Cheng Wang , Lingxin Kong , Massimiliano Tamborski , Stefano V. Albrecht

Accurate trajectory prediction is fundamental to autonomous driving, as it underpins safe motion planning and collision avoidance in complex environments. However, existing benchmark datasets suffer from a pronounced long-tail distribution…

Robotics · Computer Science 2025-10-06 Ruining Yang , Yi Xu , Yixiao Chen , Yun Fu , Lili Su

The current autonomous stack is well modularized and consists of perception, decision making and control in a handcrafted framework. With the advances in artificial intelligence (AI) and computing resources, researchers have been pushing…

Robotics · Computer Science 2024-04-19 Satya R. Jaladi , Zhimin Chen , Narahari R. Malayanur , Raja M. Macherla , Bing Li

Recent advancements in world models have revolutionized dynamic environment simulation, allowing systems to foresee future states and assess potential actions. In autonomous driving, these capabilities help vehicles anticipate the behavior…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Anthony Chen , Wenzhao Zheng , Yida Wang , Xueyang Zhang , Kun Zhan , Peng Jia , Kurt Keutzer , Shanghang Zhang

Current methods to learn controllers for autonomous vehicles (AVs) focus on behavioural cloning. Being trained only on exact historic data, the resulting agents often generalize poorly to novel scenarios. Simulators provide the opportunity…

Artificial Intelligence · Computer Science 2025-11-19 Asen Nachkov , Danda Pani Paudel , Luc Van Gool

Realistic and interactive traffic simulation is essential for training and evaluating autonomous driving systems. However, most existing data-driven simulation methods rely on static initialization or log-replay data, limiting their ability…

Robotics · Computer Science 2026-03-04 Zhenghao Peng , Yuxin Liu , Bolei Zhou

Autonomous driving technologies have achieved significant advances in recent years, yet their real-world deployment remains constrained by data scarcity, safety requirements, and the need for generalization across diverse environments. In…

Artificial Intelligence · Computer Science 2026-04-06 A. Humnabadkar , A. Sikdar , B. Cave , H. Zhang , N. Bessis , A. Behera