English
Related papers

Related papers: Improving the Generalization of End-to-End Driving…

200 papers

Generative models have significantly improved the generation and prediction quality on either camera images or LiDAR point clouds for autonomous driving. However, a real-world autonomous driving system uses multiple kinds of input modality,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Zehuan Wu , Jingcheng Ni , Xiaodong Wang , Yuxin Guo , Rui Chen , Lewei Lu , Jifeng Dai , Yuwen Xiong

Self-driving software pipelines include components that are learned from a significant number of training examples, yet it remains challenging to evaluate the overall system's safety and generalization performance. Together with scaling up…

Simulation data can be utilized to extend real-world driving data in order to cover edge cases, such as vehicle accidents. The importance of handling edge cases can be observed in the high societal costs in handling car accidents, as well…

Robotics · Computer Science 2020-07-24 Shivam Akhauri , Laura Zheng , Ming Lin

Simulation environments are good for learning different driving tasks like lane changing, parking or handling intersections etc. in an abstract manner. However, these simulation environments often restrict themselves to operate under…

Machine Learning · Computer Science 2021-11-01 Ashish Rana , Avleen Malhi

Realistic and diverse simulation scenarios with reactive and feasible agent behaviors can be used for validation and verification of self-driving system performance without relying on expensive and time-consuming real-world testing.…

Robotics · Computer Science 2022-04-01 Qichao Zhang , Yinfeng Gao , Yikang Zhang , Youtian Guo , Dawei Ding , Yunpeng Wang , Peng Sun , Dongbin Zhao

End-to-end autonomous driving planners typically generate trajectories from current observations alone. However, real-world driving is highly dynamic, and such reactive planning cannot anticipate future scene evolution, often leading to…

Robotics · Computer Science 2026-04-29 Chuyao Fu , Shengzhe Gan , Zhuoli Ouyang , Yuhan Rui , Xiaowei Chi , Sirui Han , Jiankun Wang , Hong Zhang

We propose ComDrive: the first comfort-oriented end-to-end autonomous driving system to generate temporally consistent and comfortable trajectories. Recent studies have demonstrated that imitation learning-based planners and learning-based…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Junming Wang , Xingyu Zhang , Zebin Xing , Songen Gu , Xiaoyang Guo , Yang Hu , Ziying Song , Qian Zhang , Xiaoxiao Long , Wei Yin

We present ReinDriveGen, a framework that enables full controllability over dynamic driving scenes, allowing users to freely edit actor trajectories to simulate safety-critical corner cases such as front-vehicle collisions, drifting cars,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Hao Zhang , Lue Fan , Weikang Bian , Zehuan Wu , Lewei Lu , Zhaoxiang Zhang , Hongsheng Li

Recent advancements in video generation have substantially improved visual quality and temporal coherence, making these models increasingly appealing for applications such as autonomous driving, particularly in the context of driving…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Chun-Peng Chang , Chen-Yu Wang , Julian Schmidt , Holger Caesar , Alain Pagani

Simulation is increasingly being used for generating large labelled datasets in many machine learning problems. Recent methods have focused on adjusting simulator parameters with the goal of maximising accuracy on a validation task, usually…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Harkirat Singh Behl , Atılım Güneş Baydin , Ran Gal , Philip H. S. Torr , Vibhav Vineet

Autonomous driving systems struggle with complex scenarios due to limited access to diverse, extensive, and out-of-distribution driving data which are critical for safe navigation. World models offer a promising solution to this challenge;…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Xi Guo , Chenjing Ding , Haoxuan Dou , Xin Zhang , Weixuan Tang , Wei Wu

In contemporary autonomous driving testing, virtual simulation has become an important approach due to its efficiency and cost effectiveness. However, existing methods usually rely on reinforcement learning to generate risky scenarios,…

Robotics · Computer Science 2026-03-24 Chen Xiong , Cheng Wang , Yuhang Liu , Zirui Wu , Ye Tian

Deep networks trained on demonstrations of human driving have learned to follow roads and avoid obstacles. However, driving policies trained via imitation learning cannot be controlled at test time. A vehicle trained end-to-end to imitate…

Robotics · Computer Science 2018-03-05 Felipe Codevilla , Matthias Müller , Antonio López , Vladlen Koltun , Alexey Dosovitskiy

We consider the problem of generating realistic traffic scenes automatically. Existing methods typically insert actors into the scene according to a set of hand-crafted heuristics and are limited in their ability to model the true…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Shuhan Tan , Kelvin Wong , Shenlong Wang , Sivabalan Manivasagam , Mengye Ren , Raquel Urtasun

End-to-end autonomous driving has been recently seen rapid development, exerting a profound influence on both industry and academia. However, the existing work places excessive focus on ego-vehicle status as their sole learning objectives…

Robotics · Computer Science 2025-08-08 Rui Yu , Xianghang Zhang , Runkai Zhao , Huaicheng Yan , Meng Wang

Recent breakthroughs in large language models (LLMs) have not only advanced natural language processing but also inspired their application in domains with structurally similar problems--most notably, autonomous driving motion generation.…

Artificial Intelligence · Computer Science 2025-09-04 Mingyi Wang , Jingke Wang , Tengju Ye , Junbo Chen , Kaicheng Yu

Simulation is an integral part in the process of developing autonomous vehicles and advantageous for training, validation, and verification of driving functions. Even though simulations come with a series of benefits compared to real-world…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Ferdinand Mütsch , Helen Gremmelmaier , Nicolas Becker , Daniel Bogdoll , Marc René Zofka , J. Marius Zöllner

End-to-end autonomous driving is a fully differentiable machine learning system that takes raw sensor input data and other metadata as prior information and directly outputs the ego vehicle's control signals or planned trajectories. This…

Robotics · Computer Science 2023-12-01 Apoorv Singh

Fully autonomous driving has been widely studied and is becoming increasingly feasible. However, such autonomous driving has yet to be achieved on public roads, because of various uncertainties due to surrounding human drivers and…

Robotics · Computer Science 2023-05-19 Shunsuke Aoki , Issei Yamamoto , Daiki Shiotsuka , Yuichi Inoue , Kento Tokuhiro , Keita Miwa

Controllable synthetic data generation can substantially lower the annotation cost of training data. Prior works use diffusion models to generate driving images conditioned on the 3D object layout. However, those models are trained on…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Yunsong Zhou , Michael Simon , Zhenghao Peng , Sicheng Mo , Hongzi Zhu , Minyi Guo , Bolei Zhou