English
Related papers

Related papers: GenAD: Generative End-to-End Autonomous Driving

200 papers

In recent years, end-to-end autonomous driving frameworks have been shown to not only enhance perception performance but also improve planning capabilities. However, most previous end-to-end autonomous driving frameworks have focused…

Robotics · Computer Science 2024-08-13 Yuanhua Shen , Jun Li

Trajectory prediction and planning are essential for autonomous vehicles to navigate safely and efficiently in dynamic environments. Traditional approaches often treat them separately, limiting the ability for interactive planning. While…

Robotics · Computer Science 2025-07-22 Anjian Li , Sangjae Bae , David Isele , Ryne Beeson , Faizan M. Tariq

Safety-critical corner cases, difficult to collect in the real world, are crucial for evaluating end-to-end autonomous driving. Adversarial interaction is an effective method to generate such safety-critical corner cases. While existing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Jiaheng Geng , Jiatong Du , Xinyu Zhang , Ye Li , Panqu Wang , Yanjun Huang

World models have gained significant attention as a promising approach for autonomous driving. By emulating human-like perception and decision-making processes, these models can predict and adapt to dynamic environments. Existing methods…

Robotics · Computer Science 2025-12-03 Huiqian Li , Wei Pan , Haodong Zhang , Jin Huang , Zhihua Zhong

Simulation-based testing has emerged as an essential tool for verifying and validating autonomous vehicles (AVs). However, contemporary methodologies, such as deterministic and imitation learning-based driver models, struggle to capture the…

Robotics · Computer Science 2025-11-04 Cheng Wang , Lingxin Kong , Massimiliano Tamborski , Stefano V. Albrecht

Generative world models for autonomous driving (AD) have become a trending topic. Unlike the widely studied image modality, in this work we explore generative world models for LiDAR data. Existing generation methods for LiDAR data only…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Sizhuo Zhou , Xiaosong Jia , Fanrui Zhang , Junjie Li , Juyong Zhang , Yukang Feng , Jianwen Sun , Songbur Wong , Junqi You , Junchi Yan

The generation and simulation of diverse real-world scenes have significant application value in the field of autonomous driving, especially for the corner cases. Recently, researchers have explored employing neural radiance fields or…

Robotics · Computer Science 2025-03-04 Bin Xie , Yingfei Liu , Tiancai Wang , Jiale Cao , Xiangyu Zhang

In recent years, considerable progress has been made towards a vehicle's ability to operate autonomously. An end-to-end approach attempts to achieve autonomous driving using a single, comprehensive software component. Recent breakthroughs…

Robotics · Computer Science 2019-05-17 Hege Haavaldsen , Max Aasboe , Frank Lindseth

End-to-end autonomous driving systems promise stronger performance through unified optimization of perception, motion forecasting, and planning. However, vision-based approaches face fundamental limitations in adverse weather conditions,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Philipp Wolters , Johannes Gilg , Torben Teepe , Gerhard Rigoll

In autonomous driving, end-to-end planners learn scene representations from raw sensor data and utilize them to generate a motion plan or control actions. However, exclusive reliance on the current scene for motion planning may result in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Hongbin Lin , Yiming Yang , Yifan Zhang , Chaoda Zheng , Jie Feng , Sheng Wang , Zhennan Wang , Shijia Chen , Boyang Wang , Yu Zhang , Xianming Liu , Shuguang Cui , Zhen Li

Recent breakthroughs in autonomous driving have been propelled by advances in robust world modeling, fundamentally transforming how vehicles interpret dynamic scenes and execute safe decision-making. World models have emerged as a linchpin…

Robotics · Computer Science 2025-09-11 Tuo Feng , Wenguan Wang , Yi Yang

As autonomous driving systems being deployed to millions of vehicles, there is a pressing need of improving the system's scalability, safety and reducing the engineering cost. A realistic, scalable, and practical simulator of the driving…

Robotics · Computer Science 2024-07-04 Yihan Hu , Siqi Chai , Zhening Yang , Jingyu Qian , Kun Li , Wenxin Shao , Haichao Zhang , Wei Xu , Qiang Liu

End-to-end autonomous driving solutions, which process multi-modal sensory data to directly generate refined control commands, have become a dominant paradigm in autonomous driving research. However, these approaches predominantly depend on…

Robotics · Computer Science 2025-05-12 Ruidan Xing , Runyi Huang , Qing Xu , Lei He

End-to-end autonomous driving (AD) systems increasingly adopt vision-language-action (VLA) models, yet they typically ignore the passenger's emotional state, which is central to comfort and AD acceptance. We introduce Open-Domain End-to-End…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Yihong Tang , Haicheng Liao , Tong Nie , Junlin He , Ao Qu , Kehua Chen , Wei Ma , Zhenning Li , Lijun Sun , Chengzhong Xu

Self-supervised pre-training based on next-token prediction has enabled large language models to capture the underlying structure of text, and has led to unprecedented performance on a large array of tasks when applied at scale. Similarly,…

End-to-end autonomous driving (E2E-AD) has emerged as a trend in the field of autonomous driving, promising a data-driven, scalable approach to system design. However, existing E2E-AD methods usually adopt the sequential paradigm of…

Machine Learning · Computer Science 2025-07-14 Xiaosong Jia , Junqi You , Zhiyuan Zhang , Junchi Yan

End-to-end autonomous driving (E2E-AD) has emerged as a promising paradigm that unifies perception, prediction, and planning into a holistic, data-driven framework. However, achieving robustness to varying camera viewpoints, a common…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Hoonhee Cho , Jae-Young Kang , Giwon Lee , Hyemin Yang , Heejun Park , Seokwoo Jung , Kuk-Jin Yoon

Synthesizing photo-realistic visual observations from an ego vehicle's driving trajectory is a critical step towards scalable training of self-driving models. Reconstruction-based methods create 3D scenes from driving logs and synthesize…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Jiageng Mao , Boyi Li , Boris Ivanovic , Yuxiao Chen , Yan Wang , Yurong You , Chaowei Xiao , Danfei Xu , Marco Pavone , Yue Wang

A principal barrier to large-scale deployment of urban autonomous driving systems lies in the prevalence of complex scenarios and edge cases. Existing systems fail to effectively interpret semantic information within traffic contexts and…

Robotics · Computer Science 2025-07-09 Yuhang Zhang , Jiaqi Liu , Chengkai Xu , Peng Hang , Jian Sun

End-to-end autonomous driving has emerged as a compelling alternative to traditional modular pipelines by directly mapping raw sensor data to driving actions. While recent approaches achieve strong performance on single-domain datasets,…

Robotics · Computer Science 2026-05-20 Hoonhee Cho , Giwon Lee , Jae-Young Kang , Hyemin Yang , Heejun Park , Kuk-Jin Yoon