English
Related papers

Related papers: Drive&Gen: Co-Evaluating End-to-End Driving and Vi…

200 papers

Recent advancements in video generation have substantially improved visual quality and temporal coherence, making these models increasingly appealing for applications such as autonomous driving, particularly in the context of driving…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Chun-Peng Chang , Chen-Yu Wang , Julian Schmidt , Holger Caesar , Alain Pagani

In recent years, vision-based end-to-end autonomous driving has emerged as a new paradigm. However, popular end-to-end approaches typically rely on visual feature extraction networks trained under label supervision. This limited supervision…

Robotics · Computer Science 2025-11-04 Ling Niu , Xiaoji Zheng , Han Wang , Chen Zheng , Ziyuan Yang , Bokui Chen , Jiangtao Gong

Text-to-video (T2V) generation technology holds potential to transform multiple domains such as education, marketing, entertainment, and assistive technologies for individuals with visual or reading comprehension challenges, by creating…

Graphics · Computer Science 2025-10-07 Nilay Kumar , Priyansh Bhandari , G. Maragatham

End-to-end learning has emerged as a transformative paradigm in autonomous driving. However, the inherently multimodal nature of driving behaviors and the generalization challenges in long-tail scenarios remain critical obstacles to robust…

Robotics · Computer Science 2025-05-27 Rui Zhao , Yuze Fan , Ziguo Chen , Fei Gao , Zhenhai Gao

End-to-End driving is a promising paradigm as it circumvents the drawbacks associated with modular systems, such as their overwhelming complexity and propensity for error propagation. Autonomous driving transcends conventional traffic…

Robotics · Computer Science 2023-09-20 Pranav Singh Chib , Pravendra Singh

End-to-end autonomous driving aims to generate safe and plausible planning policies from raw sensor input. Driving world models have shown great potential in learning rich representations by predicting the future evolution of a driving…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Xingtai Gui , Meijie Zhang , Tianyi Yan , Wencheng Han , Jiahao Gong , Feiyang Tan , Cheng-zhong Xu , Jianbing Shen

As autonomous driving technology matures, end-to-end methodologies have emerged as a leading strategy, promising seamless integration from perception to control via deep learning. However, existing systems grapple with challenges such as…

Autonomous driving technologies have achieved significant advances in recent years, yet their real-world deployment remains constrained by data scarcity, safety requirements, and the need for generalization across diverse environments. In…

Artificial Intelligence · Computer Science 2026-04-06 A. Humnabadkar , A. Sikdar , B. Cave , H. Zhang , N. Bessis , A. Behera

End-to-end autonomous driving (E2E-AD) has emerged as a trend in the field of autonomous driving, promising a data-driven, scalable approach to system design. However, existing E2E-AD methods usually adopt the sequential paradigm of…

Machine Learning · Computer Science 2025-07-14 Xiaosong Jia , Junqi You , Zhiyuan Zhang , Junchi Yan

For end-to-end autonomous driving (E2E-AD), the evaluation system remains an open problem. Existing closed-loop evaluation protocols usually rely on simulators like CARLA being less realistic; while NAVSIM using real-world vision data, yet…

Robotics · Computer Science 2024-12-16 Junqi You , Xiaosong Jia , Zhiyuan Zhang , Yutao Zhu , Junchi Yan

Generative models have significantly improved the generation and prediction quality on either camera images or LiDAR point clouds for autonomous driving. However, a real-world autonomous driving system uses multiple kinds of input modality,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Zehuan Wu , Jingcheng Ni , Xiaodong Wang , Yuxin Guo , Rui Chen , Lewei Lu , Jifeng Dai , Yuwen Xiong

With the rapid advancement of autonomous driving technology, vehicle-to-everything (V2X) communication has emerged as a key enabler for extending perception range and enhancing driving safety by providing visibility beyond the line of…

Driving planning is a critical component of end-to-end (E2E) autonomous driving. However, prevailing Imitative E2E Planners often suffer from multimodal trajectory mode collapse, failing to produce diverse trajectory proposals. Meanwhile,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Lin Liu , Caiyan Jia , Guanyi Yu , Ziying Song , JunQiao Li , Feiyang Jia , Peiliang Wu , Xiaoshuai Hao , Yadan Luo

Autonomous driving is of great interest to industry and academia alike. The use of machine learning approaches for autonomous driving has long been studied, but mostly in the context of perception. In this paper we take a deeper look on the…

Artificial Intelligence · Computer Science 2021-03-03 Ardi Tampuu , Maksym Semikin , Naveed Muhammad , Dmytro Fishman , Tambet Matiisen

High-quality driving video generation is crucial for providing training data for autonomous driving models. However, current generative models rarely focus on enhancing camera motion control under multi-view tasks, which is essential for…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Yining Yao , Xi Guo , Chenjing Ding , Wei Wu

The rapid evolution of video generation has enabled models to simulate complex physical dynamics and long-horizon causalities, positioning them as potential world simulators. However, a critical gap still remains between the theoretical…

Image and Video Processing · Electrical Eng. & Systems 2026-05-06 Muyang He , Hanzhong Guo , Junxiong Lin , Yizhou Yu

Diffusion models have established themselves as the de facto primary paradigm in visual generative modeling, revolutionizing the field through remarkable success across various diverse applications ranging from high-quality image synthesis…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Zhiyu Tan , WenXu Qian , Hesen Chen , Mengping Yang , Lei Chen , Hao Li

The rapid advancement of diffusion models has greatly improved video synthesis, especially in controllable video generation, which is vital for applications like autonomous driving. Although DiT with 3D VAE has become a standard framework…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Ruiyuan Gao , Kai Chen , Bo Xiao , Lanqing Hong , Zhenguo Li , Qiang Xu

End-to-end (E2E) testing is essential for ensuring web application quality. However, manual test creation is time-consuming, and current test generation techniques produce incoherent tests. In this paper, we present AutoE2E, a novel…

Software Engineering · Computer Science 2025-01-08 Parsa Alian , Noor Nashid , Mobina Shahbandeh , Taha Shabani , Ali Mesbah

Human driving behavior is inherently diverse, yet most end-to-end autonomous driving (E2E-AD) systems learn a single average driving style, neglecting individual differences. Achieving personalized E2E-AD faces challenges across three…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Xiaoru Dong , Ruiqin Li , Xiao Han , Zhenxuan Wu , Jiamin Wang , Jian Chen , Qi Jiang , SM Yiu , Xinge Zhu , Yuexin Ma