English
Related papers

Related papers: GenAD: Generative End-to-End Autonomous Driving

200 papers

In this paper, we tackle the problem of detecting objects in 3D and forecasting their future motion in the context of self-driving. Towards this goal, we design a novel approach that explicitly takes into account the interactions between…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Lingyun Luke Li , Bin Yang , Ming Liang , Wenyuan Zeng , Mengye Ren , Sean Segal , Raquel Urtasun

Modern cars are incorporating an increasing number of driver assist features, among which automatic lane keeping. The latter allows the car to properly position itself within the road lanes, which is also crucial for any subsequent lane…

Computer Vision and Pattern Recognition · Computer Science 2018-02-16 Davy Neven , Bert De Brabandere , Stamatios Georgoulis , Marc Proesmans , Luc Van Gool

In this paper, we propose OccTENS, a generative occupancy world model that enables controllable, high-fidelity long-term occupancy generation while maintaining computational efficiency. Different from visual generation, the occupancy world…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Bu Jin , Songen Gu , Xiaotao Hu , Yupeng Zheng , Xiaoyang Guo , Qian Zhang , Xiaoxiao Long , Wei Yin

End-to-end autonomous driving requires adaptive and robust handling of complex and diverse traffic environments. However, prevalent single-mode planning methods attempt to learn an overall policy while struggling to acquire diversified…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Chi Wan , Yixin Cui , Jiatong Du , Shuo Yang , Yulong Bai , Peng Yi , Nan Li , Yanjun Huang

Autonomous driving is one of the most recent topics of interest which is aimed at replicating human driving behavior keeping in mind the safety issues. We approach the problem of learning synthetic driving using generative neural networks.…

Computer Vision and Pattern Recognition · Computer Science 2016-11-29 Arna Ghosh , Biswarup Bhattacharya , Somnath Basu Roy Chowdhury

The current autonomous stack is well modularized and consists of perception, decision making and control in a handcrafted framework. With the advances in artificial intelligence (AI) and computing resources, researchers have been pushing…

Robotics · Computer Science 2024-04-19 Satya R. Jaladi , Zhimin Chen , Narahari R. Malayanur , Raja M. Macherla , Bing Li

Autonomous driving has received a lot of attention in the automotive industry and is often seen as the future of transportation. Passenger vehicles equipped with a wide array of sensors (e.g., cameras, front-facing radars, LiDARs, and IMUs)…

Machine Learning · Computer Science 2022-05-27 Andrey Pak , Hemanth Manjunatha , Dimitar Filev , Panagiotis Tsiotras

End-to-end autonomous driving has achieved remarkable progress by integrating perception, prediction, and planning into a fully differentiable framework. Yet, to fully realize its potential, an effective online trajectory evaluation is…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Yingyan Li , Yuqi Wang , Yang Liu , Jiawei He , Lue Fan , Zhaoxiang Zhang

Driving scene generation is a critical domain for autonomous driving, enabling downstream applications, including perception and planning evaluation. Occupancy-centric methods have recently achieved state-of-the-art results by offering…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Bohan Li , Xin Jin , Hu Zhu , Hongsi Liu , Ruikai Li , Jiazhe Guo , Kaiwen Cai , Chao Ma , Yueming Jin , Hao Zhao , Xiaokang Yang , Wenjun Zeng

Recognizing the tremendous improvements that the integration of generative AI can bring to intelligent transportation systems, this article explores the integration of generative AI technologies in vehicular networks, focusing on their…

Networking and Internet Architecture · Computer Science 2023-04-24 Ruichen Zhang , Ke Xiong , Hongyang Du , Dusit Niyato , Jiawen Kang , Xuemin Shen , H. Vincent Poor

End-to-end (E2E) autonomous driving systems offer a promising alternative to traditional modular pipelines by reducing information loss and error accumulation, with significant potential to enhance both mobility and safety. However, most…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Ke Guo , Haochen Liu , Xiaojun Wu , Jia Pan , Chen Lv

Diverse and realistic traffic scenarios are crucial for evaluating the AI safety of autonomous driving systems in simulation. This work introduces a data-driven method called TrafficGen for traffic scenario generation. It learns from the…

Robotics · Computer Science 2023-03-07 Lan Feng , Quanyi Li , Zhenghao Peng , Shuhan Tan , Bolei Zhou

Personalization, while extensively studied in conventional autonomous driving pipelines, has been largely overlooked in the context of end-to-end autonomous driving (E2EAD), despite its critical role in fostering user trust, safety…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Ruiyang Hao , Bowen Jing , Haibao Yu , Zaiqing Nie

Recently, world models have made significant progress in enhancing end-to-end driving systems through both future situation forecasting and improved scene understanding. However, existing driving world models are typically built upon dense…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Ruoyu Wang , Jingke Wang , Yukai Ma , Yuehao Huang , Shuangming Lei , Guanglin Xu , Aixue Ye , Yong Liu

Self-driving cars relying solely on ego-centric perception face limitations in sensing, often failing to detect occluded, faraway objects. Collaborative autonomous driving (CAV) seems like a promising direction, but collecting data for…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Tai-Yu Pan , Sooyoung Jeon , Mengdi Fan , Jinsu Yoo , Zhenyang Feng , Mark Campbell , Kilian Q. Weinberger , Bharath Hariharan , Wei-Lun Chao

Autonomous vehicles demand high accuracy and robustness of perception algorithms. To develop efficient and scalable perception algorithms, the maximum information should be extracted from the available sensor data. In this work, we present…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Sebastian Huch , Florian Sauerbeck , Johannes Betz

Accurately perceiving dynamic environments is a fundamental task for autonomous driving and robotic systems. Existing methods inadequately utilize temporal information, relying mainly on local temporal interactions between adjacent frames…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Tianhao Li , Yang Li , Mengtian Li , Yisheng Deng , Weifeng Ge

Recent deep generative models are able to provide photo-realistic images as well as visual or textual content embeddings useful to address various tasks of computer vision and natural language processing. Their usefulness is nevertheless…

Machine Learning · Computer Science 2020-01-29 Antoine Plumerault , Hervé Le Borgne , Céline Hudelot

Sequence models have demonstrated remarkable success in behavioral planning by leveraging previously collected demonstrations. However, solving multi-task missions remains a significant challenge, particularly when the planner must adapt to…

Machine Learning · Computer Science 2024-12-30 Akash Karthikeyan , Yash Vardhan Pant

Understanding the road genome is essential to realize autonomous driving. This highly intelligent problem contains two aspects - the connection relationship of lanes, and the assignment relationship between lanes and traffic elements, where…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Tianyu Li , Li Chen , Huijie Wang , Yang Li , Jiazhi Yang , Xiangwei Geng , Shengyin Jiang , Yuting Wang , Hang Xu , Chunjing Xu , Junchi Yan , Ping Luo , Hongyang Li