English
Related papers

Related papers: End-to-End Autonomous Driving without Costly Modul…

200 papers

Directly producing planning results from raw sensors has been a long-desired solution for autonomous driving and has attracted increasing attention recently. Most existing end-to-end autonomous driving methods factorize this problem into…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Wenzhao Zheng , Ruiqi Song , Xianda Guo , Chenming Zhang , Long Chen

End-to-end autonomous driving (E2E-AD) has emerged as a promising paradigm that unifies perception, prediction, and planning into a holistic, data-driven framework. However, achieving robustness to varying camera viewpoints, a common…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Hoonhee Cho , Jae-Young Kang , Giwon Lee , Hyemin Yang , Heejun Park , Seokwoo Jung , Kuk-Jin Yoon

State-of-the-art approaches for autonomous driving integrate multiple sub-tasks of the overall driving task into a single pipeline that can be trained in an end-to-end fashion by passing latent representations between the different modules.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Simon Doll , Niklas Hanselmann , Lukas Schneider , Richard Schulz , Marius Cordts , Markus Enzweiler , Hendrik P. A. Lensch

In end-to-end autonomous driving,the motion prediction plays a pivotal role in ego-vehicle planning. However, existing methods often rely on globally aggregated motion features, ignoring the fact that planning decisions are primarily…

Artificial Intelligence · Computer Science 2026-05-12 Bin Sun , Boao Zhang , Jiayi Lu , Xinjie Feng , Jiachen Shang , Rui Cao , Mengchao Zheng , Chuanye Wang , Shichun Yang , Yaoguang Cao , Ziying Song

In the context of autonomous driving, the significance of effective feature learning is widely acknowledged. While conventional 3D self-supervised pre-training methods have shown widespread success, most methods follow the ideas originally…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Honghui Yang , Sha Zhang , Di Huang , Xiaoyang Wu , Haoyi Zhu , Tong He , Shixiang Tang , Hengshuang Zhao , Qibo Qiu , Binbin Lin , Xiaofei He , Wanli Ouyang

Vision-Language Action (VLA) models unify perception, reasoning, and trajectory generation for autonomous driving, but suffer from significant inference latency due to deep transformer stacks. We present DeeAD, a training-free,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Haibo HU , Lianming Huang , Nan Guan , Chun Jason Xue

We present a new interaction mechanism of prediction and planning for end-to-end autonomous driving, called PPAD (Iterative Interaction of Prediction and Planning Autonomous Driving), which considers the timestep-wise interaction to better…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Zhili Chen , Maosheng Ye , Shuangjie Xu , Tongyi Cao , Qifeng Chen

Imitation learning based planning tasks on the nuPlan dataset have gained great interest due to their potential to generate human-like driving behaviors. However, open-loop training on the nuPlan dataset tends to cause causal confusion…

Robotics · Computer Science 2025-04-10 Junrui Zhang , Chenjie Wang , Jie Peng , Haoyu Li , Jianmin Ji , Yu Zhang , Yanyong Zhang

End-to-end autonomous driving has achieved remarkable advancements in recent years. Existing methods primarily follow a perception-planning paradigm, where perception and planning are executed sequentially within a fully differentiable…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Bozhou Zhang , Jingyu Li , Nan Song , Li Zhang

End-to-end (E2E) autonomous driving heavily relies on closed-loop simulation, where perception, planning, and control are jointly trained and evaluated in interactive environments. Yet, most existing datasets are collected from the real…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Zhijie Qiao , Zhong Cao , Henry X. Liu

End-to-end autonomous driving (E2EAD) systems, which learn to predict future trajectories directly from sensor data, are fundamentally challenged by the inherent spatio-temporal imbalance of trajectory data. This imbalance creates a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Zhiyu Zheng , Shaoyu Chen , Haoran Yin , Xinbang Zhang , Jialv Zou , Xinggang Wang , Qian Zhang , Lefei Zhang

Understanding fine-grained object affordances is imperative for robots to manipulate objects in unstructured environments given open-ended task instructions. However, existing methods of visual affordance predictions often rely on manually…

Robotics · Computer Science 2025-08-27 Yihe Tang , Wenlong Huang , Yingke Wang , Chengshu Li , Roy Yuan , Ruohan Zhang , Jiajun Wu , Li Fei-Fei

Edge intelligence autonomous driving (EIAD) offers computing resources in autonomous vehicles for training deep neural networks. However, wireless channels between the edge server and the autonomous vehicles are time-varying due to the…

Signal Processing · Electrical Eng. & Systems 2022-12-08 Xinrao Li , Tong Zhang , Shuai Wang , Guangxu Zhu , Rui Wang , Tsung-Hui Chang

Many fields could benefit from the rapid development of the large language models (LLMs). The end-to-end autonomous driving (e2eAD) is one of the typically fields facing new opportunities as the LLMs have supported more and more modalities.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Peiru Zheng , Yun Zhao , Zhan Gong , Hong Zhu , Shaohua Wu

End-to-End paradigms use a unified framework to implement multi-tasks in an autonomous driving system. Despite simplicity and clarity, the performance of end-to-end autonomous driving methods on sub-tasks is still far behind the single-task…

Autonomous driving is an emerging technology that is expected to bring significant social, economic, and environmental benefits. However, these benefits come with rising energy consumption by computation engines, limiting the driving range…

Artificial Intelligence · Computer Science 2025-10-30 Yuyang Xia , Zibo Liang , Liwei Deng , Yan Zhao , Han Su , Kai Zheng

End-to-end autonomous driving frameworks enable seamless integration of perception and planning but often rely on one-shot trajectory prediction, which may lead to unstable control and vulnerability to occlusions in single-frame perception.…

Recent advances in deep learning have markedly improved autonomous driving (AD) models, particularly end-to-end systems that integrate perception, prediction, and planning stages, achieving state-of-the-art performance. However, these…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Tianyuan Zhang , Lu Wang , Jiaqi Kang , Xinwei Zhang , Siyuan Liang , Yuwei Chen , Aishan Liu , Xianglong Liu

While Unmanned Aerial Vehicles (UAVs) have gained significant traction across various fields, path planning in 3D environments remains a critical challenge, particularly under size, weight, and power (SWAP) constraints. Traditional modular…

Robotics · Computer Science 2026-03-05 Yufei Jiang , Yuanzhu Zhan , Harsh Vardhan Gupta , Chinmay Borde , Junyi Geng

In the field of autonomous driving, end-to-end deep learning models show great potential by learning driving decisions directly from sensor data. However, training these models requires large amounts of labeled data, which is time-consuming…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Wenhao Jiang , Duo Li , Menghan Hu , Chao Ma , Ke Wang , Zhipeng Zhang