English
Related papers

Related papers: HiP-AD: Hierarchical and Multi-Granularity Plannin…

200 papers

Recent advancements in deep learning and the availability of high-quality real-world driving datasets have propelled end-to-end autonomous driving. Despite this progress, relying solely on real-world data limits the variety of driving…

Robotics · Computer Science 2025-10-29 Jongsuk Kim , Jaeyoung Lee , Gyojin Han , Dongjae Lee , Minki Jeong , Junmo Kim

End-to-end autonomous driving systems promise stronger performance through unified optimization of perception, motion forecasting, and planning. However, vision-based approaches face fundamental limitations in adverse weather conditions,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Philipp Wolters , Johannes Gilg , Torben Teepe , Gerhard Rigoll

End-to-end planning has emerged as a dominant paradigm for autonomous driving, where recent models often adopt a scoring-selection framework to choose trajectories from a large set of candidates, with diffusion-based decoding showing strong…

Robotics · Computer Science 2026-04-07 Wenhao Yao , Xinglong Sun , Zhenxin Li , Shiyi Lan , Zi Wang , Jose M. Alvarez , Zuxuan Wu

Many existing autonomous driving paradigms involve a multi-stage discrete pipeline of tasks. To better predict the control signals and enhance user safety, an end-to-end approach that benefits from joint spatial-temporal feature learning is…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Shengchao Hu , Li Chen , Penghao Wu , Hongyang Li , Junchi Yan , Dacheng Tao

The well-established modular autonomous driving system is decoupled into different standalone tasks, e.g. perception, prediction and planning, suffering from information loss and error accumulation across modules. In contrast, end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Wenchao Sun , Xuewu Lin , Yining Shi , Chuang Zhang , Haoran Wu , Sifa Zheng

End-to-End paradigms use a unified framework to implement multi-tasks in an autonomous driving system. Despite simplicity and clarity, the performance of end-to-end autonomous driving methods on sub-tasks is still far behind the single-task…

Modern autonomous driving system is characterized as modular tasks in sequential order, i.e., perception, prediction, and planning. In order to perform a wide diversity of tasks and achieve advanced-level intelligence, contemporary…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Yihan Hu , Jiazhi Yang , Li Chen , Keyu Li , Chonghao Sima , Xizhou Zhu , Siqi Chai , Senyao Du , Tianwei Lin , Wenhai Wang , Lewei Lu , Xiaosong Jia , Qiang Liu , Jifeng Dai , Yu Qiao , Hongyang Li

In an era marked by the rapid scaling of foundation models, autonomous driving technologies are approaching a transformative threshold where end-to-end autonomous driving (E2E-AD) emerges due to its potential of scaling up in the…

Robotics · Computer Science 2024-11-28 Xiaosong Jia , Zhenjie Yang , Qifeng Li , Zhiyuan Zhang , Junchi Yan

End-to-end autonomous driving, which bypasses traditional modular pipelines by directly predicting future trajectories from sensor inputs, has recently achieved substantial progress. However, existing methods often overlook the causal…

Robotics · Computer Science 2026-05-20 Seokha Moon , Minseung Lee , Joon Seo , Jinkyu Kim , Jungbeom Lee

Recent advances in generative models have sparked exciting new possibilities in the field of autonomous vehicles. Specifically, video generation models are now being explored as controllable virtual testing environments. Simultaneously,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Jiahao Wang , Zhenpei Yang , Yijing Bai , Yingwei Li , Yuliang Zou , Bo Sun , Abhijit Kundu , Jose Lezama , Luna Yue Huang , Zehao Zhu , Jyh-Jing Hwang , Dragomir Anguelov , Mingxing Tan , Chiyu Max Jiang

We present a visual localization framework based on novel deep attention aware features for autonomous driving that achieves centimeter level localization accuracy. Conventional approaches to the visual localization problem rely on…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Yao Zhou , Guowei Wan , Shenhua Hou , Li Yu , Gang Wang , Xiaofei Rui , Shiyu Song

Modeling complicated interactions among the ego-vehicle, road agents, and map elements has been a crucial part for safety-critical autonomous driving. Previous works on end-to-end autonomous driving rely on the attention mechanism for…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Yunpeng Zhang , Deheng Qian , Ding Li , Yifeng Pan , Yong Chen , Zhenbao Liang , Zhiyao Zhang , Shurui Zhang , Hongxu Li , Maolei Fu , Yun Ye , Zhujin Liang , Yi Shan , Dalong Du

End-to-end autonomous driving has made impressive progress in recent years. Existing methods usually adopt the decoupled encoder-decoder paradigm, where the encoder extracts hidden features from raw sensor data, and the decoder outputs the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Xiaosong Jia , Penghao Wu , Li Chen , Jiangwei Xie , Conghui He , Junchi Yan , Hongyang Li

Vision-based autonomous driving shows great potential due to its satisfactory performance and low costs. Most existing methods adopt dense representations (e.g., bird's eye view) or sparse representations (e.g., instance boxes) for…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Wenzhao Zheng , Junjie Wu , Yao Zheng , Sicheng Zuo , Zixun Xie , Longchao Yang , Yong Pan , Zhihui Hao , Peng Jia , Xianpeng Lang , Shanghang Zhang

End-to-end autonomous driving has received increasing attention due to its potential to learn from large amounts of data. However, most existing methods are still open-loop and suffer from weak scalability, lack of high-order interactions,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Wenzhao Zheng , Zetian Xia , Yuanhui Huang , Sicheng Zuo , Jie Zhou , Jiwen Lu

End-to-End Autonomous Driving (E2E-AD) systems are typically grouped by the nature of their outputs: (i) waypoint-based models that predict a future trajectory, and (ii) action-based models that directly output throttle, steer and brake.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Jorge Daniel Rodríguez-Vidal , Gabriel Villalonga , Diego Porres , Antonio M. López Peña

End-to-end learning has emerged as a transformative paradigm in autonomous driving. However, the inherently multimodal nature of driving behaviors and the generalization challenges in long-tail scenarios remain critical obstacles to robust…

Robotics · Computer Science 2025-05-27 Rui Zhao , Yuze Fan , Ziguo Chen , Fei Gao , Zhenhai Gao

End-to-end autonomous driving frameworks enable seamless integration of perception and planning but often rely on one-shot trajectory prediction, which may lead to unstable control and vulnerability to occlusions in single-frame perception.…

Autonomous driving has advanced significantly due to sensors, machine learning, and artificial intelligence improvements. However, prevailing methods struggle with intricate scenarios and causal relationships, hindering adaptability and…

End-to-end autonomous driving aims to produce planning trajectories from raw sensors directly. Currently, most approaches integrate perception, prediction, and planning modules into a fully differentiable network, promising great…

Robotics · Computer Science 2025-12-23 Pengxuan Yang , Yupeng Zheng , Qichao Zhang , Kefei Zhu , Zebin Xing , Qiao Lin , Yun-Fu Liu , Zhiguo Su , Dongbin Zhao