English
Related papers

Related papers: SUPER-AD: Semantic Uncertainty-aware Planning for …

200 papers

Autonomous driving systems face the formidable challenge of navigating intricate and dynamic environments with uncertainty. This study presents a unified prediction and planning framework that concurrently models short-term aleatoric…

Robotics · Computer Science 2024-03-05 Wenbo Shao , Jiahui Xu , Zhong Cao , Hong Wang , Jun Li

End-to-end autonomous driving (E2EAD) systems, which learn to predict future trajectories directly from sensor data, are fundamentally challenged by the inherent spatio-temporal imbalance of trajectory data. This imbalance creates a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Zhiyu Zheng , Shaoyu Chen , Haoran Yin , Xinbang Zhang , Jialv Zou , Xinggang Wang , Qian Zhang , Lefei Zhang

Learning a human-like driving policy from large-scale driving demonstrations is promising, but the uncertainty and non-deterministic nature of planning make it challenging. Existing learning-based planning methods follow a deterministic…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Bo Jiang , Shaoyu Chen , Hao Gao , Bencheng Liao , Qian Zhang , Wenyu Liu , Xinggang Wang

The well-established modular autonomous driving system is decoupled into different standalone tasks, e.g. perception, prediction and planning, suffering from information loss and error accumulation across modules. In contrast, end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Wenchao Sun , Xuewu Lin , Yining Shi , Chuang Zhang , Haoran Wu , Sifa Zheng

End-to-end autonomous driving has gained significant attention for its potential to learn robust behavior in interactive scenarios and scale with data. Popular architectures often build on separate modules for perception and planning…

Robotics · Computer Science 2026-03-17 David Holtz , Niklas Hanselmann , Simon Doll , Marius Cordts , Bernt Schiele

Human drivers adeptly navigate complex scenarios by utilizing rich attentional semantics, but the current autonomous systems struggle to replicate this ability, as they often lose critical semantic information when converting 2D…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Pei Liu , Haipeng Liu , Haichao Liu , Xin Liu , Jinxin Ni , Jun Ma

Safety is critical for autonomous driving, and one aspect of improving safety is to accurately capture the uncertainties of the perception system, especially knowing the unknown. Different from only providing deterministic or probabilistic…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Yunshuang Yuan , Hao Cheng , Michael Ying Yang , Monika Sester

End-to-End Autonomous Driving (E2E-AD) systems are typically grouped by the nature of their outputs: (i) waypoint-based models that predict a future trajectory, and (ii) action-based models that directly output throttle, steer and brake.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Jorge Daniel Rodríguez-Vidal , Gabriel Villalonga , Diego Porres , Antonio M. López Peña

Successful machine learning involves a complete pipeline of data, model, and downstream applications. Instead of treating them separately, there has been a prominent increase of attention within the constrained optimization (CO) and machine…

Machine Learning · Computer Science 2023-12-27 Wangkun Xu , Jianhong Wang , Fei Teng

End-to-end autonomous driving, which bypasses traditional modular pipelines by directly predicting future trajectories from sensor inputs, has recently achieved substantial progress. However, existing methods often overlook the causal…

Robotics · Computer Science 2026-05-20 Seokha Moon , Minseung Lee , Joon Seo , Jinkyu Kim , Jungbeom Lee

In autonomous driving, the end-to-end (E2E) driving approach that predicts vehicle control signals directly from sensor data is rapidly gaining attention. To learn a safe E2E driving system, one needs an extensive amount of driving data and…

Robotics · Computer Science 2025-05-12 Jin Bok Park , Jinkyu Lee , Muhyun Back , Hyunmin Han , David T. Ma , Sang Min Won , Sung Soo Hwang , Il Yong Chun

End-to-End paradigms use a unified framework to implement multi-tasks in an autonomous driving system. Despite simplicity and clarity, the performance of end-to-end autonomous driving methods on sub-tasks is still far behind the single-task…

We introduce Latent-WAM, an efficient end-to-end autonomous driving framework that achieves strong trajectory planning through spatially-aware and dynamics-informed latent world representations. Existing world-model-based planners suffer…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Linbo Wang , Yupeng Zheng , Qiang Chen , Shiwei Li , Yichen Zhang , Zebin Xing , Qichao Zhang , Xiang Li , Deheng Qian , Pengxuan Yang , Yihang Dong , Ce Hao , Xiaoqing Ye , Junyu han , Yifeng Pan , Dongbin Zhao

End-to-end autonomous driving systems promise stronger performance through unified optimization of perception, motion forecasting, and planning. However, vision-based approaches face fundamental limitations in adverse weather conditions,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Philipp Wolters , Johannes Gilg , Torben Teepe , Gerhard Rigoll

Designing a driving policy for autonomous vehicles is a difficult task. Recent studies suggested an end-toend (E2E) training of a policy to predict car actuators directly from raw sensory inputs. It is appealing due to the ease of labeled…

Robotics · Computer Science 2019-01-07 Yonatan Glassner , Liran Gispan , Ariel Ayash , Tal Furman Shohet

After the 2017 TuSimple Lane Detection Challenge, its dataset and evaluation based on accuracy and F1 score have become the de facto standard to measure the performance of lane detection methods. While they have played a major role in…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Takami Sato , Qi Alfred Chen

In autonomous driving, end-to-end planners directly utilize raw sensor data, enabling them to extract richer scene features and reduce information loss compared to traditional planners. This raises a crucial research question: how can we…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Yingyan Li , Lue Fan , Jiawei He , Yuqi Wang , Yuntao Chen , Zhaoxiang Zhang , Tieniu Tan

Autonomous driving holds transformative potential but remains fundamentally constrained by the limited perception and isolated decision-making with standalone intelligence. While recent multi-agent approaches introduce cooperation, they…

Robotics · Computer Science 2025-11-13 Ziyi Song , Chen Xia , Chenbing Wang , Haibao Yu , Sheng Zhou , Zhisheng Niu

Deep neural network controllers for autonomous driving have recently benefited from significant performance improvements, and have begun deployment in the real world. Prior to their widespread adoption, safety guarantees are needed on the…

Machine Learning · Computer Science 2019-09-24 Rhiannon Michelmore , Matthew Wicker , Luca Laurenti , Luca Cardelli , Yarin Gal , Marta Kwiatkowska

Autonomous parking fundamentally differs from on-road driving due to its frequent direction changes and complex maneuvering requirements. However, existing End-to-End (E2E) planning methods often simplify the parking task into a geometric…

Robotics · Computer Science 2026-02-26 Jishu Miao , Han Chen , Jiankun Zhai , Qi Liu , Tsubasa Hirakawa , Takayoshi Yamashita , Hironobu Fujiyoshi