English
Related papers

Related papers: Cognitive-Hierarchy Guided End-to-End Planning for…

200 papers

Effective environment modeling is the foundation for autonomous driving, underpinning tasks from perception to planning. However, current paradigms often inadequately consider the feedback of ego motion to the observation, which leads to an…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Mingzhe Guo , Yixiang Yang , Chuanrong Han , Rufeng Zhang , Shirui Li , Ji Wan , Zhipeng Zhang

Conventional end-to-end autonomous driving methods often rely on explicit global scene representations, which typically consist of 3D object detection, online mapping, and motion prediction. In contrast, human drivers selectively attend to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Ruiqi Song , Xianda Guo , Yanlun Peng , Qinggong Wei , Hangbin Wu , Long Chen

Navigating dense and dynamic environments poses a significant challenge for autonomous driving systems, owing to the intricate nature of multimodal interaction, wherein the actions of various traffic participants and the autonomous vehicle…

Robotics · Computer Science 2024-08-29 Tong Li , Lu Zhang , Sikang Liu , Shaojie Shen

Current end-to-end autonomous driving methods typically learn only from expert planning data collected from a single ego vehicle, severely limiting the diversity of learnable driving policies and scenarios. However, a critical yet…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Lin Liu , Caiyan Jia , Ziying Song , Hongyu Pan , Bencheng Liao , Wenchao Sun , Yongchang Zhang , Lei Yang , Yandan Luo

End-to-end autonomous driving directly generates planning trajectories from raw sensor data, yet it typically relies on costly perception supervision to extract scene information. A critical research challenge arises: constructing an…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Yupeng Zheng , Pengxuan Yang , Zebin Xing , Qichao Zhang , Yuhang Zheng , Yinfeng Gao , Pengfei Li , Teng Zhang , Zhongpu Xia , Peng Jia , Dongbin Zhao

Uncertainties in dynamic road environments pose significant challenges for behavior and trajectory planning in autonomous driving. This paper introduces Hi-Drive, a hierarchical planning algorithm addressing uncertainties at both behavior…

Robotics · Computer Science 2025-10-16 Xuanjin Jin , Chendong Zeng , Shengfa Zhu , Chunxiao Liu , Panpan Cai

While end-to-end autonomous driving has achieved remarkable progress in geometric control, current systems remain constrained by a command-following paradigm that relies on simple navigational instructions. Transitioning to genuinely…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Huan Zheng , Yucheng Zhou , Tianyi Yan , Jiayi Su , Hongjun Chen , Dubing Chen , Xingtai Gui , Wencheng Han , Runzhou Tao , Zhongying Qiu , Jianfei Yang , Jianbing Shen

Autonomous driving is an emerging technology that is expected to bring significant social, economic, and environmental benefits. However, these benefits come with rising energy consumption by computation engines, limiting the driving range…

Artificial Intelligence · Computer Science 2025-10-30 Yuyang Xia , Zibo Liang , Liwei Deng , Yan Zhao , Han Su , Kai Zheng

End-to-end autonomous driving systems promise stronger performance through unified optimization of perception, motion forecasting, and planning. However, vision-based approaches face fundamental limitations in adverse weather conditions,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Philipp Wolters , Johannes Gilg , Torben Teepe , Gerhard Rigoll

We present an end-to-end imitation learning system for agile, off-road autonomous driving using only low-cost sensors. By imitating a model predictive controller equipped with advanced sensors, we train a deep neural network control policy…

Robotics · Computer Science 2019-08-12 Yunpeng Pan , Ching-An Cheng , Kamil Saigol , Keuntaek Lee , Xinyan Yan , Evangelos Theodorou , Byron Boots

The emergence of general human knowledge and impressive logical reasoning capacity in rapidly progressed vision-language models (VLMs) have driven increasing interest in applying VLMs to high-level autonomous driving tasks, such as scene…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Songyan Zhang , Wenhui Huang , Zihui Gao , Hao Chen , Chen Lv

This study aims to improve the performance and generalization capability of end-to-end autonomous driving with scene understanding leveraging deep learning and multimodal sensor fusion techniques. The designed end-to-end deep neural network…

Robotics · Computer Science 2020-08-04 Zhiyu Huang , Chen Lv , Yang Xing , Jingda Wu

In dynamic autonomous driving environment, Artificial Intelligence-Generated Content (AIGC) technology can supplement vehicle perception and decision making by leveraging models' generative and predictive capabilities, and has the potential…

Systems and Control · Electrical Eng. & Systems 2024-07-03 Jianan Zhang , Zhiwei Wei , Boxun Liu , Xiayi Wang , Yong Yu , Rongqing Zhang

Simulation-based testing has emerged as an essential tool for verifying and validating autonomous vehicles (AVs). However, contemporary methodologies, such as deterministic and imitation learning-based driver models, struggle to capture the…

Robotics · Computer Science 2025-11-04 Cheng Wang , Lingxin Kong , Massimiliano Tamborski , Stefano V. Albrecht

In recent years, end-to-end autonomous driving has attracted increasing attention for its ability to jointly model perception, prediction, and planning within a unified framework. However, most existing approaches underutilize the online…

Robotics · Computer Science 2025-09-18 Huilin Yin , Yiming Kan , Daniel Watzenig

Deep networks trained on demonstrations of human driving have learned to follow roads and avoid obstacles. However, driving policies trained via imitation learning cannot be controlled at test time. A vehicle trained end-to-end to imitate…

Robotics · Computer Science 2018-03-05 Felipe Codevilla , Matthias Müller , Antonio López , Vladlen Koltun , Alexey Dosovitskiy

End-to-end autonomous driving resides not in the integration of perception and planning, but rather in the dynamic multi-agent game within a unified representation space. Most existing end-to-end models treat all agents equally, hindering…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Kang Ding , Hongsong Wang , Jie Gui , Lei He

Learning-based approaches have achieved remarkable performance in the domain of autonomous driving. Leveraging the impressive ability of neural networks and large amounts of human driving data, complex patterns and rules of driving behavior…

Robotics · Computer Science 2023-08-01 Bikun Wang , Zhipeng Wang , Chenhao Zhu , Zhiqiang Zhang , Zhichen Wang , Penghong Lin , Jingchu Liu , Qian Zhang

Autonomous driving is a challenging task that requires perceiving and understanding the surrounding environment for safe trajectory planning. While existing vision-based end-to-end models have achieved promising results, these methods are…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Tengpeng Li , Hanli Wang , Xianfei Li , Wenlong Liao , Tao He , Pai Peng

When planning for autonomous driving, it is crucial to consider essential traffic elements such as lanes, intersections, traffic regulations, and dynamic agents. However, they are often overlooked by the traditional end-to-end planning…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Guoliang You , Xiaomeng Chu , Yifan Duan , Wenyu Zhang , Xingchen Li , Sha Zhang , Yao Li , Jianmin Ji , Yanyong Zhang