English
Related papers

Related papers: Interpretable End-to-end Urban Autonomous Driving …

200 papers

Deploying deep reinforcement learning in safety-critical settings requires developing algorithms that obey hard constraints during exploration. This paper contributes a first approach toward enforcing formal safety constraints on end-to-end…

Artificial Intelligence · Computer Science 2020-07-03 Nathan Hunt , Nathan Fulton , Sara Magliacane , Nghia Hoang , Subhro Das , Armando Solar-Lezama

Vision-Language-Action (VLA) models have emerged as a promising framework for end-to-end autonomous driving. However, existing VLAs typically rely on sparse action supervision, which underutilizes their powerful scene understanding and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Xiaodong Mei , Diankun Zhang , Hongwei Xie , Guang Chen , Hangjun Ye , Dan Xu

Deep learning-based models are widely deployed in autonomous driving areas, especially the increasingly noticed end-to-end solutions. However, the black-box property of these models raises concerns about their trustworthiness and safety for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Jiankun Li , Hao Li , Jiangjiang Liu , Zhikang Zou , Xiaoqing Ye , Fan Wang , Jizhou Huang , Hua Wu , Haifeng Wang

End-to-end driving systems have made rapid progress, but have so far not been applied to the challenging new CARLA Leaderboard 2.0. Further, while there is a large body of literature on end-to-end architectures and training strategies, the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Julian Zimmerlin , Jens Beißwenger , Bernhard Jaeger , Andreas Geiger , Kashyap Chitta

Robust urban autonomous driving requires reliable 3D scene understanding and stable decision-making under dense interactions. However, existing end-to-end models lack interpretability, while modular pipelines suffer from error propagation…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Guangli Chen , Dianzhao Li , Wenjian Zhong , Bangquan Xie , Ostap Okhrin

End-to-end (E2E) autonomous driving models that take only camera images as input and directly predict a future trajectory are appealing for their computational efficiency and potential for improved generalization via unified optimization;…

Robotics · Computer Science 2026-04-10 Chihiro Noguchi , Takaki Yamamoto

In this work the problem of path planning for an autonomous vehicle that moves on a freeway is considered. The most common approaches that are used to address this problem are based on optimal control methods, which make assumptions about…

Robotics · Computer Science 2020-02-19 Konstantinos Makantasis , Maria Kontorinaki , Ioannis Nikolos

Automated driving in urban settings is challenging. Human participant behavior is difficult to model, and conventional, rule-based Automated Driving Systems (ADSs) tend to fail when they face unmodeled dynamics. On the other hand, the more…

Artificial Intelligence · Computer Science 2020-05-20 Ekim Yurtsever , Linda Capito , Keith Redmill , Umit Ozguner

Reinforcement learning has received high research interest for developing planning approaches in automated driving. Most prior works consider the end-to-end planning task that yields direct control commands and rarely deploy their algorithm…

Robotics · Computer Science 2023-07-31 Marvin Klimke , Benjamin Völz , Michael Buchholz

We introduce MoNet, a novel functionally modular network for self-supervised and interpretable end-to-end learning. By leveraging its functional modularity with a latent-guided contrastive loss function, MoNet efficiently learns…

Machine Learning · Computer Science 2024-06-06 Hyunki Seong , David Hyunchul Shim

This paper presents a novel approach to Autonomous Vehicle (AV) control through the application of active inference, a theory derived from neuroscience that conceptualizes the brain as a predictive machine. Traditional autonomous driving…

Robotics · Computer Science 2025-03-17 Elahe Delavari , John Moore , Junho Hong , Jaerock Kwon

The combination of deep neural network models and reinforcement learning algorithms can make it possible to learn policies for robotic behaviors that directly read in raw sensory inputs, such as camera images, effectively subsuming both…

Machine Learning · Computer Science 2019-05-17 Avi Singh , Larry Yang , Kristian Hartikainen , Chelsea Finn , Sergey Levine

Reinforcement Learning (RL) is a potent tool for sequential decision-making and has achieved performance surpassing human capabilities across many challenging real-world tasks. As the extension of RL in the multi-agent system domain,…

Artificial Intelligence · Computer Science 2024-08-20 Ruiqi Zhang , Jing Hou , Florian Walter , Shangding Gu , Jiayi Guan , Florian Röhrbein , Yali Du , Panpan Cai , Guang Chen , Alois Knoll

Vision-based autonomous urban driving in dense traffic is quite challenging due to the complicated urban environment and the dynamics of the driving behaviors. Widely-applied methods either heavily rely on hand-crafted rules or learn from…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Yinuo Zhao , Kun Wu , Zhiyuan Xu , Zhengping Che , Qi Lu , Jian Tang , Chi Harold Liu

Recently, two-stage fine-tuning strategies, e.g., acquiring essential driving knowledge through supervised fine-tuning (SFT) and further enhancing decision-making and planning via reinforcement fine-tuning (RFT), have shown strong potential…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Songyan Zhang , Wenhui Huang , Zhan Chen , Chua Jiahao Collister , Qihang Huang , Chen Lv

The significant components of any successful autonomous flight system are task completion and collision avoidance. Most deep learning algorithms successfully execute these aspects under the environment and conditions they are trained.…

Most existing approaches to autonomous driving fall into one of two categories: modular pipelines, that build an extensive model of the environment, and imitation learning approaches, that map images directly to control outputs. A recently…

Robotics · Computer Science 2018-11-06 Axel Sauer , Nikolay Savinov , Andreas Geiger

Gradient-based approaches in reinforcement learning (RL) have achieved tremendous success in learning policies for autonomous vehicles. While the performance of these approaches warrants real-world adoption, these policies lack…

Machine Learning · Computer Science 2023-08-01 Rohan Paleja , Yaru Niu , Andrew Silva , Chace Ritchie , Sugju Choi , Matthew Gombolay

Model-based reinforcement learning (RL) is anticipated to exhibit higher sample efficiency compared to model-free RL by utilizing a virtual environment model. However, it is challenging to obtain sufficiently accurate representations of the…

Artificial Intelligence · Computer Science 2026-01-19 Zihao Sheng , Zilin Huang , Sikai Chen

Collaborative navigation becomes essential in situations of occluded scenarios in autonomous driving where independent driving policies are likely to lead to collisions. One promising approach to address this issue is through the use of…

Robotics · Computer Science 2024-12-12 Leandro Parada , Hanlin Tian , Jose Escribano , Panagiotis Angeloudis