English
Related papers

Related papers: Interpretable Decision-Making for End-to-End Auton…

200 papers

Artificial intelligence (AI) is revolutionizing many areas of our lives, leading a new era of technological advancement. Particularly, the transportation sector would benefit from the progress in AI and advance the development of…

Machine Learning · Computer Science 2022-10-19 Yanan Xin , Natasa Tagasovska , Fernando Perez-Cruz , Martin Raubal

This paper focuses on inverse reinforcement learning for autonomous navigation using distance and semantic category observations. The objective is to infer a cost function that explains demonstrated behavior while relying only on the…

Machine Learning · Computer Science 2021-01-05 Tianyu Wang , Vikas Dhiman , Nikolay Atanasov

Explainable AI aims to render model behavior understandable by humans, which can be seen as an intermediate step in extracting causal relations from correlative patterns. Due to the high risk of possible fatal decisions in image-based…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Lukas Klein , João B. S. Carvalho , Mennatallah El-Assady , Paolo Penna , Joachim M. Buhmann , Paul F. Jaeger

Interpretable deep learning is a fundamental building block towards safer AI, especially when the deployment possibilities of deep learning-based computer-aided medical diagnostic systems are so eminent. However, without a computational…

Machine Learning · Computer Science 2018-06-27 Anirban Mukhopadhyay

Large-scale deployment of autonomous vehicles has been continually delayed due to safety concerns. On the one hand, comprehensive scene understanding is indispensable, a lack of which would result in vulnerability to rare but complex…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Hao Shao , Letian Wang , RuoBing Chen , Hongsheng Li , Yu Liu

End-to-end autonomous driving provides a feasible way to automatically maximize overall driving system performance by directly mapping the raw pixels from a front-facing camera to control signals. Recent advanced methods construct a latent…

Machine Learning · Computer Science 2024-05-21 Zeyu Gao , Yao Mu , Chen Chen , Jingliang Duan , Shengbo Eben Li , Ping Luo , Yanfeng Lu

As autonomous driving technology matures, end-to-end methodologies have emerged as a leading strategy, promising seamless integration from perception to control via deep learning. However, existing systems grapple with challenges such as…

In recent years, considerable progress has been made towards a vehicle's ability to operate autonomously. An end-to-end approach attempts to achieve autonomous driving using a single, comprehensive software component. Recent breakthroughs…

Robotics · Computer Science 2019-05-17 Hege Haavaldsen , Max Aasboe , Frank Lindseth

Explainable AI is an emerging field providing solutions for acquiring insights into automated systems' rationale. It has been put on the AI map by suggesting ways to tackle key ethical and societal issues. Existing explanation techniques…

Machine Learning · Computer Science 2022-05-02 Ioannis Mollas , Nick Bassiliades , Grigorios Tsoumakas

Current end-to-end autonomous driving methods either run a controller based on a planned trajectory or perform control prediction directly, which have spanned two separately studied lines of research. Seeing their potential mutual benefits…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Penghao Wu , Xiaosong Jia , Li Chen , Junchi Yan , Hongyang Li , Yu Qiao

Recently, deep-learning based approaches have achieved impressive performance for autonomous driving. However, end-to-end vision-based methods typically have limited interpretability, making the behaviors of the deep networks difficult to…

Computer Vision and Pattern Recognition · Computer Science 2021-04-28 Hengli Wang , Peide Cai , Yuxiang Sun , Lujia Wang , Ming Liu

Widespread adoption of self-driving cars will depend not only on their safety but largely on their ability to interact with human users. Just like human drivers, self-driving cars will be expected to understand and safely follow…

Robotics · Computer Science 2019-10-18 Junha Roh , Chris Paxton , Andrzej Pronobis , Ali Farhadi , Dieter Fox

Topology reasoning is crucial for autonomous driving as it enables comprehensive understanding of connectivity and relationships between lanes and traffic elements. While recent approaches have shown success in perceiving driving topology…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Junjie Ye , David Paz , Hengyuan Zhang , Yuliang Guo , Xinyu Huang , Henrik I. Christensen , Yue Wang , Liu Ren

Recent work by Anthropic on Mechanistic interpretability claims to understand and control Large Language Models by extracting human-interpretable features from their neural activation patterns using sparse autoencoders (SAEs). If…

Machine Learning · Computer Science 2026-01-07 Raphael Ronge , Markus Maier , Frederick Eberhardt

Many existing autonomous driving paradigms involve a multi-stage discrete pipeline of tasks. To better predict the control signals and enhance user safety, an end-to-end approach that benefits from joint spatial-temporal feature learning is…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Shengchao Hu , Li Chen , Penghao Wu , Hongyang Li , Junchi Yan , Dacheng Tao

End-to-end architectures in autonomous driving (AD) face a significant challenge in interpretability, impeding human-AI trust. Human-friendly natural language has been explored for tasks such as driving explanation and 3D captioning.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Kairui Ding , Boyuan Chen , Yuchen Su , Huan-ang Gao , Bu Jin , Chonghao Sima , Wuqiang Zhang , Xiaohui Li , Paul Barsch , Hongyang Li , Hao Zhao

Recent progress in vision-language-action (VLA) models has enabled language-conditioned driving agents to execute natural-language navigation commands in closed-loop simulation, yet standard evaluations largely assume instructions are…

Computation and Language · Computer Science 2026-05-28 Kaiser Hamid , Can Cui , Nade Liang

The abilities to understand the social interaction behaviors between a vehicle and its surroundings while predicting its trajectory in an urban environment are critical for road safety in autonomous driving. Social interactions are hard to…

Artificial Intelligence · Computer Science 2023-08-09 Amina Ghoul , Itheri Yahiaoui , Anne Verroust-Blondet , Fawzi Nashashibi

Deep learning-based models are widely deployed in autonomous driving areas, especially the increasingly noticed end-to-end solutions. However, the black-box property of these models raises concerns about their trustworthiness and safety for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Jiankun Li , Hao Li , Jiangjiang Liu , Zhikang Zou , Xiaoqing Ye , Fan Wang , Jizhou Huang , Hua Wu , Haifeng Wang

While end-to-end autonomous driving has achieved remarkable progress in geometric control, current systems remain constrained by a command-following paradigm that relies on simple navigational instructions. Transitioning to genuinely…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Huan Zheng , Yucheng Zhou , Tianyi Yan , Jiayi Su , Hongjun Chen , Dubing Chen , Xingtai Gui , Wencheng Han , Runzhou Tao , Zhongying Qiu , Jianfei Yang , Jianbing Shen