English
Related papers

Related papers: Interpretable Decision-Making for End-to-End Auton…

200 papers

As AI systems are used in high-stakes applications, ensuring interpretability is crucial. Mechanistic Interpretability (MI) aims to reverse-engineer neural networks by extracting human-understandable algorithms to explain their behavior.…

Machine Learning · Computer Science 2025-03-03 Maxime Méloux , Silviu Maniu , François Portet , Maxime Peyrard

Motivated by vision-based control of autonomous vehicles, we consider the problem of controlling a known linear dynamical system for which partial state information, such as vehicle position, is extracted from complex and nonlinear data,…

Optimization and Control · Mathematics 2019-12-24 Sarah Dean , Nikolai Matni , Benjamin Recht , Vickie Ye

Interpretable machine learning offers insights into what factors drive a certain prediction of a black-box system. A large number of interpreting methods focus on identifying explanatory input features, which generally fall into two main…

Machine Learning · Computer Science 2023-06-02 Vy Vo , Van Nguyen , Trung Le , Quan Hung Tran , Gholamreza Haffari , Seyit Camtepe , Dinh Phung

Deep learning (DL) based computer vision (CV) models are generally considered as black boxes due to poor interpretability. This limitation impedes efficient diagnoses or predictions of system failure, thereby precluding the widespread…

Computer Vision and Pattern Recognition · Computer Science 2021-10-15 Sikai Chen , Jiqian Dong , Runjia Du , Yujie Li , Samuel Labi

The Multi-modal Large Language Models (MLLMs) with extensive world knowledge have revitalized autonomous driving, particularly in reasoning tasks within perceivable regions. However, when faced with perception-limited areas (dynamic or…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Mingliang Zhai , Cheng Li , Zengyuan Guo , Ningrui Yang , Xiameng Qin , Sanyuan Zhao , Junyu Han , Ji Tao , Yuwei Wu , Yunde Jia

Vision-Language-Action (VLA) models are a promising path to realizing generalist embodied agents that can quickly adapt to new tasks, modalities, and environments. However, methods for interpreting and steering VLAs fall far short of…

Robotics · Computer Science 2025-09-03 Bear Häon , Kaylene Stocking , Ian Chuang , Claire Tomlin

The increasing complexity of AI systems has made understanding their behavior critical. Numerous interpretability methods have been developed to attribute model behavior to three key aspects: input features, training data, and internal…

Machine Learning · Computer Science 2025-05-30 Shichang Zhang , Tessa Han , Usha Bhalla , Himabindu Lakkaraju

Multi-agent robotic systems are increasingly operating in real-world environments in close proximity to humans, yet are largely controlled by policy models with inscrutable deep neural network representations. We introduce a method for…

Machine Learning · Computer Science 2023-02-24 Renos Zabounidis , Joseph Campbell , Simon Stepputtis , Dana Hughes , Katia Sycara

Autonomous driving has the potential to revolutionize mobility and is hence an active area of research. In practice, the behavior of autonomous vehicles must be acceptable, i.e., efficient, safe, and interpretable. While vanilla…

Machine Learning · Computer Science 2022-08-03 Lukas M. Schmidt , Sebastian Rietsch , Axel Plinge , Bjoern M. Eskofier , Christopher Mutschler

Deep networks trained on demonstrations of human driving have learned to follow roads and avoid obstacles. However, driving policies trained via imitation learning cannot be controlled at test time. A vehicle trained end-to-end to imitate…

Robotics · Computer Science 2018-03-05 Felipe Codevilla , Matthias Müller , Antonio López , Vladlen Koltun , Alexey Dosovitskiy

Interpretability has become an important topic of research as more machine learning (ML) models are deployed and widely used to make important decisions. Most of the current explanation methods provide explanations through feature…

Machine Learning · Statistics 2019-10-09 Amirata Ghorbani , James Wexler , James Zou , Been Kim

In Explainable AI, rule extraction translates model knowledge into logical rules, such as IF-THEN statements, crucial for understanding patterns learned by black-box models. This could significantly aid in fields like disease diagnosis,…

Machine Learning · Computer Science 2024-08-16 Yu Chen , Tianyu Cui , Alexander Capstick , Nan Fletcher-Loyd , Payam Barnaghi

A long-term goal of artificial intelligence is to have an agent execute commands communicated through natural language. In many cases the commands are grounded in a visual environment shared by the human who gives the command and the agent.…

Artificial Intelligence · Computer Science 2020-08-27 Thierry Deruyttere , Simon Vandenhende , Dusan Grujicic , Luc Van Gool , Marie-Francine Moens

End-to-end autonomous driving models based on Vision-Language-Action (VLA) architectures have shown promising results by learning driving policies through behavior cloning on expert demonstrations. However, imitation learning inherently…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Zihao Sheng , Xin Ye , Jingru Luo , Sikai Chen , Liu Ren

Frontier AI systems require governance mechanisms that can verify internal alignment, not just behavioral compliance. Private governance mechanisms audits, certification, insurance, and procurement are emerging to complement public…

Machine Learning · Computer Science 2025-11-21 Aadit Sengupta , Pratinav Seth , Vinay Kumar Sankarapu

In the last decade, deep learning (DL) approaches have been used successfully in computer vision (CV) applications. However, DL-based CV models are generally considered to be black boxes due to their lack of interpretability. This black box…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Jiqian Dong , Sikai Chen , Shuya Zong , Tiantian Chen , Mohammad Miralinaghi , Samuel Labi

We study multi-agent reinforcement learning (MARL) for tasks in complex high-dimensional environments, such as autonomous driving. MARL is known to suffer from the \textit{partial observability} and \textit{non-stationarity} issues. To…

Robotics · Computer Science 2025-06-11 Hang Wang , Dechen Gao , Junshan Zhang

In recent years, vision-based end-to-end autonomous driving has emerged as a new paradigm. However, popular end-to-end approaches typically rely on visual feature extraction networks trained under label supervision. This limited supervision…

Robotics · Computer Science 2025-11-04 Ling Niu , Xiaoji Zheng , Han Wang , Chen Zheng , Ziyuan Yang , Bokui Chen , Jiangtao Gong

Precise parking requires an end-to-end system where perception adaptively provides policy-relevant details - especially in critical areas where fine control decisions are essential. End-to-end learning offers a unified framework by directly…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Chao Chen , Shunyu Yao , Yuanwu He , Feng Tao , Ruojing Song , Yuliang Guo , Xinyu Huang , Chenxu Wu , Liu Ren , Chen Feng

The fields of explainable AI and mechanistic interpretability aim to uncover the internal structure of neural networks, with circuit discovery as a central tool for understanding model computations. Existing approaches, however, rely on…

Machine Learning · Computer Science 2026-03-05 Elena Golimblevskaia , Aakriti Jain , Bruno Puri , Ammar Ibrahim , Wojciech Samek , Sebastian Lapuschkin