English
Related papers

Related papers: Interpretable Learning for Self-Driving Cars by Vi…

200 papers

Autonomous driving (AD) systems are becoming increasingly capable of handling complex tasks, mainly due to recent advances in deep learning and AI. As interactions between autonomous systems and humans increase, the interpretability of…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Mukilan Karuppasamy , Shankar Gangisetty , Shyam Nandan Rai , Carlo Masone , C V Jawahar

Vision-based end-to-end driving models trained by imitation learning can lead to affordable solutions for autonomous driving. However, training these well-performing models usually requires a huge amount of data, while still lacking…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Diego Porres , Yi Xiao , Gabriel Villalonga , Alexandre Levy , Antonio M. López

We introduce a framework for learning robust visual representations that generalize to new viewpoints, backgrounds, and scene contexts. Discriminative models often learn naturally occurring spurious correlations, which cause them to fail on…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Chengzhi Mao , Augustine Cha , Amogh Gupta , Hao Wang , Junfeng Yang , Carl Vondrick

Deep convolutional neural networks (CNNs) have been shown to perform extremely well at a variety of tasks including subtasks of autonomous driving such as image segmentation and object classification. However, networks designed for these…

Computer Vision and Pattern Recognition · Computer Science 2017-11-21 Yiqi Hou , Sascha Hornauer , Karl Zipser

The increasing use of complex machine learning models in education has led to concerns about their interpretability, which in turn has spurred interest in developing explainability techniques that are both faithful to the model's inner…

Machine Learning · Computer Science 2025-05-13 Juan D. Pinto , Luc Paquette

This paper proposes a strategy for visual prediction in the context of autonomous driving. Humans, when not distracted or drunk, are still the best drivers you can currently find. For this reason we take inspiration from two theoretical…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Alice Plebe , Mauro Da Lio

The abilities to understand the social interaction behaviors between a vehicle and its surroundings while predicting its trajectory in an urban environment are critical for road safety in autonomous driving. Social interactions are hard to…

Artificial Intelligence · Computer Science 2023-08-09 Amina Ghoul , Itheri Yahiaoui , Anne Verroust-Blondet , Fawzi Nashashibi

In commentary driving, drivers verbalise their observations, assessments and intentions. By speaking out their thoughts, both learning and expert drivers are able to create a better understanding and awareness of their surroundings. In the…

Artificial Intelligence · Computer Science 2022-10-24 Daniel Omeiza , Sule Anjomshoae , Helena Webb , Marina Jirotka , Lars Kunze

Recent success suggests that deep neural control networks are likely to be a key component of self-driving vehicles. These networks are trained on large datasets to imitate human actions, but they lack semantic understanding of image…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Jinkyu Kim , Teruhisa Misu , Yi-Ting Chen , Ashish Tawari , John Canny

Improving decision-making capabilities in Autonomous Intelligent Vehicles (AIVs) has been a heated topic in recent years. Despite advancements, training machines to capture regions of interest for comprehensive scene understanding, like…

Artificial Intelligence · Computer Science 2025-04-09 Zhuoli Zhuang , Cheng-You Lu , Yu-Cheng Fred Chang , Yu-Kai Wang , Thomas Do , Chin-Teng Lin

Causal approaches to post-hoc explainability for black-box prediction models (e.g., deep neural networks trained on image pixel data) have become increasingly popular. However, existing approaches have two important shortcomings: (i) the…

Machine Learning · Computer Science 2025-08-12 Numair Sani , Daniel Malinsky , Ilya Shpitser

Modality differences have led to the development of heterogeneous architectures for vision and language models. While images typically require 2D non-causal modeling, texts utilize 1D causal modeling. This distinction poses significant…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Chenxin Tao , Xizhou Zhu , Shiqian Su , Lewei Lu , Changyao Tian , Xuan Luo , Gao Huang , Hongsheng Li , Yu Qiao , Jie Zhou , Jifeng Dai

Vehicle taillight recognition is an important application for automated driving, especially for intent prediction of ado vehicles and trajectory planning of the ego vehicle. In this work, we propose an end-to-end deep learning framework to…

Computer Vision and Pattern Recognition · Computer Science 2019-06-11 Kuan-Hui Lee , Takaaki Tagawa , Jia-En M. Pan , Adrien Gaidon , Bertrand Douillard

Accurate detection of a drivers attention state can help develop assistive technologies that respond to unexpected hazards in real time and therefore improve road safety. This study compares the performance of several attention classifiers…

Human-Computer Interaction · Computer Science 2021-08-24 Fred Atilla , Maryam Alimardani

Numerous groups have applied a variety of deep learning techniques to computer vision problems in highway perception scenarios. In this paper, we presented a number of empirical evaluations of recent deep learning advances. Computer vision,…

Causal reasoning has been an indispensable capability for humans and other intelligent animals to interact with the physical world. In this work, we propose to endow an artificial agent with the capability of causal reasoning for completing…

Machine Learning · Computer Science 2019-10-07 Suraj Nair , Yuke Zhu , Silvio Savarese , Li Fei-Fei

Neural networks are growing more capable on their own, but we do not understand their neural mechanisms. Understanding these mechanisms' decision-making processes, or mechanistic interpretability, enables (1) accountability and control in…

Computation and Language · Computer Science 2026-03-02 Mason Kadem , Rong Zheng

Convolutional Neural Networks (CNN) have been successfully applied to autonomous driving tasks, many in an end-to-end manner. Previous end-to-end steering control methods take an image or an image sequence as the input and directly predict…

Computer Vision and Pattern Recognition · Computer Science 2018-02-06 Zhengyuan Yang , Yixuan Zhang , Jerry Yu , Junjie Cai , Jiebo Luo

We study the problem of explaining a rich class of behavioral properties of deep neural networks. Distinctively, our influence-directed explanations approach this problem by peering inside the network to identify neurons with high influence…

Machine Learning · Computer Science 2018-11-14 Klas Leino , Shayak Sen , Anupam Datta , Matt Fredrikson , Linyi Li

The field of deep learning is evolving in different directions, with still the need for more efficient training strategies. In this work, we present a novel and robust training scheme that integrates visual explanation techniques in the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-30 David Morales , Estefania Talavera , Beatriz Remeseiro