English
Related papers

Related papers: Explain Your Move: Understanding Agent Actions Usi…

200 papers

This paper explores the mechanistic interpretability of reinforcement learning (RL) agents through an analysis of a neural network trained on procedural maze environments. By dissecting the network's inner workings, we identified…

Machine Learning · Computer Science 2024-11-05 Tristan Trim , Triston Grayston

The aim of this work is to detect and automatically generate high-level explanations of anomalous events in video. Understanding the cause of an anomalous event is crucial as the required response is dependant on its nature and severity.…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Stanislaw Szymanowicz , James Charles , Roberto Cipolla

Deep reinforcement learning (RL) has recently led to many breakthroughs on a range of complex control tasks. However, the agent's decision-making process is generally not transparent. The lack of interpretability hinders the applicability…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Wenjie Shi , Gao Huang , Shiji Song , Zhuoyuan Wang , Tingyu Lin , Cheng Wu

Explainable AI (XAI) systems have been proposed to help people understand how AI systems produce outputs and behaviors. Explainable Reinforcement Learning (XRL) has an added complexity due to the temporal nature of sequential…

Artificial Intelligence · Computer Science 2025-08-19 Madhuri Singh , Amal Alabdulkarim , Gennie Mansi , Mark O. Riedl

Incentive salience attribution can be understood as a psychobiological mechanism ascribing relevance to potentially rewarding objects and actions. Despite being an important component of the motivational process guiding our everyday…

Machine Learning · Computer Science 2022-05-30 Valerio Bonometti , Mathieu J. Ruiz , Anders Drachen , Alex Wade

Reinforcement learning (RL) studies how an agent comes to achieve reward in an environment through interactions over time. Recent advances in machine RL have surpassed human expertise at the world's oldest board games and many classic video…

Artificial Intelligence · Computer Science 2021-07-28 Pedro A. Tsividis , Joao Loula , Jake Burga , Nathan Foss , Andres Campero , Thomas Pouncy , Samuel J. Gershman , Joshua B. Tenenbaum

While a lot of research in explainable AI focuses on producing effective explanations, less work is devoted to the question of how people understand and interpret the explanation. In this work, we focus on this question through a study of…

Computation and Language · Computer Science 2022-06-20 Hendrik Schuff , Alon Jacovi , Heike Adel , Yoav Goldberg , Ngoc Thang Vu

In visual-based Reinforcement Learning (RL), agents often struggle to generalize well to environmental variations in the state space that were not observed during training. The variations can arise in both task-irrelevant features, such as…

Artificial Intelligence · Computer Science 2023-12-25 Sili Huang , Yanchao Sun , Jifeng Hu , Siyuan Guo , Hechang Chen , Yi Chang , Lichao Sun , Bo Yang

Improving the interpretability of geospatial artificial intelligence (GeoAI) models has become critically important to open the "black box" of complex AI models, such as deep learning. This paper compares popular saliency map generation…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Chia-Yu Hsu , Wenwen Li

One of the goals of Explainable AI (XAI) is to determine which input components were relevant for a classifier decision. This is commonly know as saliency attribution. Characteristic functions (from cooperative game theory) are able to…

Machine Learning · Computer Science 2022-02-28 Stephan Wäldchen , Felix Huber , Sebastian Pokutta

Modern deep reinforcement learning (DRL) methods have made significant advances in handling continuous action spaces. However, real-world control systems, especially those requiring precise and reliable performance, often demand…

Machine Learning · Computer Science 2026-04-10 Xuyang Li , Romit Maulik

Reinforcement learning (RL) systems can be complex and non-interpretable, making it challenging for non-AI experts to understand or intervene in their decisions. This is due in part to the sequential nature of RL in which actions are chosen…

Artificial Intelligence · Computer Science 2025-04-16 Amal Alabdulkarim , Madhuri Singh , Gennie Mansi , Kaely Hall , Upol Ehsan , Mark O. Riedl

Saliency methods are used extensively to highlight the importance of input features in model predictions. These methods are mostly used in vision and language tasks, and their applications to time series data is relatively unexplored. In…

Machine Learning · Computer Science 2020-10-28 Aya Abdelsalam Ismail , Mohamed Gunady , Héctor Corrada Bravo , Soheil Feizi

Text-based games are a popular testbed for language-based reinforcement learning (RL). In previous work, deep Q-learning is commonly used as the learning agent. Q-learning algorithms are challenging to apply to complex real-world domains…

Machine Learning · Computer Science 2023-06-28 Weichen Li , Rati Devidze , Sophie Fellenz

Due to the capability of deep learning to perform well in high dimensional problems, deep reinforcement learning agents perform well in challenging tasks such as Atari 2600 games. However, clearly explaining why a certain action is taken by…

Machine Learning · Computer Science 2019-02-05 Laurens Weitkamp , Elise van der Pol , Zeynep Akata

While Explainable Artificial Intelligence (XAI) is increasingly expanding more areas of application, little has been applied to make deep Reinforcement Learning (RL) more comprehensible. As RL becomes ubiquitous and used in critical and…

Artificial Intelligence · Computer Science 2021-10-05 Alexandre Heuillet , Fabien Couthouis , Natalia Díaz-Rodríguez

Saliency Map, the gradient of the score function with respect to the input, is the most basic technique for interpreting deep neural network decisions. However, saliency maps are often visually noisy. Although several hypotheses were…

Machine Learning · Computer Science 2019-09-17 Beomsu Kim , Junghoon Seo , SeungHyun Jeon , Jamyoung Koo , Jeongyeol Choe , Taegyun Jeon

A Very recent trend has emerged to couple the notion of interpretability and adversarial robustness, unlike earlier efforts which solely focused on good interpretations or robustness against adversaries. Works have shown that adversarially…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Puneet Mangla , Vedant Singh , Vineeth N Balasubramanian

We propose a new approach to visualize saliency maps for deep neural network models and apply it to deep reinforcement learning agents trained on Atari environments. Our method adds an attention module that we call FLS (Free Lunch Saliency)…

Machine Learning · Computer Science 2019-11-01 Dmitry Nikulin , Anastasia Ianina , Vladimir Aliev , Sergey Nikolenko

Counterfactual explanations, which deal with "why not?" scenarios, can provide insightful explanations to an AI agent's behavior. In this work, we focus on generating counterfactual explanations for deep reinforcement learning (RL) agents…

Artificial Intelligence · Computer Science 2021-02-01 Matthew L. Olson , Roli Khanna , Lawrence Neal , Fuxin Li , Weng-Keen Wong