English
Related papers

Related papers: Counterfactual State Explanations for Reinforcemen…

200 papers

Although deep reinforcement learning agents have produced impressive results in many domains, their decision making is difficult to explain to humans. To address this problem, past work has mainly focused on explaining why an action was…

Machine Learning · Computer Science 2019-10-01 Matthew L. Olson , Lawrence Neal , Fuxin Li , Weng-Keen Wong

Counterfactual explanations are a common tool to explain artificial intelligence models. For Reinforcement Learning (RL) agents, they answer "Why not?" or "What if?" questions by illustrating what minimal change to a state is needed such…

Machine Learning · Computer Science 2023-02-27 Tobias Huber , Maximilian Demmler , Silvan Mertes , Matthew L. Olson , Elisabeth André

With the ongoing rise of machine learning, the need for methods for explaining decisions made by artificial intelligence systems is becoming a more and more important topic. Especially for image classification tasks, many state-of-the-art…

Machine Learning · Computer Science 2022-05-10 Silvan Mertes , Tobias Huber , Katharina Weitz , Alexander Heimerl , Elisabeth André

One major barrier to applications of deep Reinforcement Learning (RL) both inside and outside of games is the lack of explainability. In this paper, we describe a lightweight and effective method to derive explanations for deep RL agents,…

Machine Learning · Computer Science 2021-10-08 Alexander Sieusahai , Matthew Guzdial

Reinforcement Learning (RL) is a learning paradigm in which the agent learns from its environment through trial and error. Deep reinforcement learning (DRL) algorithms represent the agent's policies using neural networks, making their…

Artificial Intelligence · Computer Science 2024-09-10 Jasmina Gajcin , Jovan Jeromela , Ivana Dusparic

Explainable AI (XAI) systems have been proposed to help people understand how AI systems produce outputs and behaviors. Explainable Reinforcement Learning (XRL) has an added complexity due to the temporal nature of sequential…

Artificial Intelligence · Computer Science 2025-08-19 Madhuri Singh , Amal Alabdulkarim , Gennie Mansi , Mark O. Riedl

Saliency maps are frequently used to support explanations of the behavior of deep reinforcement learning (RL) agents. However, a review of how saliency maps are used in practice indicates that the derived explanations are often…

Machine Learning · Computer Science 2020-02-24 Akanksha Atrey , Kaleigh Clary , David Jensen

While reinforcement learning (RL) algorithms have been successfully applied to numerous tasks, their reliance on neural networks makes their behavior difficult to understand and trust. Counterfactual explanations are human-friendly…

Artificial Intelligence · Computer Science 2023-10-11 Jasmina Gajcin , Ivana Dusparic

While AI algorithms have shown remarkable success in various fields, their lack of transparency hinders their application to real-life tasks. Although explanations targeted at non-experts are necessary for user trust and human-AI…

Artificial Intelligence · Computer Science 2024-02-12 Jasmina Gajcin , Ivana Dusparic

Natural language explanations of deep neural network decisions provide an intuitive way for a AI agent to articulate a reasoning process. Current textual explanations learn to discuss class discriminative features in an image. However, it…

Computer Vision and Pattern Recognition · Computer Science 2018-06-27 Lisa Anne Hendricks , Ronghang Hu , Trevor Darrell , Zeynep Akata

We present a novel generative method for producing unseen and plausible counterfactual examples for reinforcement learning (RL) agents based upon outcome variables that characterize agent behavior. Our approach uses a variational…

Artificial Intelligence · Computer Science 2022-07-19 Eric Yeh , Pedro Sequeira , Jesse Hostetler , Melinda Gervasio

Counterfactual thinking describes a psychological phenomenon that people re-infer the possible results with different solutions about things that have already happened. It helps people to gain more experience from mistakes and thus to…

Machine Learning · Computer Science 2019-08-19 Yue Wang , Yao Wan , Chenwei Zhang , Lixin Cui , Lu Bai , Philip S. Yu

Reinforcement learning (RL) systems can be complex and non-interpretable, making it challenging for non-AI experts to understand or intervene in their decisions. This is due in part to the sequential nature of RL in which actions are chosen…

Artificial Intelligence · Computer Science 2025-04-16 Amal Alabdulkarim , Madhuri Singh , Gennie Mansi , Kaely Hall , Upol Ehsan , Mark O. Riedl

Deep Reinforcement Learning (DRL) has demonstrated promising capability in solving complex control problems. However, DRL applications in safety-critical systems are hindered by the inherent lack of robust verification techniques to assure…

Machine Learning · Computer Science 2023-10-10 Amir Samadi , Konstantinos Koufos , Kurt Debattista , Mehrdad Dianati

Understanding how failure occurs and how it can be prevented in reinforcement learning (RL) is necessary to enable debugging, maintain user trust, and develop personalized policies. Counterfactual reasoning has often been used to assign…

Artificial Intelligence · Computer Science 2024-02-12 Jasmina Gajcin , Ivana Dusparic

Reinforcement learning (RL) has demonstrated remarkable success in solving complex decision-making problems, yet its adoption in critical domains is hindered by the lack of interpretability in its decision-making processes. Existing…

Artificial Intelligence · Computer Science 2025-09-23 Rui Zuo , Simon Khan , Zifan Wang , Garrett Ethan Katz , Qinru Qiu

Counterfactual inference is a powerful tool for analysing and evaluating autonomous agents, but its application to language model (LM) agents remains challenging. Existing work on counterfactuals in LMs has primarily focused on token-level…

Machine Learning · Computer Science 2025-06-04 Edoardo Pona , Milad Kazemi , Yali Du , David Watson , Nicola Paoletti

Reinforcement Learning (RL) has shown great promise in domains like healthcare and robotics but often struggles with adoption due to its lack of interpretability. Counterfactual explanations, which address "what if" scenarios, provide a…

Machine Learning · Computer Science 2025-05-20 Shuyang Dong , Shangtong Zhang , Lu Feng

While deep reinforcement learning (deep RL) agents are effective at maximizing rewards, it is often unclear what strategies they use to do so. In this paper, we take a step toward explaining deep RL agents through a case study using Atari…

Artificial Intelligence · Computer Science 2018-09-12 Sam Greydanus , Anurag Koul , Jonathan Dodge , Alan Fern

We present counterfactual planning as a design approach for creating a range of safety mechanisms that can be applied in hypothetical future AI systems which have Artificial General Intelligence. The key step in counterfactual planning is…

Artificial Intelligence · Computer Science 2021-02-02 Koen Holtman
‹ Prev 1 2 3 10 Next ›