English
Related papers

Related papers: ReLAX: Reinforcement Learning Agent eXplainer for …

200 papers

We present a novel generative method for producing unseen and plausible counterfactual examples for reinforcement learning (RL) agents based upon outcome variables that characterize agent behavior. Our approach uses a variational…

Artificial Intelligence · Computer Science 2022-07-19 Eric Yeh , Pedro Sequeira , Jesse Hostetler , Melinda Gervasio

In this paper we introduce and evaluate a distal explanation model for model-free reinforcement learning agents that can generate explanations for `why' and `why not' questions. Our starting point is the observation that causal models can…

Artificial Intelligence · Computer Science 2020-09-15 Prashan Madumal , Tim Miller , Liz Sonenberg , Frank Vetere

The use of counterfactual explanations (CFXs) is an increasingly popular explanation strategy for machine learning models. However, recent studies have shown that these explanations may not be robust to changes in the underlying model…

Machine Learning · Computer Science 2022-12-21 Junqi Jiang , Francesco Leofante , Antonio Rago , Francesca Toni

The recent adoption of machine learning as a tool in real world decision making has spurred interest in understanding how these decisions are being made. Counterfactual Explanations are a popular interpretable machine learning technique…

Machine Learning · Computer Science 2021-10-05 Andrew O'Brien , Edward Kim

Counterfactual explanations play an important role in detecting bias and improving the explainability of data-driven classification models. A counterfactual explanation (CE) is a minimal perturbed data point for which the decision of the…

Machine Learning · Computer Science 2023-10-27 Donato Maragno , Jannis Kurtz , Tabea E. Röber , Rob Goedhart , Ş. Ilker Birbil , Dick den Hertog

Counterfactual explanations (CFs) provide human-interpretable insights into model's predictions by identifying minimal changes to input features that would alter the model's output. However, existing methods struggle to generate multiple…

Machine Learning · Computer Science 2026-02-20 Oleksii Furman , Patryk Marszałek , Jan Masłowski , Piotr Gaiński , Maciej Zięba , Marek Śmieja

Many dynamic processes, including common scenarios in robotic control and reinforcement learning (RL), involve a set of interacting subprocesses. Though the subprocesses are not independent, their interactions are often sparse, and the…

Machine Learning · Computer Science 2020-12-07 Silviu Pitis , Elliot Creager , Animesh Garg

The growing integration of machine learning (ML) and artificial intelligence (AI) models into high-stakes domains such as healthcare and scientific research calls for models that are not only accurate but also interpretable. Among the…

Machine Learning · Computer Science 2025-10-23 Zhuo Cao , Xuan Zhao , Lena Krieger , Hanno Scharr , Ira Assent

In-context learning (ICL) of large language models (LLMs) has attracted increasing attention in the community where LLMs make predictions only based on instructions augmented with a few examples. Existing example selection methods for ICL…

Computation and Language · Computer Science 2024-08-26 Haowei Du , Dongyan Zhao

Counterfactual explanations (CFEs) are essential for interpreting black-box models, yet they often become invalid when models are slightly changed. Existing methods for generating robust CFEs are often limited to specific types of models,…

Machine Learning · Computer Science 2026-04-21 Marcin Kostrzewa , Maciej Zięba , Jerzy Stefanowski

In recent years, Reinforcement Learning (RL) has been applied to real-world problems with increasing success. Such applications often require to put constraints on the agent's behavior. Existing algorithms for constrained RL (CRL) rely on…

Machine Learning · Computer Science 2023-03-07 Ted Moskovitz , Brendan O'Donoghue , Vivek Veeriah , Sebastian Flennerhag , Satinder Singh , Tom Zahavy

Recently, there has been increasing interest in transparency and interpretability in Deep Reinforcement Learning (DRL) systems. Verbal explanations, as the most natural way of communication in our daily life, deserve more attention, since…

Artificial Intelligence · Computer Science 2020-12-25 Xinzhi Wang , Huao Li , Hui Zhang , Michael Lewis , Katia Sycara

Post-hoc explanations of machine learning models are crucial for people to understand and act on algorithmic predictions. An intriguing class of explanations is through counterfactuals, hypothetical examples that show people how to obtain a…

Machine Learning · Computer Science 2019-12-09 Ramaravind Kommiya Mothilal , Amit Sharma , Chenhao Tan

Credit assignment in reinforcement learning is the problem of measuring an action's influence on future rewards. In particular, this requires separating skill from luck, i.e. disentangling the effect of an action on rewards from that of…

Counterfactual explanations elucidate algorithmic decisions by pointing to scenarios that would have led to an alternative, desired outcome. Giving insight into the model's behavior, they hint users towards possible actions and give grounds…

Machine Learning · Statistics 2024-04-05 Susanne Dandl , Kristin Blesch , Timo Freiesleben , Gunnar König , Jan Kapar , Bernd Bischl , Marvin Wright

Many traditional algorithms for solving combinatorial optimization problems involve using hand-crafted heuristics that sequentially construct a solution. Such heuristics are designed by domain experts and may often be suboptimal due to the…

Machine Learning · Computer Science 2020-12-25 Nina Mazyavkina , Sergey Sviridov , Sergei Ivanov , Evgeny Burnaev

Overfitting is a well-known issue in machine learning that occurs when a model struggles to generalize its predictions to new, unseen data beyond the scope of its training set. Traditional techniques to mitigate overfitting include early…

Machine Learning · Computer Science 2025-12-09 Flavio Giorgi , Fabiano Veglianti , Fabrizio Silvestri , Gabriele Tolomei

CounterFactual (CF) visual explanations try to find images similar to the query image that change the decision of a vision system to a specified outcome. Existing methods either require inference-time optimization or joint training with a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Saeed Khorram , Li Fuxin

Counterfactual explanations promote explainability in machine learning models by answering the question "how should an input instance be perturbed to obtain a desired predicted label?". The comparison of this instance before and after…

Machine Learning · Computer Science 2022-11-09 Jing Ma , Ruocheng Guo , Saumitra Mishra , Aidong Zhang , Jundong Li

Auxiliary Learning (AL) is a form of multi-task learning in which a model trains on auxiliary tasks to boost performance on a primary objective. While AL has improved generalization across domains such as navigation, image classification,…

Machine Learning · Computer Science 2025-11-05 Judah Goldfeder , Matthew So , Hod Lipson