English
Related papers

Related papers: Counterfactual Explanations Can Be Manipulated

200 papers

Counterfactual explanations emerge as a powerful approach in explainable AI, providing what-if scenarios that reveal how minimal changes to an input time series can alter the model's prediction. This work presents a survey of recent…

Machine Learning · Computer Science 2026-03-31 Udo Schlegel , Thomas Seidl

Interpretability research takes counterfactual theories of causality for granted. Most causal methods rely on counterfactual interventions to inputs or the activations of particular model components, followed by observations of the change…

Machine Learning · Computer Science 2024-07-08 Aaron Mueller

Recently, a groundswell of research has identified the use of counterfactual explanations as a potentially significant solution to the Explainable AI (XAI) problem. It is argued that (a) technically, these counterfactual cases can be…

Artificial Intelligence · Computer Science 2020-05-29 Mark T. Keane , Barry Smyth

Artificial intelligence (AI) comes with great opportunities but can also pose significant risks. Automatically generated explanations for decisions can increase transparency and foster trust, especially for systems based on automated…

Machine Learning · Computer Science 2021-12-03 Johannes Schneider , Christian Meske , Michalis Vlachos

We study the problem of assessing the robustness of counterfactual explanations for deep learning models. We focus on $\textit{plausible model shifts}$ altering model parameters and propose a novel framework to reason about the robustness…

Machine Learning · Computer Science 2024-07-11 Luca Marzari , Francesco Leofante , Ferdinando Cicalese , Alessandro Farinelli

This paper investigates the prospects of using directive explanations to assist people in achieving recourse of machine learning decisions. Directive explanations list which specific actions an individual needs to take to achieve their…

Machine Learning · Computer Science 2021-02-05 Ronal Singh , Paul Dourish , Piers Howe , Tim Miller , Liz Sonenberg , Eduardo Velloso , Frank Vetere

Recommender system practitioners are facing increasing pressure to explain recommendations. We explore how to explain recommendations using counterfactual logic, i.e. "Had you not interacted with the following items, we would not recommend…

Artificial Intelligence · Computer Science 2023-02-10 Yuanshun Yao , Chong Wang , Hang Li

While reinforcement learning (RL) algorithms have been successfully applied to numerous tasks, their reliance on neural networks makes their behavior difficult to understand and trust. Counterfactual explanations are human-friendly…

Artificial Intelligence · Computer Science 2023-10-11 Jasmina Gajcin , Ivana Dusparic

Recently, eXplainable AI (XAI) research has focused on counterfactual explanations as post-hoc justifications for AI-system decisions (e.g. a customer refused a loan might be told: If you asked for a loan with a shorter term, it would have…

Artificial Intelligence · Computer Science 2023-05-10 Saugat Aryal , Mark T Keane

We argue that the trend toward providing users with feasible and actionable explanations of AI decisions, known as recourse explanations, comes with ethical downsides. Specifically, we argue that recourse explanations face several…

Computers and Society · Computer Science 2024-06-19 Emily Sullivan , Atoosa Kasirzadeh

Counterfactuals, or modified inputs that lead to a different outcome, are an important tool for understanding the logic used by machine learning classifiers and how to change an undesirable classification. Even if a counterfactual changes a…

Machine Learning · Computer Science 2024-05-21 Jesse Friedbaum , Sudarshan Adiga , Ravi Tandon

Machine learning algorithms in socially sensitive domains (e.g., credit decisions) often focus on equalizing predictive outcomes. However, satisfying these metrics does not guarantee that models use the same reasoning for different groups.…

Machine Learning · Computer Science 2026-05-14 Gideon Popoola , John Sheppard

In this paper, we show that counterfactual explanations of confidence scores help users better understand and better trust an AI model's prediction in human-subject studies. Showing confidence scores in human-agent interaction systems can…

Machine Learning · Computer Science 2022-06-08 Thao Le , Tim Miller , Ronal Singh , Liz Sonenberg

The field of explainability in artificial intelligence (AI) has witnessed a growing number of studies and increasing scholarly interest. However, the lack of human-friendly and individual interpretations in explaining the outcomes of…

Artificial Intelligence · Computer Science 2025-02-04 Toygar Tanyel , Serkan Ayvaz , Bilgin Keserci

One well motivated explanation method for classifiers leverages counterfactuals which are hypothetical events identical to real observations in all aspects except for one feature. Constructing such counterfactual poses specific challenges…

Machine Learning · Computer Science 2024-09-12 Pirmin Lemberger , Antoine Saillenfest

Evaluating hypothetical statements about how the world would be had a different course of action been taken is arguably one key capability expected from modern AI systems. Counterfactual reasoning underpins discussions in fairness, the…

Machine Learning · Computer Science 2022-10-04 Kevin Xia , Yushu Pan , Elias Bareinboim

The goal of algorithmic recourse is to reverse unfavorable decisions (e.g., from loan denial to approval) under automated decision making by suggesting actionable feature changes (e.g., reduce the number of credit cards). To generate…

Machine Learning · Computer Science 2022-11-07 Martin Pawelczyk , Lea Tiyavorabun , Gjergji Kasneci

Accurate estimation of counterfactual outcomes in high-dimensional data is crucial for decision-making and understanding causal relationships and intervention outcomes in various domains, including healthcare, economics, and social…

Machine Learning · Computer Science 2024-07-31 Jiageng Zhu , Hanchen Xie , Jiazhi Li , Wael Abd-Almageed

Recent work on counterfactual visual explanations has contributed to making artificial intelligence models more explainable by providing visual perturbation to flip the prediction. However, these approaches neglect the causal relationships…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yiran Qiao , Disheng Liu , Yiren Lu , Yu Yin , Mengnan Du , Jing Ma

Counterfactual explanation is a form of interpretable machine learning that generates perturbations on a sample to achieve the desired outcome. The generated samples can act as instructions to guide end users on how to observe the desired…

Machine Learning · Computer Science 2023-03-28 Tri Dung Duong , Qian Li , Guandong Xu