English
Related papers

Related papers: Generating robust counterfactual explanations

200 papers

Explainability is increasingly seen as an essential feature of rule-based smart environments. While counterfactual explanations, which describe what could have been done differently to achieve a desired outcome, are a powerful tool in…

Artificial Intelligence · Computer Science 2025-10-06 Anna Trapp , Mersedeh Sadeghi , Andreas Vogelsang

Counterfactual explanations offer an intuitive and straightforward way to explain black-box models and offer algorithmic recourse to individuals. To address the need for plausible explanations, existing work has primarily relied on…

Machine Learning · Computer Science 2023-12-19 Patrick Altmeyer , Mojtaba Farmanbar , Arie van Deursen , Cynthia C. S. Liem

Machine learning is increasingly applied in high-stakes decision making that directly affect people's lives, and this leads to an increased demand for systems to explain their decisions. Explanations often take the form of counterfactuals,…

Machine Learning · Computer Science 2021-05-20 Maximilian Schleich , Zixuan Geng , Yihong Zhang , Dan Suciu

Recently, a groundswell of research has identified the use of counterfactual explanations as a potentially significant solution to the Explainable AI (XAI) problem. It is argued that (a) technically, these counterfactual cases can be…

Artificial Intelligence · Computer Science 2020-05-29 Mark T. Keane , Barry Smyth

Counterfactual explanations are increasingly used to address interpretability, recourse, and bias in AI decisions. However, we do not know how well counterfactual explanations help users to understand a systems decisions, since no large…

Human-Computer Interaction · Computer Science 2023-04-04 Greta Warren , Mark T Keane , Ruth M J Byrne

With the increasing impact of algorithmic decision-making on human lives, the interpretability of models has become a critical issue in machine learning. Counterfactual explanation is an important method in the field of interpretable…

Machine Learning · Computer Science 2024-07-17 Ao Xu , Tieru Wu

Providing clear explanations to the choices of machine learning models is essential for these models to be deployed in crucial applications. Counterfactual and semi-factual explanations have emerged as two mechanisms for providing users…

Machine Learning · Computer Science 2026-01-15 André Artelt , Martin Olsen , Kevin Tierney

Counterfactual explanations are a widely used approach in Explainable AI, offering actionable insights into decision-making by illustrating how small changes to input data can lead to different outcomes. Despite their importance, evaluating…

Human-Computer Interaction · Computer Science 2025-04-22 Marharyta Domnich , Rasmus Moorits Veski , Julius Välja , Kadi Tulver , Raul Vicente

We propose an architecture for training generative models of counterfactual conditionals of the form, 'can we modify event A to cause B instead of C?', motivated by applications in robot control. Using an 'adversarial training' paradigm, an…

Robotics · Computer Science 2020-09-23 Simón C. Smith , Subramanian Ramamoorthy

Counterfactual explanations provide human-understandable reasoning for AI-made decisions by describing minimal changes to input features that would alter a model's prediction. To be truly useful in practice, such explanations must be…

Machine Learning · Computer Science 2025-08-15 Asiful Arefeen , Shovito Barua Soumma , Hassan Ghasemzadeh

The increasing use of Machine Learning (ML) models to aid decision-making in high-stakes industries demands explainability to facilitate trust. Counterfactual Explanations (CEs) are ideally suited for this, as they can offer insights into…

Machine Learning · Computer Science 2025-02-20 Junqi Jiang , Luca Marzari , Aaryan Purohit , Francesco Leofante

Visual Question Answering (VQA) has been a popular task that combines vision and language, with numerous relevant implementations in literature. Even though there are some attempts that approach explainability and robustness issues in VQA…

Computation and Language · Computer Science 2024-05-06 Theodoti Stoikou , Maria Lymperaiou , Giorgos Stamou

We propose a novel training regime termed counterfactual training that leverages counterfactual explanations to increase the explanatory capacity of models. Counterfactual explanations have emerged as a popular post-hoc explanation method…

Machine Learning · Computer Science 2026-01-23 Patrick Altmeyer , Aleksander Buszydlik , Arie van Deursen , Cynthia C. S. Liem

Counterfactual explanations play an important role in detecting bias and improving the explainability of data-driven classification models. A counterfactual explanation (CE) is a minimal perturbed data point for which the decision of the…

Machine Learning · Computer Science 2023-10-27 Donato Maragno , Jannis Kurtz , Tabea E. Röber , Rob Goedhart , Ş. Ilker Birbil , Dick den Hertog

There exist several methods that aim to address the crucial task of understanding the behaviour of AI/ML models. Arguably, the most popular among them are local explanations that focus on investigating model behaviour for individual…

Machine Learning · Computer Science 2023-01-04 Saumitra Mishra , Sanghamitra Dutta , Jason Long , Daniele Magazzeni

Machine learning plays a role in many deployed decision systems, often in ways that are difficult or impossible to understand by human stakeholders. Explaining, in a human-understandable way, the relationship between the input and output of…

Machine Learning · Computer Science 2022-11-17 Sahil Verma , Varich Boonsanong , Minh Hoang , Keegan E. Hines , John P. Dickerson , Chirag Shah

Counterfactual explanations are an increasingly popular form of post hoc explanation due to their (i) applicability across problem domains, (ii) proposed legal compliance (e.g., with GDPR), and (iii) reliance on the contrastive nature of…

Artificial Intelligence · Computer Science 2023-03-17 Greta Warren , Mark T. Keane , Christophe Gueret , Eoin Delaney

AI-driven outcomes can be challenging for end-users to understand. Explanations can address two key questions: "Why this outcome?" (factual) and "Why not another?" (counterfactual). While substantial efforts have been made to formalize…

Artificial Intelligence · Computer Science 2025-03-21 Suryani Lim , Henri Prade , Gilles Richard

Deep neural network based question answering (QA) models are neither robust nor explainable in many cases. For example, a multiple-choice QA model, tested without any input of question, is surprisingly "capable" to predict the most of…

Computation and Language · Computer Science 2020-10-13 Sicheng Yu , Yulei Niu , Shuohang Wang , Jing Jiang , Qianru Sun

There is an emerging interest in generating robust counterfactual explanations that would remain valid if the model is updated or changed even slightly. Towards finding robust counterfactuals, existing literature often assumes that the…

Machine Learning · Statistics 2024-03-19 Faisal Hamman , Erfaun Noorani , Saumitra Mishra , Daniele Magazzeni , Sanghamitra Dutta