English
Related papers

Related papers: Trustworthy Actionable Perturbations

200 papers

To understand the black-box characteristics of deep networks, counterfactual explanation that deduces not only the important features of an input space but also how those features should be modified to classify input as a target class has…

Machine Learning · Computer Science 2022-08-15 Hong-Gyu Jung , Sin-Han Kang , Hee-Dong Kim , Dong-Ok Won , Seong-Whan Lee

Counterfactual explanations represent the minimal change to a data sample that alters its predicted classification, typically from an unfavorable initial class to a desired target class. Counterfactuals help answer questions such as "what…

Machine Learning · Computer Science 2021-12-03 Brian Barr , Matthew R. Harrington , Samuel Sharpe , C. Bayan Bruss

Counterfactual explanations assess unfairness by revealing how inputs must change to achieve a desired outcome. This paper introduces the first graph-based framework for generating group counterfactual explanations to audit group fairness,…

Machine Learning · Computer Science 2025-09-09 Christos Fragkathoulas , Vasiliki Papanikou , Evaggelia Pitoura , Evimaria Terzi

Automated fact checking systems have been proposed that quickly provide veracity prediction at scale to mitigate the negative influence of fake news on people and on public opinion. However, most studies focus on veracity classifiers of…

Computation and Language · Computer Science 2022-06-15 Shih-Chieh Dai , Yi-Li Hsu , Aiping Xiong , Lun-Wei Ku

Transformers have profoundly influenced AI research, but explaining their decisions remains challenging -- even for relatively simpler tasks such as classification -- which hinders trust and safe deployment in real-world applications.…

Computation and Language · Computer Science 2025-07-30 Sungmin Han , Jeonghyun Lee , Sangkyun Lee

Counterfactual explanations have emerged as a prominent method in Explainable Artificial Intelligence (XAI), providing intuitive and actionable insights into Machine Learning model decisions. In contrast to other traditional feature…

This research is focused on generating achievable counterfactual explanations. Given a negative outcome computed by a machine learning model or a decision system, the novel CoGS approach generates (i) a counterfactual solution that…

Artificial Intelligence · Computer Science 2025-02-14 Sopam Dasgupta

Counterfactual generation lies at the core of various machine learning tasks, including image translation and controllable text generation. This generation process usually requires the identification of the disentangled latent…

Machine Learning · Computer Science 2024-02-26 Hanqi Yan , Lingjing Kong , Lin Gui , Yuejie Chi , Eric Xing , Yulan He , Kun Zhang

Deploying reinforcement learning in safety critical domains, from autonomous vehicles to medical decision support, is constrained by failures arising when systems encounter unfamiliar conditions. We argue that the fundamental bottleneck is…

Systems and Control · Electrical Eng. & Systems 2026-05-27 Chayan Banerjee , Ethan Goan

Despite their high accuracies, modern complex image classifiers cannot be trusted for sensitive tasks due to their unknown decision-making process and potential biases. Counterfactual explanations are very effective in providing…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Kamran Alipour , Aditya Lahiri , Ehsan Adeli , Babak Salimi , Michael Pazzani

Counterfactuals are widely used in AI to explain how minimal changes to a model's input can lead to a different output. However, established methods for computing counterfactuals typically focus on one-step decision-making, and are not…

Artificial Intelligence · Computer Science 2025-05-15 Paul Kobialka , Lina Gerlach , Francesco Leofante , Erika Ábrahám , Silvia Lizeth Tapia Tarifa , Einar Broch Johnsen

Decision-makers are faced with the challenge of estimating what is likely to happen when they take an action. For instance, if I choose not to treat this patient, are they likely to die? Practitioners commonly use supervised learning…

Machine Learning · Statistics 2018-02-02 Peter Schulam , Suchi Saria

We study the problem of generating counterfactual text for a classifier as a means for understanding and debugging classification. Given a textual input and a classification model, we aim to minimally alter the text to change the model's…

Computation and Language · Computer Science 2021-10-25 Quintin Pope , Xiaoli Z. Fern

Transparency is a fundamental requirement for decision making systems when these should be deployed in the real world. It is usually achieved by providing explanations of the system's behavior. A prominent and intuitive type of explanations…

Machine Learning · Computer Science 2021-07-23 André Artelt , Valerie Vaquet , Riza Velioglu , Fabian Hinder , Johannes Brinkrolf , Malte Schilling , Barbara Hammer

There are now many explainable AI methods for understanding the decisions of a machine learning model. Among these are those based on counterfactual reasoning, which involve simulating features changes and observing the impact on the…

Machine Learning · Computer Science 2024-04-15 Vincent Lemaire , Nathan Le Boudec , Victor Guyomard , Françoise Fessant

When the performance of a machine learning model varies over groups defined by sensitive attributes (e.g., gender or ethnicity), the performance disparity can be expressed in terms of the probability distributions of the input and output…

Machine Learning · Computer Science 2019-05-20 Hao Wang , Berk Ustun , Flavio P. Calmon

Counterfactual, serving as one emerging type of model explanation, has attracted tons of attentions recently from both industry and academia. Different from the conventional feature-based explanations (e.g., attributions), counterfactuals…

Machine Learning · Computer Science 2022-08-08 Fan Yang , Qizhang Feng , Kaixiong Zhou , Jiahao Chen , Xia Hu

Counterfactuals operationalised through algorithmic recourse have become a powerful tool to make artificial intelligence systems explainable. Conceptually, given an individual classified as y -- the factual -- we seek actions such that…

Despite the widespread adoption of autoregressive language models, explainability evaluation research has predominantly focused on span infilling and masked language models. Evaluating the faithfulness of an explanation method -- how…

Computation and Language · Computer Science 2025-03-11 Sepehr Kamahi , Yadollah Yaghoobzadeh

We present a novel generative method for producing unseen and plausible counterfactual examples for reinforcement learning (RL) agents based upon outcome variables that characterize agent behavior. Our approach uses a variational…

Artificial Intelligence · Computer Science 2022-07-19 Eric Yeh , Pedro Sequeira , Jesse Hostetler , Melinda Gervasio