English
Related papers

Related papers: Counterfactual Evaluation for Explainable AI

200 papers

As machine learning models evolve, maintaining transparency demands more human-centric explainable AI techniques. Counterfactual explanations, with roots in human reasoning, identify the minimal input changes needed to obtain a given output…

Artificial Intelligence · Computer Science 2025-04-23 Marharyta Domnich , Julius Välja , Rasmus Moorits Veski , Giacomo Magnifico , Kadi Tulver , Eduard Barbu , Raul Vicente

In this paper, we show that counterfactual explanations of confidence scores help users better understand and better trust an AI model's prediction in human-subject studies. Showing confidence scores in human-agent interaction systems can…

Machine Learning · Computer Science 2022-06-08 Thao Le , Tim Miller , Ronal Singh , Liz Sonenberg

Transparency is an essential requirement of machine learning based decision making systems that are deployed in real world. Often, transparency of a given system is achieved by providing explanations of the behavior and predictions of the…

Machine Learning · Computer Science 2021-05-18 André Artelt , Barbara Hammer

Despite the increasing effectiveness of language models, their reasoning capabilities remain underdeveloped. In particular, causal reasoning through counterfactual question answering is lacking. This work aims to bridge this gap. We first…

Computation and Language · Computer Science 2025-03-18 Alihan Hüyük , Xinnuo Xu , Jacqueline Maasch , Aditya V. Nori , Javier González

Counterfactual explanations offer an intuitive and straightforward way to explain black-box models and offer algorithmic recourse to individuals. To address the need for plausible explanations, existing work has primarily relied on…

Machine Learning · Computer Science 2023-12-19 Patrick Altmeyer , Mojtaba Farmanbar , Arie van Deursen , Cynthia C. S. Liem

The growing integration of machine learning (ML) and artificial intelligence (AI) models into high-stakes domains such as healthcare and scientific research calls for models that are not only accurate but also interpretable. Among the…

Machine Learning · Computer Science 2025-10-23 Zhuo Cao , Xuan Zhao , Lena Krieger , Hanno Scharr , Ira Assent

In many applications, it is important to be able to explain the decisions of machine learning systems. An increasingly popular approach has been to seek to provide \emph{counterfactual instance explanations}. These specify close possible…

Artificial Intelligence · Computer Science 2021-09-22 Adam White , Artur d'Avila Garcez

Counterfactual explanations have emerged as a prominent method in Explainable Artificial Intelligence (XAI), providing intuitive and actionable insights into Machine Learning model decisions. In contrast to other traditional feature…

Counterfactual explanations (CEs) are a practical tool for demonstrating why machine learning classifiers make particular decisions. For CEs to be useful, it is important that they are easy for users to interpret. Existing methods for…

Machine Learning · Computer Science 2021-03-17 Lisa Schut , Oscar Key , Rory McGrath , Luca Costabello , Bogdan Sacaleanu , Medb Corcoran , Yarin Gal

Transparency is a fundamental requirement for decision making systems when these should be deployed in the real world. It is usually achieved by providing explanations of the system's behavior. A prominent and intuitive type of explanations…

Machine Learning · Computer Science 2021-07-23 André Artelt , Valerie Vaquet , Riza Velioglu , Fabian Hinder , Johannes Brinkrolf , Malte Schilling , Barbara Hammer

Explainable AI is an emerging field providing solutions for acquiring insights into automated systems' rationale. It has been put on the AI map by suggesting ways to tackle key ethical and societal issues. Existing explanation techniques…

Machine Learning · Computer Science 2022-05-02 Ioannis Mollas , Nick Bassiliades , Grigorios Tsoumakas

Counterfactual explanations (CEs) are advocated as being ideally suited to providing algorithmic recourse for subjects affected by the predictions of machine learning models. While CEs can be beneficial to affected individuals, recent work…

Machine Learning · Computer Science 2024-02-06 Junqi Jiang , Francesco Leofante , Antonio Rago , Francesca Toni

Recent advancements in machine learning have emphasized the need for transparency in model predictions, particularly as interpretability diminishes when using increasingly complex architectures. In this paper, we propose leveraging…

Machine Learning · Computer Science 2025-07-18 Chenrui Zhu , Louenas Bounia , Vu Linh Nguyen , Sébastien Destercke , Arthur Hoarau

There has been considerable recent interest in explainability in AI, especially with black-box machine learning models. As correctly observed by the planning community, when the application at hand is not a single-shot decision or…

Artificial Intelligence · Computer Science 2025-02-14 Vaishak Belle

Explainable models in Artificial Intelligence are often employed to ensure transparency and accountability of AI systems. The fidelity of the explanations are dependent upon the algorithms used as well as on the fidelity of the data. Many…

Machine Learning · Computer Science 2019-07-31 Muhammad Aurangzeb Ahmad , Carly Eckert , Ankur Teredesai

Causal approaches to fairness have seen substantial recent interest, both from the machine learning community and from wider parties interested in ethical prediction algorithms. In no small part, this has been due to the fact that causal…

Machine Learning · Computer Science 2019-08-17 Niki Kilbertus , Philip J. Ball , Matt J. Kusner , Adrian Weller , Ricardo Silva

Automated fact checking systems have been proposed that quickly provide veracity prediction at scale to mitigate the negative influence of fake news on people and on public opinion. However, most studies focus on veracity classifiers of…

Computation and Language · Computer Science 2022-06-15 Shih-Chieh Dai , Yi-Li Hsu , Aiping Xiong , Lun-Wei Ku

We propose a novel training regime termed counterfactual training that leverages counterfactual explanations to increase the explanatory capacity of models. Counterfactual explanations have emerged as a popular post-hoc explanation method…

Machine Learning · Computer Science 2026-01-23 Patrick Altmeyer , Aleksander Buszydlik , Arie van Deursen , Cynthia C. S. Liem

In order to oversee advanced AI systems, it is important to understand their underlying decision-making process. When prompted, large language models (LLMs) can provide natural language explanations or reasoning traces that sound plausible…

Computation and Language · Computer Science 2024-06-10 Noah Y. Siegel , Oana-Maria Camburu , Nicolas Heess , Maria Perez-Ortiz

While machine learning models have achieved unprecedented success in real-world applications, they might make biased/unfair decisions for specific demographic groups and hence result in discriminative outcomes. Although research efforts…

Machine Learning · Computer Science 2022-12-08 Yuying Zhao , Yu Wang , Tyler Derr