English
Related papers

Related papers: Explaining Data-Driven Decisions made by AI System…

200 papers

We propose a BlackBox Counterfactual Explainer, designed to explain image classification models for medical applications. Classical approaches (e.g., saliency maps) that assess feature importance do not explain "how" imaging features in…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Sumedha Singla , Motahhare Eslami , Brian Pollack , Stephen Wallace , Kayhan Batmanghelich

With the ongoing rise of machine learning, the need for methods for explaining decisions made by artificial intelligence systems is becoming a more and more important topic. Especially for image classification tasks, many state-of-the-art…

Machine Learning · Computer Science 2022-05-10 Silvan Mertes , Tobias Huber , Katharina Weitz , Alexander Heimerl , Elisabeth André

In the field of Explainable Artificial Intelligence (XAI), counterfactual examples explain to a user the predictions of a trained decision model by indicating the modifications to be made to the instance so as to change its associated…

Artificial Intelligence · Computer Science 2023-05-11 Thibault Laugel , Adulam Jeyasothy , Marie-Jeanne Lesot , Christophe Marsala , Marcin Detyniecki

Many decision making systems deployed in the real world are not static - a phenomenon known as model adaptation takes place over time. The need for transparency and interpretability of AI-based decision models is widely accepted and thus…

Machine Learning · Computer Science 2021-04-08 André Artelt , Fabian Hinder , Valerie Vaquet , Robert Feldhans , Barbara Hammer

Explainable AI (XAI) methods identify which features are relevant to a model's predictions but often fail to clarify why certain decisions are made. In this work, we present a novel method that integrates causality with argument-based…

Artificial Intelligence · Computer Science 2026-05-22 Henry Salgado , Meagan R. Kendall , Martine Ceberio

Machine learning models that automate decision-making are increasingly being used in consequential areas such as loan approvals, pretrial bail, hiring, and many more. Unfortunately, most of these models are black-boxes, i.e., they are…

Artificial Intelligence · Computer Science 2023-10-24 Sopam Dasgupta , Farhad Shakerin , Joaquín Arias , Elmer Salazar , Gopal Gupta

Experimental user studies evaluating the effectiveness of different subtypes of post-hoc explanations for black-box models are largely nonexistent. Therefore, the aim of this study was to investigate and evaluate how different types of…

Human-Computer Interaction · Computer Science 2026-04-14 Tabea E. Röber , Paul Festor , Rob Goedhart , S. İlker Birbil , Aldo Faisal

In the context of AI-based decision support systems, explanations can help users to judge when to trust the AI's suggestion, and when to question it. In this way, human oversight can prevent AI errors and biased decision-making. However,…

Human-Computer Interaction · Computer Science 2025-08-12 Laura Spillner , Rachel Ringe , Robert Porzel , Rainer Malaka

Explainability is widely regarded as essential for trustworthy artificial intelligence systems. However, the metrics commonly used to evaluate counterfactual explanations are algorithmic evaluation metrics that are rarely validated against…

Artificial Intelligence · Computer Science 2026-03-17 Felix Liedeker , Basil Ell , Philipp Cimiano , Christoph Düsing

In this paper, we show that counterfactual explanations of confidence scores help users better understand and better trust an AI model's prediction in human-subject studies. Showing confidence scores in human-agent interaction systems can…

Machine Learning · Computer Science 2022-06-08 Thao Le , Tim Miller , Ronal Singh , Liz Sonenberg

Counterfactual explanations are a prominent example of post-hoc interpretability methods in the explainable Artificial Intelligence research domain. They provide individuals with alternative scenarios and a set of recommendations to achieve…

Artificial Intelligence · Computer Science 2021-01-20 Andrea Ferrario , Michele Loi

There has been a growing interest in model-agnostic methods that can make deep learning models more transparent and explainable to a user. Some researchers recently argued that for a machine to achieve a certain degree of human-level…

Artificial Intelligence · Computer Science 2021-06-09 Yu-Liang Chou , Catarina Moreira , Peter Bruza , Chun Ouyang , Joaquim Jorge

Counterfactuals play a pivotal role in the two distinct data science fields of causal inference (CI) and explainable artificial intelligence (XAI). While the core idea behind counterfactuals remains the same in both fields--the examination…

Machine Learning · Statistics 2025-05-20 Galit Shmueli , David Martens , Jaewon Yoo , Travis Greene

Counterfactual reasoning -- the practice of asking ``what if'' by varying inputs and observing changes in model behavior -- has become central to interpretable and fair AI. This thesis develops frameworks that use counterfactuals to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Pushkar Shukla

Evaluating hypothetical statements about how the world would be had a different course of action been taken is arguably one key capability expected from modern AI systems. Counterfactual reasoning underpins discussions in fairness, the…

Machine Learning · Computer Science 2022-10-04 Kevin Xia , Yushu Pan , Elias Bareinboim

Counterfactual explanations have been argued to be one of the most intuitive forms of explanation. They are typically defined as a minimal set of edits on a given data sample that, when applied, changes the output of a model on that sample.…

Artificial Intelligence · Computer Science 2023-05-30 Edmund Dervakos , Konstantinos Thomas , Giorgos Filandrianos , Giorgos Stamou

Counterfactual explanations emerge as a powerful approach in explainable AI, providing what-if scenarios that reveal how minimal changes to an input time series can alter the model's prediction. This work presents a survey of recent…

Machine Learning · Computer Science 2026-03-31 Udo Schlegel , Thomas Seidl

Due to the increasing use of machine learning in practice it becomes more and more important to be able to explain the prediction and behavior of machine learning models. An instance of explanations are counterfactual explanations which…

Machine Learning · Computer Science 2019-11-19 André Artelt , Barbara Hammer

With the rising need of interpretable machine learning methods, there is a necessity for a rise in human effort to provide diverse explanations of the influencing factors of the model decisions. To improve the trust and transparency of…

Machine Learning · Computer Science 2024-02-05 Peiyu Li , Soukaina Filali Boubrahimi , Shah Muhammad Hamdi

Sophisticated machine models are increasingly used for high-stakes decisions in everyday life. There is an urgent need to develop effective explanation techniques for such automated decisions. Rule-Based Explanations have been proposed for…

Machine Learning · Computer Science 2022-11-01 Zixuan Geng , Maximilian Schleich , Dan Suciu