English
Related papers

Related papers: Meaningfully Debugging Model Mistakes using Concep…

200 papers

Counterfactual explanations (CFEs) provide actionable recourse, but most methods assume a static framework with fixed data and a trained classifier. This assumption breaks in evolving data environments, such as data streams, where online…

Machine Learning · Computer Science 2026-05-19 Marcin Kostrzewa , Jerzy Stefanowski , Maciej Zięba

Machine learning algorithms generally suffer from a problem of explainability. Given a classification result from a model, it is typically hard to determine what caused the decision to be made, and to give an informative explanation. We…

Machine Learning · Computer Science 2019-06-26 Jonathan Moore , Nils Hammerla , Chris Watkins

Although deep neural networks are effective on supervised learning tasks, they have been shown to be brittle. They are prone to overfitting on their training distribution and are easily fooled by small adversarial perturbations. In this…

Machine Learning · Computer Science 2020-10-07 Laëtitia Shao , Yang Song , Stefano Ermon

Plausible counterfactual explanations (p-CFEs) are perturbations that minimally modify inputs to change classifier decisions while remaining plausible under the data distribution. In this study, we demonstrate that classifiers can be…

Machine Learning · Computer Science 2025-11-14 Shpresim Sadiku , Kartikeya Chitranshi , Hiroshi Kera , Sebastian Pokutta

The continued improvements in the predictive accuracy of machine learning models have allowed for their widespread practical application. Yet, many decisions made with seemingly accurate models still require verification by domain experts.…

Human-Computer Interaction · Computer Science 2020-03-06 Oscar Gomez , Steffen Holter , Jun Yuan , Enrico Bertini

Counterfactual explanations (CEs) are a powerful means for understanding how decisions made by algorithms can be changed. Researchers have proposed a number of desiderata that CEs should meet to be practically useful, such as requiring…

Machine Learning · Computer Science 2022-09-26 Marco Virgolin , Saverio Fracaros

Multimodal classifiers function as opaque black box models. While several techniques exist to interpret their predictions, very few of them are as intuitive and accessible as natural language explanations (NLEs). To build trust, such…

Computation and Language · Computer Science 2025-12-09 Dibyanayan Bandyopadhyay , Soham Bhattacharjee , Mohammed Hasanuzzaman , Asif Ekbal

Counterfactual examples for an input -- perturbations that change specific features but not others -- have been shown to be useful for evaluating bias of machine learning models, e.g., against specific demographic groups. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-01-07 Saloni Dash , Vineeth N Balasubramanian , Amit Sharma

Counterfactual Explanations (CEs) are an important tool in Algorithmic Recourse for addressing two questions: 1. What are the crucial factors that led to an automated prediction/decision? 2. How can these factors be changed to achieve a…

Machine Learning · Computer Science 2023-11-23 Xuan Zhao , Klaus Broelemann , Gjergji Kasneci

Concept-based explanation approach is a popular model interpertability tool because it expresses the reasons for a model's predictions in terms of concepts that are meaningful for the domain experts. In this work, we study the problem of…

Machine Learning · Computer Science 2021-05-25 Mohammad Taha Bahadori , David E. Heckerman

There are now many explainable AI methods for understanding the decisions of a machine learning model. Among these are those based on counterfactual reasoning, which involve simulating features changes and observing the impact on the…

Machine Learning · Computer Science 2024-04-15 Vincent Lemaire , Nathan Le Boudec , Victor Guyomard , Françoise Fessant

Machine learning (ML) models play an increasingly prevalent role in many software engineering tasks. However, because most models are now powered by opaque deep neural networks, it can be difficult for developers to understand why the model…

Software Engineering · Computer Science 2021-11-11 Jürgen Cito , Isil Dillig , Vijayaraghavan Murali , Satish Chandra

The complexity of state-of-the-art modeling techniques for image classification impedes the ability to explain model predictions in an interpretable way. Existing explanation methods generally create importance rankings in terms of pixels…

Machine Learning · Computer Science 2020-04-17 Tom Vermeire , David Martens

To understand the black-box characteristics of deep networks, counterfactual explanation that deduces not only the important features of an input space but also how those features should be modified to classify input as a target class has…

Machine Learning · Computer Science 2022-08-15 Hong-Gyu Jung , Sin-Han Kang , Hee-Dong Kim , Dong-Ok Won , Seong-Whan Lee

Counterfactual explanations have emerged as a popular solution for the eXplainable AI (XAI) problem of elucidating the predictions of black-box deep-learning systems due to their psychological validity, flexibility across problem domains…

Machine Learning · Computer Science 2022-12-20 Eoin Delaney , Arjun Pakrashi , Derek Greene , Mark T. Keane

Deep learning models are effective, yet brittle. Even carefully trained, their behavior tends to be hard to predict when confronted with out-of-distribution samples. In this work, our goal is to propose a simple yet effective solution to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Gabriela Csurka , Tyler L. Hayes , Diane Larlus , Riccardo Volpi

Post-hoc explanation methods for machine learning models have been widely used to support decision-making. One of the popular methods is Counterfactual Explanation (CE), also known as Actionable Recourse, which provides a user with a…

Machine Learning · Computer Science 2021-11-10 Kentaro Kanamori , Takuya Takagi , Ken Kobayashi , Yuichi Ike , Kento Uemura , Hiroki Arimura

Counterfactual Explanations (CEs) have emerged as a major paradigm in explainable AI research, providing recourse recommendations for users affected by the decisions of machine learning models. However, CEs found by existing methods often…

Machine Learning · Computer Science 2024-11-25 Junqi Jiang , Francesco Leofante , Antonio Rago , Francesca Toni

Machine learning models achieve state-of-the-art performance on many supervised learning tasks. However, prior evidence suggests that these models may learn to rely on shortcut biases or spurious correlations (intuitively, correlations that…

Machine Learning · Computer Science 2021-08-31 Sindhu C. M. Gowda , Shalmali Joshi , Haoran Zhang , Marzyeh Ghassemi

Counterfactual explanations (CE) are the de facto method for providing insights into black-box decision-making models by identifying alternative inputs that lead to different outcomes. However, existing CE approaches, including group and…

Artificial Intelligence · Computer Science 2025-03-13 Lei You , Lele Cao , Mattias Nilsson , Bo Zhao , Lei Lei