English
Related papers

Related papers: Explaining Black-Box Models through Counterfactual…

200 papers

Counterfactual Explanations (CEs) help address the question: How can the factors that influence the prediction of a predictive model be changed to achieve a more favorable outcome from a user's perspective? Thus, they bear the potential to…

Machine Learning · Computer Science 2023-11-27 Xuan Zhao , Klaus Broelemann , Gjergji Kasneci

We propose answer-set programs that specify and compute counterfactual interventions as a basis for causality-based explanations to decisions produced by classification models. They can be applied with black-box models and models that can…

Machine Learning · Computer Science 2020-06-17 Leopoldo Bertossi

Currently, there is a significant amount of research being conducted in the field of artificial intelligence to improve the explainability and interpretability of deep learning models. It is found that if end-users understand the reason for…

Information Retrieval · Computer Science 2023-06-02 Niloofar Ranjbar , Saeedeh Momtazi , MohammadMehdi Homayounpour

With the ongoing rise of machine learning, the need for methods for explaining decisions made by artificial intelligence systems is becoming a more and more important topic. Especially for image classification tasks, many state-of-the-art…

Machine Learning · Computer Science 2022-05-10 Silvan Mertes , Tobias Huber , Katharina Weitz , Alexander Heimerl , Elisabeth André

We predict credit applications with off-the-shelf, interchangeable black-box classifiers and we explain single predictions with counterfactual explanations. Counterfactual explanations expose the minimal changes required on the input data…

Artificial Intelligence · Computer Science 2018-11-19 Rory Mc Grath , Luca Costabello , Chan Le Van , Paul Sweeney , Farbod Kamiab , Zhao Shen , Freddy Lecue

Counterfactual explanations provide human-understandable reasoning for AI-made decisions by describing minimal changes to input features that would alter a model's prediction. To be truly useful in practice, such explanations must be…

Machine Learning · Computer Science 2025-08-15 Asiful Arefeen , Shovito Barua Soumma , Hassan Ghasemzadeh

Counterfactual explanations (CE) are the de facto method for providing insights into black-box decision-making models by identifying alternative inputs that lead to different outcomes. However, existing CE approaches, including group and…

Artificial Intelligence · Computer Science 2025-03-13 Lei You , Lele Cao , Mattias Nilsson , Bo Zhao , Lei Lei

In the field of Explainable Artificial Intelligence (XAI), counterfactual examples explain to a user the predictions of a trained decision model by indicating the modifications to be made to the instance so as to change its associated…

Artificial Intelligence · Computer Science 2023-05-11 Thibault Laugel , Adulam Jeyasothy , Marie-Jeanne Lesot , Christophe Marsala , Marcin Detyniecki

We introduce a new model-agnostic explanation technique which explains the prediction of any classifier called CLE. CLE gives an faithful and interpretable explanation to the prediction, by approximating the model locally using an…

Machine Learning · Computer Science 2019-10-03 Zijian Zhang , Fan Yang , Haofan Wang , Xia Hu

Machine learning is increasingly applied in high-stakes decision making that directly affect people's lives, and this leads to an increased demand for systems to explain their decisions. Explanations often take the form of counterfactuals,…

Machine Learning · Computer Science 2021-05-20 Maximilian Schleich , Zixuan Geng , Yihong Zhang , Dan Suciu

The application of deep learning in medical imaging has significantly advanced diagnostic capabilities, enhancing both accuracy and efficiency. Despite these benefits, the lack of transparency in these AI models, often termed "black boxes,"…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Eleonora Beatrice Rossi , Eleonora Lopez , Danilo Comminiello

Counterfactual explanations promote explainability in machine learning models by answering the question "how should an input instance be perturbed to obtain a desired predicted label?". The comparison of this instance before and after…

Machine Learning · Computer Science 2022-11-09 Jing Ma , Ruocheng Guo , Saumitra Mishra , Aidong Zhang , Jundong Li

Counterfactual explanations are a popular type of explanation for making the outcomes of a decision making system transparent to the user. Counterfactual explanations tell the user what to do in order to change the outcome of the system in…

Machine Learning · Computer Science 2022-11-29 André Artelt , Barbara Hammer

Counterfactual explanations provide means for prescriptive model explanations by suggesting actionable feature changes (e.g., increase income) that allow individuals to achieve favorable outcomes in the future (e.g., insurance approval).…

Machine Learning · Computer Science 2022-12-16 Martin Pawelczyk , Sascha Bielawski , Johannes van den Heuvel , Tobias Richter , Gjergji Kasneci

While AI algorithms have shown remarkable success in various fields, their lack of transparency hinders their application to real-life tasks. Although explanations targeted at non-experts are necessary for user trust and human-AI…

Artificial Intelligence · Computer Science 2024-02-12 Jasmina Gajcin , Ivana Dusparic

In this paper, we show that counterfactual explanations of confidence scores help users better understand and better trust an AI model's prediction in human-subject studies. Showing confidence scores in human-agent interaction systems can…

Machine Learning · Computer Science 2022-06-08 Thao Le , Tim Miller , Ronal Singh , Liz Sonenberg

Recent black-box counterfactual generation frameworks fail to take into account the semantic content of the proposed edits, while relying heavily on training to guide the generation process. We propose a novel, plug-and-play black-box…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Nikolaos Spanos , Maria Lymperaiou , Giorgos Filandrianos , Konstantinos Thomas , Athanasios Voulodimos , Giorgos Stamou

Counterfactual explanations (CEs) are a powerful means for understanding how decisions made by algorithms can be changed. Researchers have proposed a number of desiderata that CEs should meet to be practically useful, such as requiring…

Machine Learning · Computer Science 2022-09-26 Marco Virgolin , Saverio Fracaros

A highly accurate but overconfident model is ill-suited for deployment in critical applications such as healthcare and autonomous driving. The classification outcome should reflect a high uncertainty on ambiguous in-distribution samples…

Machine Learning · Computer Science 2022-10-25 Sumedha Singla , Nihal Murali , Forough Arabshahi , Sofia Triantafyllou , Kayhan Batmanghelich

Counterfactual explanations (CFEs) are an emerging technique under the umbrella of interpretability of machine learning (ML) models. They provide ``what if'' feedback of the form ``if an input datapoint were $x'$ instead of $x$, then an ML…

Machine Learning · Computer Science 2021-06-16 Sahil Verma , John Dickerson , Keegan Hines