English
Related papers

Related papers: Explaining Image Classifiers Using Contrastive Cou…

200 papers

This paper addresses the challenge of generating Counterfactual Explanations (CEs), involving the identification and modification of the fewest necessary features to alter a classifier's prediction for a given image. Our proposed method,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Guillaume Jeanneret , Loïc Simon , Frédéric Jurie

There exist many methods to explain how an image classification model generates its decision, but very little work has explored methods to explain why a classifier might lack confidence in its prediction. As there are various reasons the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Sara Pohland , Claire Tomlin

We present a general causal generative modelling framework for accurate estimation of high fidelity image counterfactuals with deep structural causal models. Estimation of interventional and counterfactual queries for high-dimensional…

Machine Learning · Computer Science 2023-07-19 Fabio De Sousa Ribeiro , Tian Xia , Miguel Monteiro , Nick Pawlowski , Ben Glocker

The imminent need to interpret the output of a Machine Learning model with counterfactual (CF) explanations - via small perturbations to the input - has been notable in the research community. Although the variety of CF examples is…

Machine Learning · Computer Science 2024-04-23 Kleopatra Markou , Dimitrios Tomaras , Vana Kalogeraki , Dimitrios Gunopulos

Counterfactual explanations elucidate algorithmic decisions by pointing to scenarios that would have led to an alternative, desired outcome. Giving insight into the model's behavior, they hint users towards possible actions and give grounds…

Machine Learning · Statistics 2024-04-05 Susanne Dandl , Kristin Blesch , Timo Freiesleben , Gunnar König , Jan Kapar , Bernd Bischl , Marvin Wright

Counterfactual explanations are an emerging tool to enhance interpretability of deep learning models. Given a sample, these methods seek to find and display to the user similar samples across the decision boundary. In this paper, we propose…

Machine Learning · Computer Science 2023-08-22 Cassio F. Dantas , Diego Marcos , Dino Ienco

Post-hoc explanations of machine learning models are crucial for people to understand and act on algorithmic predictions. An intriguing class of explanations is through counterfactuals, hypothetical examples that show people how to obtain a…

Machine Learning · Computer Science 2019-12-09 Ramaravind Kommiya Mothilal , Amit Sharma , Chenhao Tan

This paper proposes a novel framework to reinforce classification models using language-guided generated counterfactual images. Deep learning classification models are often trained using datasets that mirror real-world scenarios. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Xiang Li , Ren Togo , Keisuke Maeda , Takahiro Ogawa , Miki Haseyama

Counterfactual explanations can be used to interpret and debug text classifiers by producing minimally altered text inputs that change a classifier's output. In this work, we evaluate five methods for generating counterfactual explanations…

Computation and Language · Computer Science 2024-11-06 Stephen McAleese , Mark Keane

Scientific expertise often requires recognizing subtle visual differences that remain challenging to articulate even for domain experts. We present a system that leverages generative models to automatically discover and visualize minimal…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Mia Chiquier , Orr Avrech , Yossi Gandelsman , Berthy Feng , Katherine Bouman , Carl Vondrick

In the field of medical imaging, particularly in tasks related to early disease detection and prognosis, understanding the reasoning behind AI model predictions is imperative for assessing their reliability. Conventional explanation methods…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Yingying Fang , Shuang Wu , Zihao Jin , Caiwen Xu , Shiyi Wang , Simon Walsh , Guang Yang

In the environment of fair lending laws and the General Data Protection Regulation (GDPR), the ability to explain a model's prediction is of paramount importance. High quality explanations are the first step in assessing fairness.…

Machine Learning · Computer Science 2021-06-23 Rachana Balasubramanian , Samuel Sharpe , Brian Barr , Jason Wittenbach , C. Bayan Bruss

Counterfactual explanations have shown promising results as a post-hoc framework to make image classifiers more explainable. In this paper, we propose DiME, a method allowing the generation of counterfactual images using the recent…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Guillaume Jeanneret , Loïc Simon , Frédéric Jurie

We propose a novel approach to mitigate biases in computer vision models by utilizing counterfactual generation and fine-tuning. While counterfactuals have been used to analyze and address biases in DNN models, the counterfactuals…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Pushkar Shukla , Dhruv Srikanth , Lee Cohen , Matthew Turk

There are now many explainable AI methods for understanding the decisions of a machine learning model. Among these are those based on counterfactual reasoning, which involve simulating features changes and observing the impact on the…

Machine Learning · Computer Science 2024-04-15 Vincent Lemaire , Nathan Le Boudec , Victor Guyomard , Françoise Fessant

Counterfactual examples have emerged as an effective approach to produce simple and understandable post-hoc explanations. In the context of graph classification, previous work has focused on generating counterfactual explanations by…

Machine Learning · Computer Science 2023-07-28 Carlo Abrate , Giulia Preti , Francesco Bonchi

Models that are learned from real-world data are often biased because the data used to train them is biased. This can propagate systemic human biases that exist and ultimately lead to inequitable treatment of people, especially minorities.…

Computer Vision and Pattern Recognition · Computer Science 2019-07-01 Daniel McDuff , Shuang Ma , Yale Song , Ashish Kapoor

Counterfactual generation lies at the core of various machine learning tasks, including image translation and controllable text generation. This generation process usually requires the identification of the disentangled latent…

Machine Learning · Computer Science 2024-02-26 Hanqi Yan , Lingjing Kong , Lin Gui , Yuejie Chi , Eric Xing , Yulan He , Kun Zhang

Visual counterfactual explanations (VCEs) in image space are an important tool to understand decisions of image classifiers as they show under which changes of the image the decision of the classifier would change. Their generation in image…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Valentyn Boreiko , Maximilian Augustin , Francesco Croce , Philipp Berens , Matthias Hein

Recent black-box counterfactual generation frameworks fail to take into account the semantic content of the proposed edits, while relying heavily on training to guide the generation process. We propose a novel, plug-and-play black-box…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Nikolaos Spanos , Maria Lymperaiou , Giorgos Filandrianos , Konstantinos Thomas , Athanasios Voulodimos , Giorgos Stamou