English
Related papers

Related papers: Text-to-Image Models for Counterfactual Explanatio…

200 papers

Counterfactual instances are a powerful tool to obtain valuable insights into automated decision processes, describing the necessary minimal changes in the input space to alter the prediction towards a desired target. Most previous…

Machine Learning · Computer Science 2021-06-07 Robert-Florian Samoilescu , Arnaud Van Looveren , Janis Klaise

The same method that creates adversarial examples (AEs) to fool image-classifiers can be used to generate counterfactual explanations (CEs) that explain algorithmic decisions. This observation has led researchers to consider CEs as AEs by…

Artificial Intelligence · Computer Science 2021-11-03 Timo Freiesleben

With the ongoing rise of machine learning, the need for methods for explaining decisions made by artificial intelligence systems is becoming a more and more important topic. Especially for image classification tasks, many state-of-the-art…

Machine Learning · Computer Science 2022-05-10 Silvan Mertes , Tobias Huber , Katharina Weitz , Alexander Heimerl , Elisabeth André

Counterfactual Explanations (CEs) are a powerful technique used to explain Machine Learning models by showing how the input to a model should be minimally changed for the model to produce a different output. Similar proposals have been made…

Artificial Intelligence · Computer Science 2025-09-01 Nicola Gigante , Francesco Leofante , Andrea Micheli

Visual counterfactual explanations (VCEs) in image space are an important tool to understand decisions of image classifiers as they show under which changes of the image the decision of the classifier would change. Their generation in image…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Valentyn Boreiko , Maximilian Augustin , Francesco Croce , Philipp Berens , Matthias Hein

Text-to-image diffusion models are capable of generating high-quality images, but suboptimal pre-trained text representations often result in these images failing to align closely with the given text prompts. Classifier-free guidance (CFG)…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Zhenyu Zhou , Defang Chen , Can Wang , Chun Chen , Siwei Lyu

Estimating counterfactual outcomes over time has the potential to unlock personalized healthcare by assisting decision-makers to answer ''what-iF'' questions. Existing causal inference approaches typically consider regular, discrete-time…

Machine Learning · Computer Science 2022-06-17 Nabeel Seedat , Fergus Imrie , Alexis Bellot , Zhaozhi Qian , Mihaela van der Schaar

We propose selective debiasing -- an inference-time safety mechanism designed to enhance the overall model quality in terms of prediction performance and fairness, especially in scenarios where retraining the model is impractical. The…

Computation and Language · Computer Science 2025-03-12 Gleb Kuzmin , Neemesh Yadav , Ivan Smirnov , Timothy Baldwin , Artem Shelmanov

Focusing on text-to-image (T2I) generation, we propose Text and Image Mutual-Translation Adversarial Networks (TIME), a lightweight but effective model that jointly learns a T2I generator G and an image captioning discriminator D under the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-24 Bingchen Liu , Kunpeng Song , Yizhe Zhu , Gerard de Melo , Ahmed Elgammal

Counterfactual thinking is a crucial yet challenging topic for artificial intelligence to learn knowledge from data and ultimately improve performance for new scenarios. Many research works, including the Potential Outcome Model (POM) and…

Artificial Intelligence · Computer Science 2026-02-24 Mingyu Kang , Duxin Chen , Ziyuan Pu , Jianxi Gao , Wenwu Yu

We introduce a new model-agnostic explanation technique which explains the prediction of any classifier called CLE. CLE gives an faithful and interpretable explanation to the prediction, by approximating the model locally using an…

Machine Learning · Computer Science 2019-10-03 Zijian Zhang , Fan Yang , Haofan Wang , Xia Hu

Counterfactual examples explain a prediction by highlighting changes of instance that flip the outcome of a classifier. This paper proposes TIGTEC, an efficient and modular method for generating sparse, plausible and diverse counterfactual…

Machine Learning · Computer Science 2023-04-26 Milan Bhan , Jean-Noel Vittaut , Nicolas Chesneau , Marie-Jeanne Lesot

We leverage diffusion models to study the robustness-performance tradeoff of robust classifiers. Our approach introduces a simple, pretrained diffusion method to generate low-norm counterfactual examples (CEs): semantically altered data…

Machine Learning · Computer Science 2024-04-18 Eric Yeats , Cameron Darwin , Eduardo Ortega , Frank Liu , Hai Li

In this paper, we demonstrate the feasibility of alterfactual explanations for black box image classifiers. Traditional explanation mechanisms from the field of Counterfactual Thinking are a widely-used paradigm for Explainable Artificial…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Silvan Mertes , Tobias Huber , Christina Karle , Katharina Weitz , Ruben Schlagowski , Cristina Conati , Elisabeth André

We present an approach to explain the decisions of black box models for image classification. While using the black box to label images, our explanation method exploits the latent feature space learned through an adversarial autoencoder.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Riccardo Guidotti , Anna Monreale , Stan Matwin , Dino Pedreschi

Natural language explanations of deep neural network decisions provide an intuitive way for a AI agent to articulate a reasoning process. Current textual explanations learn to discuss class discriminative features in an image. However, it…

Computer Vision and Pattern Recognition · Computer Science 2018-06-27 Lisa Anne Hendricks , Ronghang Hu , Trevor Darrell , Zeynep Akata

Counterfactual explanations enhance the interpretability of deep learning models in medical imaging, yet adapting them to 3D CT scans poses challenges due to volumetric complexity and resource demands. We extend the Latent Shift…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Joseph Paul Cohen , Louis Blankemeier , Akshay Chaudhari

Automated fact checking systems have been proposed that quickly provide veracity prediction at scale to mitigate the negative influence of fake news on people and on public opinion. However, most studies focus on veracity classifiers of…

Computation and Language · Computer Science 2022-06-15 Shih-Chieh Dai , Yi-Li Hsu , Aiping Xiong , Lun-Wei Ku

Text-to-image diffusion models rely on text embeddings from a pre-trained text encoder, but these embeddings remain fixed across all diffusion timesteps, limiting their adaptability to the generative process. We propose Diffusion Adaptive…

Machine Learning · Computer Science 2025-10-29 Byeonghu Na , Minsang Park , Gyuwon Sim , Donghyeok Shin , HeeSun Bae , Mina Kang , Se Jung Kwon , Wanmo Kang , Il-Chul Moon

Counterfactual explanations (CFEs) are minimal and semantically meaningful modifications of the input of a model that alter the model predictions. They highlight the decisive features the model relies on, providing contrastive…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Chao Wang , Chengan Che , Xinyue Chen , Sophia Tsoka , Luis C. Garcia-Peraza-Herrera