English
Related papers

Related papers: Explaining Image Classifiers by Counterfactual Gen…

200 papers

Counterfactual Explanations are becoming a de-facto standard in post-hoc interpretable machine learning. For a given classifier and an instance classified in an undesired class, its counterfactual explanation corresponds to small…

Machine Learning · Computer Science 2024-01-17 Veronica Piccialli , Dolores Romero Morales , Cecilia Salvatore

Counterfactual explanations enhance the interpretability of deep learning models in medical imaging, yet adapting them to 3D CT scans poses challenges due to volumetric complexity and resource demands. We extend the Latent Shift…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Joseph Paul Cohen , Louis Blankemeier , Akshay Chaudhari

Nowadays, deep vision models are being widely deployed in safety-critical applications, e.g., autonomous driving, and explainability of such models is becoming a pressing concern. Among explanation methods, counterfactual explanations aim…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Mehdi Zemni , Mickaël Chen , Éloi Zablocki , Hédi Ben-Younes , Patrick Pérez , Matthieu Cord

Image captioning, which generates natural language descriptions of the visual information in an image, is a crucial task in vision-language research. Previous models have typically addressed this task by aligning the generative capabilities…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Qian Cao , Xu Chen , Ruihua Song , Xiting Wang , Xinting Huang , Yuchen Ren

Currently available methods for extracting saliency maps identify parts of the input which are the most important to a specific fixed classifier. We show that this strong dependence on a given classifier hinders their performance. To…

Machine Learning · Computer Science 2020-07-21 Konrad Zolna , Krzysztof J. Geras , Kyunghyun Cho

Models that are learned from real-world data are often biased because the data used to train them is biased. This can propagate systemic human biases that exist and ultimately lead to inequitable treatment of people, especially minorities.…

Computer Vision and Pattern Recognition · Computer Science 2019-07-01 Daniel McDuff , Shuang Ma , Yale Song , Ashish Kapoor

The accelerating advancement of generative models has introduced new challenges for detecting AI-generated images, especially in real-world scenarios where novel generation techniques emerge rapidly. Existing learning paradigms are likely…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Qinghui He , Haifeng Zhang , Xiuli Bi , Bo Liu , Chi-Man Pun , Bin Xiao

Adversarial images highlight how vulnerable modern image classifiers are to perturbations outside of their training set. Human oversight might mitigate this weakness, but depends on humans understanding the AI well enough to predict when it…

Artificial Intelligence · Computer Science 2021-06-18 Tomas Folke , ZhaoBin Li , Ravi B. Sojitra , Scott Cheng-Hsin Yang , Patrick Shafto

Counterfactual examples identify how inputs can be altered to change the predicted class of a classifier, thus opening up the black-box nature of, e.g., deep neural networks. We propose a method, ECINN, that utilizes the generative…

Machine Learning · Computer Science 2021-04-07 Frederik Hvilshøj , Alexandros Iosifidis , Ira Assent

Counterfactual explanations can be obtained by identifying the smallest change made to a feature vector to qualitatively influence a prediction; for example, from 'loan rejected' to 'awarded' or from 'high risk of cardiovascular disease' to…

Machine Learning · Computer Science 2020-05-05 Martin Pawelczyk , Johannes Haug , Klaus Broelemann , Gjergji Kasneci

Counterfactual instances offer human-interpretable insight into the local behaviour of machine learning models. We propose a general framework to generate sparse, in-distribution counterfactual model explanations which match a desired…

Machine Learning · Computer Science 2021-01-26 Arnaud Van Looveren , Janis Klaise , Giovanni Vacanti , Oliver Cobb

In this work, we propose an introspection technique for deep neural networks that relies on a generative model to instigate salient editing of the input image for model interpretation. Such modification provides the fundamental…

Machine Learning · Computer Science 2019-07-09 Shusen Liu , Bhavya Kailkhura , Donald Loveland , Yong Han

Counterfactual explanations are considered, which is to answer {\it why the prediction is class A but not B.} Different from previous optimization based methods, an optimization-free Fast ReAl-time Counterfactual Explanation (FRACE)…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Yunxia Zhao

The use of complex machine learning models can make systems opaque to users. Machine learning research proposes the use of post-hoc explanations. However, it is unclear if they give users insights into otherwise uninterpretable models. One…

Human-Computer Interaction · Computer Science 2019-05-09 Martin Schuessler , Philipp Weiß

Machine learning plays an increasingly significant role in many aspects of our lives (including medicine, transportation, security, justice and other domains), making the potential consequences of false predictions increasingly devastating.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-01 Yuval Bahat , Gregory Shakhnarovich

In the context of post-hoc interpretability, this paper addresses the task of explaining the prediction of a classifier, considering the case where no information is available, neither on the classifier itself, nor on the processed data…

Machine Learning · Statistics 2017-12-25 Thibault Laugel , Marie-Jeanne Lesot , Christophe Marsala , Xavier Renard , Marcin Detyniecki

In image classification tasks, deep learning models are vulnerable to image distortions i.e. their accuracy significantly drops if the input images are distorted. An image-classifier is considered "reliable" if its accuracy on distorted…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Dang Nguyen , Sunil Gupta , Kien Do , Svetha Venkatesh

Generative AI has revolutionised visual content editing, empowering users to effortlessly modify images and videos. However, not all edits are equal. To perform realistic edits in domains such as natural image or medical imaging,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Thomas Melistas , Nikos Spyrou , Nefeli Gkouti , Pedro Sanchez , Athanasios Vlontzos , Yannis Panagakis , Giorgos Papanastasiou , Sotirios A. Tsaftaris

Natural language counterfactual generation aims to minimally modify a given text such that the modified text will be classified into a different class. The generated counterfactuals provide insight into the reasoning behind a model's…

Computation and Language · Computer Science 2024-10-08 Yongjie Wang , Xiaoqi Qiu , Yu Yue , Xu Guo , Zhiwei Zeng , Yuhong Feng , Zhiqi Shen

Counterfactual explanations (CEs) are a practical tool for demonstrating why machine learning classifiers make particular decisions. For CEs to be useful, it is important that they are easy for users to interpret. Existing methods for…

Machine Learning · Computer Science 2021-03-17 Lisa Schut , Oscar Key , Rory McGrath , Luca Costabello , Bogdan Sacaleanu , Medb Corcoran , Yarin Gal