English
Related papers

Related papers: V-CECE: Visual Counterfactual Explanations via Con…

200 papers

Counterfactual explanations have emerged as a popular solution for the eXplainable AI (XAI) problem of elucidating the predictions of black-box deep-learning systems due to their psychological validity, flexibility across problem domains…

Machine Learning · Computer Science 2022-12-20 Eoin Delaney , Arjun Pakrashi , Derek Greene , Mark T. Keane

Counterfactual explanations have been successfully applied to create human interpretable explanations for various black-box models. They are handy for tasks in the image domain, where the quality of the explanations benefits from recent…

Machine Learning · Computer Science 2025-03-27 Trung Duc Ha , Sidney Bender

Nowadays, deep vision models are being widely deployed in safety-critical applications, e.g., autonomous driving, and explainability of such models is becoming a pressing concern. Among explanation methods, counterfactual explanations aim…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Mehdi Zemni , Mickaël Chen , Éloi Zablocki , Hédi Ben-Younes , Patrick Pérez , Matthieu Cord

Counterfactual explanation is a common class of methods to make local explanations of machine learning decisions. For a given instance, these methods aim to find the smallest modification of feature values that changes the predicted…

Artificial Intelligence · Computer Science 2022-12-22 Victor Guyomard , Françoise Fessant , Thomas Guyet , Tassadit Bouadi , Alexandre Termier

Visual counterfactual explanations (VCEs) have recently gained immense popularity as a tool for clarifying the decision-making process of image classifiers. This trend is largely motivated by what these explanations promise to deliver --…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Bartlomiej Sobieski , Jakub Grzywaczewski , Bartlomiej Sadlej , Matthew Tivnan , Przemyslaw Biecek

Research in Image Generation has recently made significant progress, particularly boosted by the introduction of Vision-Language models which are able to produce high-quality visual content based on textual inputs. Despite ongoing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Federico Betti , Jacopo Staiano , Lorenzo Baraldi , Lorenzo Baraldi , Rita Cucchiara , Nicu Sebe

Counterfactual explanations have shown promising results as a post-hoc framework to make image classifiers more explainable. In this paper, we propose DiME, a method allowing the generation of counterfactual images using the recent…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Guillaume Jeanneret , Loïc Simon , Frédéric Jurie

To understand the black-box characteristics of deep networks, counterfactual explanation that deduces not only the important features of an input space but also how those features should be modified to classify input as a target class has…

Machine Learning · Computer Science 2022-08-15 Hong-Gyu Jung , Sin-Han Kang , Hee-Dong Kim , Dong-Ok Won , Seong-Whan Lee

Recent advancements in generative AI have introduced novel prospects and practical implementations. Especially diffusion models show their strength in generating diverse and, at the same time, realistic features, positioning them well for…

Machine Learning · Computer Science 2024-06-05 Franz Motzkus , Christian Hellert , Ute Schmid

Generating counterfactual explanations is one of the most effective approaches for uncovering the inner workings of black-box neural network models and building user trust. While remarkable strides have been made in generative modeling…

Machine Learning · Computer Science 2023-12-22 Nishtha Madaan , Srikanta Bedathur

Counterfactual explanations (CFE) for deep image classifiers aim to reveal how minimal input changes lead to different model decisions, providing critical insights for model interpretation and improvement. However, existing CFE methods…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Townim Faisal Chowdhury , Vu Minh Hieu Phan , Kewen Liao , Nanyu Dong , Minh-Son To , Anton Hengel , Johan Verjans , Zhibin Liao

Counterfactual reasoning -- the practice of asking ``what if'' by varying inputs and observing changes in model behavior -- has become central to interpretable and fair AI. This thesis develops frameworks that use counterfactuals to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Pushkar Shukla

Natural language explanation in visual question answer (VQA-NLE) aims to explain the decision-making process of models by generating natural language sentences to increase users' trust in the black-box systems. Existing post-hoc methods…

Computation and Language · Computer Science 2023-12-22 Chengen Lai , Shengli Song , Shiqi Meng , Jingyang Li , Sitong Yan , Guangneng Hu

Fact-checking systems have become important tools to verify fake and misguiding news. These systems become more trustworthy when human-readable explanations accompany the veracity labels. However, manual collection of such explanations is…

Computation and Language · Computer Science 2021-12-15 Shailza Jolly , Pepa Atanasova , Isabelle Augenstein

There is a growing concern that the recent progress made in AI, especially regarding the predictive competence of deep learning models, will be undermined by a failure to properly explain their operation and outputs. In response to this…

Machine Learning · Computer Science 2020-09-15 Eoin M. Kenny , Mark T. Keane

Counterfactuals have been established as a popular explainability technique which leverages a set of minimal edits to alter the prediction of a classifier. When considering conceptual counterfactuals on images, the edits requested should…

Machine Learning · Computer Science 2024-05-06 Angeliki Dimitriou , Nikolaos Chaidos , Maria Lymperaiou , Giorgos Stamou

While Visual Question Answering (VQA) models continue to push the state-of-the-art forward, they largely remain black-boxes - failing to provide insight into how or why an answer is generated. In this ongoing work, we propose addressing…

Computer Vision and Pattern Recognition · Computer Science 2019-11-18 Jingjing Pan , Yash Goyal , Stefan Lee

We present CounterfactualExplanations.jl: a package for generating Counterfactual Explanations (CE) and Algorithmic Recourse (AR) for black-box models in Julia. CE explain how inputs into a model need to change to yield specific model…

Machine Learning · Computer Science 2023-08-15 Patrick Altmeyer , Arie van Deursen , Cynthia C. S. Liem

Counterfactual image editing is an important task in generative AI, which asks how an image would look if certain features were different. The current literature on the topic focuses primarily on changing individual features while remaining…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Yushu Pan , Elias Bareinboim

Text-guided diffusion models have advanced image editing by enabling intuitive control through language. However, despite their strong capabilities, we surprisingly find that SOTA methods struggle with simple, everyday transformations such…

Image and Video Processing · Electrical Eng. & Systems 2026-03-27 Omar Elezabi , Eduard Zamfir , Zongwei Wu , Radu Timofte