English
Related papers

Related papers: Towards Desiderata-Driven Design of Visual Counter…

200 papers

Counterfactual Explanations (CFEs) interpret machine learning models by identifying the smallest change to input features needed to change the model's prediction to a desired output. For classification tasks, CFEs determine how close a…

Machine Learning · Computer Science 2025-10-01 Margarita A. Guerrero , Cristian R. Rojas

Visual counterfactual explanation (CF) methods modify image concepts, e.g, shape, to change a prediction to a predefined outcome while closely resembling the original query image. Unlike self-explainable models (SEMs) and heatmap…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Anselm Haselhoff , Kevin Trelenberg , Fabian Küppers , Jonas Schneider

Recent black-box counterfactual generation frameworks fail to take into account the semantic content of the proposed edits, while relying heavily on training to guide the generation process. We propose a novel, plug-and-play black-box…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Nikolaos Spanos , Maria Lymperaiou , Giorgos Filandrianos , Konstantinos Thomas , Athanasios Voulodimos , Giorgos Stamou

The goal of a classification model is to assign the correct labels to data. In most cases, this data is not fully described by the given set of labels. Often a rich set of meaningful concepts exist in the domain that can much more precisely…

Machine Learning · Computer Science 2021-08-23 Yoeri Poels , Vlado Menkovski

When an image classifier outputs a wrong class label, it can be helpful to see what changes in the image would lead to a correct classification. This is the aim of algorithms generating counterfactual explanations. However, there is no…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Benedikt Höltgen , Lisa Schut , Jan M. Brauner , Yarin Gal

Counterfactual explanations have substantially increased in popularity in the past few years as a useful human-centric way of understanding individual black-box model predictions. While several properties desired of high-quality…

Machine Learning · Computer Science 2022-10-14 Shubham Sharma , Alan H. Gee , Jette Henderson , Joydeep Ghosh

Conditional Variational Auto Encoders (VAE) are gathering significant attention as an Explainable Artificial Intelligence (XAI) tool. The codes in the latent space provide a theoretically sound way to produce counterfactuals, i.e.…

Machine Learning · Computer Science 2021-02-02 Nicolas Vercheval , Aleksandra Pizurica

Recent advancements in generative AI have introduced novel prospects and practical implementations. Especially diffusion models show their strength in generating diverse and, at the same time, realistic features, positioning them well for…

Machine Learning · Computer Science 2024-06-05 Franz Motzkus , Christian Hellert , Ute Schmid

The concept of counterfactual explanations (CE) has emerged as one of the important concepts to understand the inner workings of complex AI systems. In this paper, we translate the idea of CEs to linear optimization and propose, motivate,…

Optimization and Control · Mathematics 2024-05-27 Jannis Kurtz , Ş. İlker Birbil , Dick den Hertog

In the domain of non-generative visual counterfactual explanations (CE), traditional techniques frequently involve the substitution of sections within a query image with corresponding sections from distractor images. Such methods have…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Lintong Zhang , Kang Yin , Seong-Whan Lee

Nowadays, deep vision models are being widely deployed in safety-critical applications, e.g., autonomous driving, and explainability of such models is becoming a pressing concern. Among explanation methods, counterfactual explanations aim…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Mehdi Zemni , Mickaël Chen , Éloi Zablocki , Hédi Ben-Younes , Patrick Pérez , Matthieu Cord

Counterfactual explanation is a form of interpretable machine learning that generates perturbations on a sample to achieve the desired outcome. The generated samples can act as instructions to guide end users on how to observe the desired…

Machine Learning · Computer Science 2023-03-28 Tri Dung Duong , Qian Li , Guandong Xu

As deep learning models are increasingly used in safety-critical applications, explainability and trustworthiness become major concerns. For simple images, such as low-resolution face portraits, synthesizing visual counterfactual…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Paul Jacob , Éloi Zablocki , Hédi Ben-Younes , Mickaël Chen , Patrick Pérez , Matthieu Cord

Counterfactual explanations (CFE) for deep image classifiers aim to reveal how minimal input changes lead to different model decisions, providing critical insights for model interpretation and improvement. However, existing CFE methods…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Townim Faisal Chowdhury , Vu Minh Hieu Phan , Kewen Liao , Nanyu Dong , Minh-Son To , Anton Hengel , Johan Verjans , Zhibin Liao

Counterfactual explanations (CEs) offer interpretable insights into machine learning predictions by answering ``what if?" questions. However, in real-world settings where models are frequently updated, existing counterfactual explanations…

Machine Learning · Computer Science 2026-02-12 Jamie Duell , Xiuyi Fan

Counterfactual explanations (CFEs) are a popular approach for interpreting machine learning predictions by identifying minimal feature changes that alter model outputs. However, in real-world settings, users often refine feasibility…

Machine Learning · Computer Science 2025-05-28 Christos Fragkathoulas , Evaggelia Pitoura

Post-hoc explanation methods for machine learning models have been widely used to support decision-making. One of the popular methods is Counterfactual Explanation (CE), also known as Actionable Recourse, which provides a user with a…

Machine Learning · Computer Science 2021-11-10 Kentaro Kanamori , Takuya Takagi , Ken Kobayashi , Yuichi Ike , Kento Uemura , Hiroki Arimura

Counterfactual Explanation (CE) techniques have garnered attention as a means to provide insights to the users engaging with AI systems. While extensively researched in domains such as medical imaging and autonomous vehicles, Graph…

Machine Learning · Computer Science 2024-01-12 Mario Alfonso Prado-Romero , Bardh Prenkaj , Giovanni Stilo

As black-box AI-driven decision-making systems become increasingly widespread in modern document processing workflows, improving their transparency and reliability has become critical, especially in high-stakes applications where biases or…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Saifullah Saifullah , Stefan Agne , Andreas Dengel , Sheraz Ahmed

Counterfactual explanations (CE) are the de facto method for providing insights into black-box decision-making models by identifying alternative inputs that lead to different outcomes. However, existing CE approaches, including group and…

Artificial Intelligence · Computer Science 2025-03-13 Lei You , Lele Cao , Mattias Nilsson , Bo Zhao , Lei Lei