English
Related papers

Related papers: Evaluating and Mitigating Bias in Image Classifier…

200 papers

Generative AI has revolutionised visual content editing, empowering users to effortlessly modify images and videos. However, not all edits are equal. To perform realistic edits in domains such as natural image or medical imaging,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Thomas Melistas , Nikos Spyrou , Nefeli Gkouti , Pedro Sanchez , Athanasios Vlontzos , Yannis Panagakis , Giorgos Papanastasiou , Sotirios A. Tsaftaris

Counterfactuals, serving as one of the emerging type of model interpretations, have recently received attention from both researchers and practitioners. Counterfactual explanations formalize the exploration of ``what-if'' scenarios, and are…

Machine Learning · Computer Science 2021-06-17 Fan Yang , Sahan Suresh Alva , Jiahao Chen , Xia Hu

Explainability for machine learning models has gained considerable attention within the research community given the importance of deploying more reliable machine-learning systems. In computer vision applications, generative counterfactual…

Machine Learning · Computer Science 2021-11-12 Pau Rodriguez , Massimo Caccia , Alexandre Lacoste , Lee Zamparo , Issam Laradji , Laurent Charlin , David Vazquez

We introduce an approach to counterfactual inference based on merging information from multiple datasets. We consider a causal reformulation of the statistical marginal problem: given a collection of marginal structural causal models (SCMs)…

Artificial Intelligence · Computer Science 2022-07-18 Luigi Gresele , Julius von Kügelgen , Jonas M. Kübler , Elke Kirschbaum , Bernhard Schölkopf , Dominik Janzing

Mammogram benign or malignant classification with only image-level labels is challenging due to the absence of lesion annotations. Motivated by the symmetric prior that the lesions on one side of breasts rarely appear in the corresponding…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Chu-ran Wang , Jing Li , Fandong Zhang , Xinwei Sun , Hao Dong , Yizhou Yu , Yizhou Wang

We consider the task of counterfactual estimation from observational imaging data given a known causal structure. In particular, quantifying the causal effect of interventions for high-dimensional data with neural networks remains an open…

Machine Learning · Computer Science 2022-02-22 Pedro Sanchez , Sotirios A. Tsaftaris

Deep generative models have shown tremendous capability in data density estimation and data generation from finite samples. While these models have shown impressive performance by learning correlations among features in the data, some…

Machine Learning · Computer Science 2024-05-24 Aneesh Komanduri , Xintao Wu , Yongkai Wu , Feng Chen

Counterfactual explanation methods have recently received significant attention for explaining CNN-based image classifiers due to their ability to provide easily understandable explanations that align more closely with human reasoning.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Syed Ali Tariq , Tehseen Zia

This work showcases a new approach for causal discovery by leveraging user experiments and recent advances in photo-realistic image editing, demonstrating a potential of identifying causal factors and understanding complex systems…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Tao Li

Causal generative modelling is gaining interest in medical imaging due to its ability to answer interventional and counterfactual queries. Most work focuses on generating counterfactual images that look plausible, using auxiliary…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Tian Xia , Mélanie Roschewitz , Fabio De Sousa Ribeiro , Charles Jones , Ben Glocker

To construct interpretable explanations that are consistent with the original ML model, counterfactual examples---showing how the model's output changes with small perturbations to the input---have been proposed. This paper extends the work…

Machine Learning · Computer Science 2020-06-16 Divyat Mahajan , Chenhao Tan , Amit Sharma

Counterfactual explanations have been successfully applied to create human interpretable explanations for various black-box models. They are handy for tasks in the image domain, where the quality of the explanations benefits from recent…

Machine Learning · Computer Science 2025-03-27 Trung Duc Ha , Sidney Bender

Deep learning models in medical imaging often fail when deployed in new clinical environments due to distribution shifts in demographics, scanner hardware, or acquisition protocols. A central challenge is underspecification, where models…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Moritz Stammel , Fabio De Sousa Ribeiro , Raghav Mehta , Mélanie Roschewitz , Ben Glocker

This paper proposes a novel framework to reinforce classification models using language-guided generated counterfactual images. Deep learning classification models are often trained using datasets that mirror real-world scenarios. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Xiang Li , Ren Togo , Keisuke Maeda , Takahiro Ogawa , Miki Haseyama

One well motivated explanation method for classifiers leverages counterfactuals which are hypothetical events identical to real observations in all aspects except for one feature. Constructing such counterfactual poses specific challenges…

Machine Learning · Computer Science 2024-09-12 Pirmin Lemberger , Antoine Saillenfest

Due to the increasing use of Machine Learning models in high stakes decision making settings, it has become increasingly important to have tools to understand how models arrive at decisions. Assuming a trained Supervised Classification…

Machine Learning · Statistics 2023-10-20 Emilio Carrizosa , Jasone Ramírez-Ayerbe , Dolores Romero Morales

Counterfactual instances offer human-interpretable insight into the local behaviour of machine learning models. We propose a general framework to generate sparse, in-distribution counterfactual model explanations which match a desired…

Machine Learning · Computer Science 2021-01-26 Arnaud Van Looveren , Janis Klaise , Giovanni Vacanti , Oliver Cobb

When an image classifier outputs a wrong class label, it can be helpful to see what changes in the image would lead to a correct classification. This is the aim of algorithms generating counterfactual explanations. However, there is no…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Benedikt Höltgen , Lisa Schut , Jan M. Brauner , Yarin Gal

Counterfactual explanations for machine learning models are used to find minimal interventions to the feature values such that the model changes the prediction to a different output or a target output. A valid counterfactual explanation…

Machine Learning · Computer Science 2023-03-23 Shravan Kumar Sajja , Sumanta Mukherjee , Satyam Dwivedi

Deep learning models can perform well in complex medical imaging classification tasks, even when basing their conclusions on spurious correlations (i.e. confounders), should they be prevalent in the training dataset, rather than on the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Amar Kumar , Nima Fathi , Raghav Mehta , Brennan Nichyporuk , Jean-Pierre R. Falet , Sotirios Tsaftaris , Tal Arbel