English
Related papers

Related papers: Counterfactual Stress Testing for Image Classifica…

200 papers

With the widespread application of causal inference, it is increasingly important to have tools which can test for the presence of causal effects in a diverse array of circumstances. In this vein we focus on the problem of testing for…

Machine Learning · Statistics 2023-11-08 Jake Fawkes , Robert Hu , Robin J. Evans , Dino Sejdinovic

In this paper, we propose leveraging causal generative learning as an interpretable tool for explaining image classifiers. Specifically, we present a generative counterfactual inference approach to study the influence of visual features…

Machine Learning · Computer Science 2024-01-23 Will Taylor-Melanson , Zahra Sadeghi , Stan Matwin

Understanding predictions made by deep neural networks is notoriously difficult, but also crucial to their dissemination. As all machine learning based methods, they are as good as their training data, and can also capture unwanted biases.…

Computation and Language · Computer Science 2022-11-15 Amir Feder , Nadav Oved , Uri Shalit , Roi Reichart

Healthcare artificial intelligence systems often degrade in performance when deployed across institutions, with documented performance drops and perpetuation of discriminatory patterns embedded in data. This brittleness comes, in part, from…

Machine Learning · Computer Science 2026-03-30 Munib Mesinovic , Max Buhlan , Tingting Zhu

Biomedical imaging datasets are often small and biased, meaning that real-world performance of predictive models can be substantially lower than expected from internal testing. This work proposes using generative image editing to simulate…

Counterfactual explanation methods have recently received significant attention for explaining CNN-based image classifiers due to their ability to provide easily understandable explanations that align more closely with human reasoning.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Syed Ali Tariq , Tehseen Zia

Deep learning models are challenged by the distribution shift between the training data and test data. Recently, the large models pre-trained on diverse data have demonstrated unprecedented robustness to various distribution shifts.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Yao Xiao , Ziyi Tang , Pengxu Wei , Cong Liu , Liang Lin

Physical and optical factors interacting with sensor characteristics create complex image degradation patterns. Despite advances in deep learning-based super-resolution, existing methods overlook the causal nature of degradation by adopting…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Zhengyang Lu , Bingjie Lu , Feng Wang

We propose a BlackBox Counterfactual Explainer, designed to explain image classification models for medical applications. Classical approaches (e.g., saliency maps) that assess feature importance do not explain "how" imaging features in…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Sumedha Singla , Motahhare Eslami , Brian Pollack , Stephen Wallace , Kayhan Batmanghelich

Foundation models trained on web-scraped datasets propagate societal biases to downstream tasks. While counterfactual generation enables bias analysis, existing methods introduce artifacts by modifying contextual elements like clothing and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Kirill Sirotkin , Marcos Escudero-Viñolo , Pablo Carballeira , Mayug Maniparambil , Catarina Barata , Noel E. O'Connor

Audio-based depression detection models have demonstrated promising performance but often suffer from gender bias due to imbalanced training data. Epidemiological statistics show a higher prevalence of depression in females, leading models…

Machine Learning · Computer Science 2026-02-04 Mingxuan Hu , Hongbo Ma , Xinlan Wu , Ziqi Liu , Jiaqi Liu , Yangbin Chen

The fundamental challenge of drawing causal inference is that counterfactual outcomes are not fully observed for any unit. Furthermore, in observational studies, treatment assignment is likely to be confounded. Many statistical methods have…

Methodology · Statistics 2022-08-01 Harsh Parikh , Carlos Varjao , Louise Xu , Eric Tchetgen Tchetgen

Counterfactual explanations promote explainability in machine learning models by answering the question "how should an input instance be perturbed to obtain a desired predicted label?". The comparison of this instance before and after…

Machine Learning · Computer Science 2022-11-09 Jing Ma , Ruocheng Guo , Saumitra Mishra , Aidong Zhang , Jundong Li

Deep generative models have demonstrated remarkable success in medical image synthesis. However, ensuring conditioning faithfulness and high-quality synthetic images for direct or counterfactual generation remains a challenge. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Fangrui Huang , Alan Wang , Binxu Li , Bailey Trang , Ridvan Yesiloglu , Tianyu Hua , Wei Peng , Ehsan Adeli

Context-aware emotion recognition (CAER) has recently boosted the practical applications of affective computing techniques in unconstrained environments. Mainstream CAER methods invariably extract ensemble representations from diverse…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Dingkang Yang , Kun Yang , Mingcheng Li , Shunli Wang , Shuaibing Wang , Lihua Zhang

Causal modeling has been recognized as a potential solution to many challenging problems in machine learning (ML). Here, we describe how a recently proposed counterfactual approach developed to deconfound linear structural causal models can…

Machine Learning · Computer Science 2020-11-23 Elias Chaibub Neto

Model explanations based on pure observational data cannot compute the effects of features reliably, due to their inability to estimate how each factor alteration could affect the rest. We argue that explanations should be based on the…

Machine Learning · Statistics 2019-09-20 Álvaro Parafita , Jordi Vitrià

We present a general framework for evaluating image counterfactuals. The power and flexibility of deep generative models make them valuable tools for learning mechanisms in structural causal models. However, their flexibility makes…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Miguel Monteiro , Fabio De Sousa Ribeiro , Nick Pawlowski , Daniel C. Castro , Ben Glocker

Aligning the decision-making process of machine learning algorithms with that of experienced radiologists is crucial for reliable diagnosis. While existing methods have attempted to align their diagnosis behaviors to those of radiologists…

Machine Learning · Computer Science 2025-02-10 Mingzhou Liu , Ching-Wen Lee , Xinwei Sun , Yu Qiao , Yizhou Wang

We propose a counterfactual approach to train ``causality-aware" predictive models that are able to leverage causal information in static anticausal machine learning tasks (i.e., prediction tasks where the outcome influences the features).…

Applications · Statistics 2020-12-01 Elias Chaibub Neto