English
Related papers

Related papers: Mitigating attribute amplification in counterfactu…

200 papers

Developing models that are capable of answering questions of the form "How would x change if y had been z?'" is fundamental to advancing medical image analysis. Training causal generative models that address such counterfactual questions,…

Machine Learning · Computer Science 2024-07-15 Yasin Ibrahim , Hermione Warr , Konstantinos Kamnitsas

Neural Image Classifiers are effective but inherently hard to interpret and susceptible to adversarial attacks. Solutions to both problems exist, among others, in the form of counterfactual examples generation to enhance explainability or…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Rafael Bischof , Florian Scheidegger , Michael A. Kraus , A. Cristiano I. Malossi

We propose an architecture for training generative models of counterfactual conditionals of the form, 'can we modify event A to cause B instead of C?', motivated by applications in robot control. Using an 'adversarial training' paradigm, an…

Robotics · Computer Science 2020-09-23 Simón C. Smith , Subramanian Ramamoorthy

We present a general causal generative modelling framework for accurate estimation of high fidelity image counterfactuals with deep structural causal models. Estimation of interventional and counterfactual queries for high-dimensional…

Machine Learning · Computer Science 2023-07-19 Fabio De Sousa Ribeiro , Tian Xia , Miguel Monteiro , Nick Pawlowski , Ben Glocker

Bias amplification is a phenomenon in which models exacerbate biases or stereotypes present in the training data. In this paper, we study bias amplification in the text-to-image domain using Stable Diffusion by comparing gender ratios in…

Machine Learning · Computer Science 2023-11-16 Preethi Seshadri , Sameer Singh , Yanai Elazar

While deep learning methods have shown great success in medical image analysis, they require a number of medical images to train. Due to data privacy concerns and unavailability of medical annotators, it is oftentimes very difficult to…

Image and Video Processing · Electrical Eng. & Systems 2020-10-08 Yue Yang , Pengtao Xie

This work showcases a new approach for causal discovery by leveraging user experiments and recent advances in photo-realistic image editing, demonstrating a potential of identifying causal factors and understanding complex systems…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Tao Li

We present Causal-Adapter, a modular framework that adapts frozen text-to-image diffusion backbones for counterfactual image generation. Our method supports causal interventions on target attributes and consistently propagates their effects…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Lei Tong , Zhihua Liu , Chaochao Lu , Dino Oglic , Tom Diethe , Philip Teare , Sotirios A. Tsaftaris , Chen Jin

The reliance of text classifiers on spurious correlations can lead to poor generalization at deployment, raising concerns about their use in safety-critical domains such as healthcare. In this work, we propose to use counterfactual data…

Machine Learning · Computer Science 2024-01-10 Amir Feder , Yoav Wald , Claudia Shi , Suchi Saria , David Blei

Recent theoretical work in causal inference has explored an important class of variables which, when conditioned on, may further amplify existing unmeasured confounding bias (bias amplification). Despite this theoretical work, existing…

Methodology · Statistics 2020-03-20 Tyrel Stokes , Russell Steele , Ian Shrier

Counterfactual Data Augmentation (CDA) is a commonly used technique for improving robustness in natural language classifiers. However, one fundamental challenge is how to discover meaningful counterfactuals and efficiently label them, with…

Computation and Language · Computer Science 2023-05-24 Ananth Balashankar , Xuezhi Wang , Yao Qin , Ben Packer , Nithum Thain , Jilin Chen , Ed H. Chi , Alex Beutel

With the wide use of deep neural networks (DNN), model interpretability has become a critical concern, since explainable decisions are preferred in high-stake scenarios. Current interpretation techniques mainly focus on the feature…

Machine Learning · Computer Science 2021-01-19 Fan Yang , Ninghao Liu , Mengnan Du , Xia Hu

In order to reduce overfitting, neural networks are typically trained with data augmentation, the practice of artificially generating additional training data via label-preserving transformations of existing training examples. While these…

Computer Vision and Pattern Recognition · Computer Science 2019-01-23 Cecilia Summers , Michael J. Dinneen

Deep learning (DL) models in medical imaging face challenges in generalizability and robustness due to variations in image acquisition parameters (IAP). In this work, we introduce a novel method using conditional denoising diffusion…

Image and Video Processing · Electrical Eng. & Systems 2024-11-01 Pedro Morão , Joao Santinha , Yasna Forghani , Nuno Loução , Pedro Gouveia , Mario A. T. Figueiredo

The key to multi-label image classification (MLC) is to improve model performance by leveraging label correlations. Unfortunately, it has been shown that overemphasizing co-occurrence relationships can cause the overfitting issue of the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Ming-Kun Xie , Jia-Hao Xiao , Pei Peng , Gang Niu , Masashi Sugiyama , Sheng-Jun Huang

Recent research suggests that predictions made by machine-learning models can amplify biases present in the training data. When a model amplifies bias, it makes certain predictions at a higher rate for some groups than expected based on…

Machine Learning · Computer Science 2022-10-20 Melissa Hall , Laurens van der Maaten , Laura Gustafson , Maxwell Jones , Aaron Adcock

Counterfactual medical image generation effectively addresses data scarcity and enhances the interpretability of medical images. However, due to the complex and diverse pathological features of medical images and the imbalanced class…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Weizhi Nie , Zichun Zhang , Weijie Wang , Bruno Lepri , Anan Liu , Nicu Sebe

The widespread adoption of generative AI models has raised growing concerns about representational harm and potential discriminatory outcomes. Yet, despite growing literature on this topic, the mechanisms by which bias emerges - especially…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Xiaofeng Zhang , Michelle Lin , Simon Lacoste-Julien , Aaron Courville , Yash Goyal

Supervised training of an automated medical image analysis system often requires a large amount of expert annotations that are hard to collect. Moreover, the proportions of data available across different classes may be highly imbalanced…

Computer Vision and Pattern Recognition · Computer Science 2019-12-10 Yuan Xue , Jiarong Ye , Rodney Long , Sameer Antani , Zhiyun Xue , Xiaolei Huang

Facial analysis models are increasingly used in applications that have serious impacts on people's lives, ranging from authentication to surveillance tracking. It is therefore critical to develop techniques that can reveal unintended biases…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Remi Denton , Ben Hutchinson , Margaret Mitchell , Timnit Gebru , Andrew Zaldivar