English
Related papers

Related papers: High Fidelity Image Counterfactuals with Probabili…

200 papers

Structural causal models postulate noisy functional relations among a set of interacting variables. The causal structure underlying each such model is naturally represented by a directed graph whose edges indicate for each variable which…

Statistics Theory · Mathematics 2022-03-15 David Strieder , Tobias Freidling , Stefan Haffner , Mathias Drton

This paper addresses the performance bottlenecks of existing text-driven image generation methods in terms of semantic alignment accuracy and structural consistency. A high-fidelity image generation method is proposed by integrating…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Danyi Gao

We formulate a general framework for building structural causal models (SCMs) with deep learning components. The proposed approach employs normalising flows and variational inference to enable tractable inference of exogenous noise…

Machine Learning · Statistics 2020-10-26 Nick Pawlowski , Daniel C. Castro , Ben Glocker

We propose a novel approach to mitigate biases in computer vision models by utilizing counterfactual generation and fine-tuning. While counterfactuals have been used to analyze and address biases in DNN models, the counterfactuals…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Pushkar Shukla , Dhruv Srikanth , Lee Cohen , Matthew Turk

We introduce a framework for learning robust visual representations that generalize to new viewpoints, backgrounds, and scene contexts. Discriminative models often learn naturally occurring spurious correlations, which cause them to fail on…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Chengzhi Mao , Augustine Cha , Amogh Gupta , Hao Wang , Junfeng Yang , Carl Vondrick

Counterfactual examples for an input -- perturbations that change specific features but not others -- have been shown to be useful for evaluating bias of machine learning models, e.g., against specific demographic groups. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-01-07 Saloni Dash , Vineeth N Balasubramanian , Amit Sharma

Counterfactuals -- expressing what might have been true under different circumstances -- have been widely applied in statistics and machine learning to help understand causal relationships. More recently, counterfactuals have begun to…

Human-Computer Interaction · Computer Science 2024-04-08 Arran Zeyu Wang , David Borland , David Gotz

We propose an architecture for training generative models of counterfactual conditionals of the form, 'can we modify event A to cause B instead of C?', motivated by applications in robot control. Using an 'adversarial training' paradigm, an…

Robotics · Computer Science 2020-09-23 Simón C. Smith , Subramanian Ramamoorthy

Interpretability research takes counterfactual theories of causality for granted. Most causal methods rely on counterfactual interventions to inputs or the activations of particular model components, followed by observations of the change…

Machine Learning · Computer Science 2024-07-08 Aaron Mueller

Interpretability research now offers a variety of techniques for identifying abstract internal mechanisms in neural networks. Can such techniques be used to predict how models will behave on out-of-distribution examples? In this work, we…

Machine Learning · Computer Science 2025-11-12 Jing Huang , Junyi Tao , Thomas Icard , Diyi Yang , Christopher Potts

As deep learning models are increasingly used in safety-critical applications, explainability and trustworthiness become major concerns. For simple images, such as low-resolution face portraits, synthesizing visual counterfactual…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Paul Jacob , Éloi Zablocki , Hédi Ben-Younes , Mickaël Chen , Patrick Pérez , Matthieu Cord

Causal generative modeling is essential for developing reliable and transparent AI systems capable of counterfactual reasoning. While existing approaches focus on integrating causal constraints during the training of generative models, they…

Machine Learning · Computer Science 2026-05-25 Aneesh Komanduri , Xintao Wu

Causal world models are systems that can answer counterfactual questions about an environment of interest, i.e. predict how it would have evolved if an arbitrary subset of events had been realized differently. It requires understanding the…

Artificial Intelligence · Computer Science 2025-05-21 Gaël Gendron , Jože M. Rožanec , Michael Witbrock , Gillian Dobbie

Neural Image Classifiers are effective but inherently hard to interpret and susceptible to adversarial attacks. Solutions to both problems exist, among others, in the form of counterfactual examples generation to enhance explainability or…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Rafael Bischof , Florian Scheidegger , Michael A. Kraus , A. Cristiano I. Malossi

A machine learning model, under the influence of observed or unobserved confounders in the training data, can learn spurious correlations and fail to generalize when deployed. For image classifiers, augmenting a training dataset using…

Machine Learning · Computer Science 2022-12-13 Abbavaram Gowtham Reddy , Saloni Dash , Amit Sharma , Vineeth N Balasubramanian

We propose a counterfactual approach to train ``causality-aware" predictive models that are able to leverage causal information in static anticausal machine learning tasks (i.e., prediction tasks where the outcome influences the features).…

Applications · Statistics 2020-12-01 Elias Chaibub Neto

Counterfactual medical image generation effectively addresses data scarcity and enhances the interpretability of medical images. However, due to the complex and diverse pathological features of medical images and the imbalanced class…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Weizhi Nie , Zichun Zhang , Weijie Wang , Bruno Lepri , Anan Liu , Nicu Sebe

Survivor bias in observational data leads the optimization of recommender systems towards local optima. Currently most solutions re-mines existing human-system collaboration patterns to maximize longer-term satisfaction by reinforcement…

Machine Learning · Computer Science 2023-10-31 Jialin Liu , Xinyan Su , Peng Zhou , Xiangyu Zhao , Jun Li

Causal reasoning provides a language to ask important interventional and counterfactual questions beyond purely statistical association. In medical imaging, for example, we may want to study the causal effect of genetic, environmental, or…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Rajat Rasal , Daniel C. Castro , Nick Pawlowski , Ben Glocker

Foundation models trained on web-scraped datasets propagate societal biases to downstream tasks. While counterfactual generation enables bias analysis, existing methods introduce artifacts by modifying contextual elements like clothing and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Kirill Sirotkin , Marcos Escudero-Viñolo , Pablo Carballeira , Mayug Maniparambil , Catarina Barata , Noel E. O'Connor