English
Related papers

Related papers: De-Biasing Generative Models using Counterfactual …

200 papers

We introduce a framework for learning robust visual representations that generalize to new viewpoints, backgrounds, and scene contexts. Discriminative models often learn naturally occurring spurious correlations, which cause them to fail on…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Chengzhi Mao , Augustine Cha , Amogh Gupta , Hao Wang , Junfeng Yang , Carl Vondrick

Foundation models, despite their robust zero-shot capabilities, remain vulnerable to spurious correlations and 'Clever Hans' strategies. Existing mitigation methods often rely on unavailable group labels or computationally expensive…

Machine Learning · Computer Science 2026-05-07 Sidney Bender , Marco Morik

This paper proposes a Disentangled gEnerative cAusal Representation (DEAR) learning method under appropriate supervised information. Unlike existing disentanglement methods that enforce independence of the latent variables, we consider the…

Machine Learning · Computer Science 2022-10-04 Xinwei Shen , Furui Liu , Hanze Dong , Qing Lian , Zhitang Chen , Tong Zhang

Image paragraph generation is the task of producing a coherent story (usually a paragraph) that describes the visual content of an image. The problem nevertheless is not trivial especially when there are multiple descriptive and diverse…

Computer Vision and Pattern Recognition · Computer Science 2019-08-02 Jing Wang , Yingwei Pan , Ting Yao , Jinhui Tang , Tao Mei

Causal learning has long concerned itself with the accurate recovery of underlying causal mechanisms. Such causal modelling enables better explanations of out-of-distribution data. Prior works on causal learning assume that the high-level…

We consider the problem of answering observational, interventional, and counterfactual queries in a causally sufficient setting where only observational data and the causal graph are available. Utilizing the recent developments in diffusion…

Machine Learning · Statistics 2024-10-11 Patrick Chao , Patrick Blöbaum , Sapan Patel , Shiva Prasad Kasiviswanathan

Most neural models of causality assume static causal graphs, failing to capture the dynamic and sparse nature of physical interactions where causal relationships emerge and dissolve over time. We introduce the Causal Process Framework and…

Machine Learning · Computer Science 2026-04-07 Turan Orujlu , Christian Gumbsch , Martin V. Butz , Charley M Wu

Variational autoencoders (VAEs) are widely used deep generative models capable of learning unsupervised latent representations of data. Such representations are often difficult to interpret or control. We consider the problem of…

Machine Learning · Computer Science 2018-12-18 Jack Klys , Jake Snell , Richard Zemel

The recent rise in deep learning technologies fueled innovation and boosted scientific research. Their achievements enabled new research directions for deep generative modeling (DGM), an increasingly popular approach that can create novel…

Machine Learning · Computer Science 2022-04-28 Luca Bergamin , Tommaso Carraro , Mirko Polato , Fabio Aiolli

Deep learning classifiers are prone to latching onto dominant confounders present in a dataset rather than on the causal markers associated with the target class, leading to poor generalization and biased predictions. Although…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Nima Fathi , Amar Kumar , Brennan Nichyporuk , Mohammad Havaei , Tal Arbel

Visual counterfactual explanation (CF) methods modify image concepts, e.g, shape, to change a prediction to a predefined outcome while closely resembling the original query image. Unlike self-explainable models (SEMs) and heatmap…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Anselm Haselhoff , Kevin Trelenberg , Fabian Küppers , Jonas Schneider

This study presents a novel framework for counterfactual user behavior forecasting that combines structural causal models with transformer-based generative artificial intelligence. To model fictitious situations, the method creates causal…

Machine Learning · Computer Science 2025-11-12 Dharmateja Priyadarshi Uddandarao , Ravi Kiran Vadlamani

Motivated by the burgeoning interest in cross-domain learning, we present a novel generative modeling challenge: generating counterfactual samples in a target domain based on factual observations from a source domain. Our approach operates…

Generative AI has revolutionised visual content editing, empowering users to effortlessly modify images and videos. However, not all edits are equal. To perform realistic edits in domains such as natural image or medical imaging,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Thomas Melistas , Nikos Spyrou , Nefeli Gkouti , Pedro Sanchez , Athanasios Vlontzos , Yannis Panagakis , Giorgos Papanastasiou , Sotirios A. Tsaftaris

Recent work on counterfactual visual explanations has contributed to making artificial intelligence models more explainable by providing visual perturbation to flip the prediction. However, these approaches neglect the causal relationships…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yiran Qiao , Disheng Liu , Yiren Lu , Yu Yin , Mengnan Du , Jing Ma

Context-Aware Emotion Recognition (CAER) is a crucial and challenging task that aims to perceive the emotional states of the target person with contextual information. Recent approaches invariably focus on designing sophisticated…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Dingkang Yang , Zhaoyu Chen , Yuzheng Wang , Shunli Wang , Mingcheng Li , Siao Liu , Xiao Zhao , Shuai Huang , Zhiyan Dong , Peng Zhai , Lihua Zhang

In recent years, research on image generation methods has been developing fast. The auto-encoding variational Bayes method (VAEs) was proposed in 2013, which uses variational inference to learn a latent space from the image database and…

Computer Vision and Pattern Recognition · Computer Science 2018-07-12 Guoqiang Zhong , Wei Gao , Yongbin Liu , Youzhao Yang

Developing models that are capable of answering questions of the form "How would x change if y had been z?'" is fundamental to advancing medical image analysis. Training causal generative models that address such counterfactual questions,…

Machine Learning · Computer Science 2024-07-15 Yasin Ibrahim , Hermione Warr , Konstantinos Kamnitsas

The ability to extract generative parameters from high-dimensional fields of data in an unsupervised manner is a highly desirable yet unrealized goal in computational physics. This work explores the use of variational autoencoders (VAEs)…

Computational Physics · Physics 2021-11-16 Christian Jacobsen , Karthik Duraisamy

Explainable machine learning has attracted much interest in the community where the stakes are high. Counterfactual explanations methods have become an important tool in explaining a black-box model. The recent advances have leveraged the…

Machine Learning · Computer Science 2025-09-03 Wei Zhang , Brian Barr , John Paisley