English
Related papers

Related papers: Invariance & Causal Representation Learning: Prosp…

200 papers

The task of causal representation learning aims to uncover latent higher-level causal variables that affect lower-level observations. Identifying the true latent causal variables from observed data, while allowing instantaneous causal…

Machine Learning · Computer Science 2026-02-19 Yuhang Liu , Zhen Zhang , Dong Gong , Mingming Gong , Biwei Huang , Anton van den Hengel , Kun Zhang , Javen Qinfeng Shi

Causal inference is capable of estimating the treatment effect (i.e., the causal effect of treatment on the outcome) to benefit the decision making in various domains. One fundamental challenge in this research is that the treatment…

Machine Learning · Computer Science 2021-12-28 Qian Li , Zhichao Wang , Shaowu Liu , Gang Li , Guandong Xu

Causal inference methods based on conditional independence construct Markov equivalent graphs, and cannot be applied to bivariate cases. The approaches based on independence of cause and mechanism state, on the contrary, that causal…

Machine Learning · Computer Science 2021-08-04 Nataliya Sokolovska , Pierre-Henri Wuillemin

Inferring causal effects of a treatment, intervention or policy from observational data is central to many applications. However, state-of-the-art methods for causal inference seldom consider the possibility that covariates have missing…

Methodology · Statistics 2020-02-26 Imke Mayer , Julie Josse , Félix Raimundo , Jean-Philippe Vert

We study causal representation learning, the task of inferring latent causal variables and their causal relations from high-dimensional mixtures of the variables. Prior work relies on weak supervision, in the form of counterfactual pre- and…

Machine Learning explainability techniques have been proposed as a means of `explaining' or interrogating a model in order to understand why a particular decision or prediction has been made. Such an ability is especially important at a…

Machine Learning · Statistics 2022-02-28 Matthew J. Vowels

This paper presents a novel approach that leverages domain variability to learn representations that are conditionally invariant to unwanted variability or distractors. Our approach identifies both spurious and invariant latent features…

Machine Learning · Computer Science 2023-07-04 Hananeh Aliee , Ferdinand Kapl , Soroor Hediyeh-Zadeh , Fabian J. Theis

The goal of causal representation learning is to find a representation of data that consists of causally related latent variables. We consider a setup where one has access to data from multiple domains that potentially share a causal…

Machine Learning · Statistics 2023-10-30 Nils Sturma , Chandler Squires , Mathias Drton , Caroline Uhler

It has become increasingly common nowadays to collect observations of feature and response pairs from different environments. As a consequence, one has to apply learned predictors to data with a different distribution due to distribution…

Methodology · Statistics 2023-10-31 Kang Du , Yu Xiang

Learning high-level causal representations together with a causal model from unstructured low-level data such as pixels is impossible from observational data alone. We prove under mild assumptions that this representation is however…

Machine Learning · Statistics 2022-10-12 Johann Brehmer , Pim de Haan , Phillip Lippe , Taco Cohen

The causal discovery of Bayesian networks is an active and important research area, and it is based upon searching the space of causal models for those which can best explain a pattern of probabilistic dependencies shown in the data.…

Artificial Intelligence · Computer Science 2016-07-25 Xuhui Zhang , Kevin B. Korb , Ann E. Nicholson , Steven Mascaro

A key to causal inference with observational data is achieving balance in predictive features associated with each treatment type. Recent literature has explored representation learning to achieve this goal. In this work, we discuss the…

Machine Learning · Statistics 2021-02-25 Serge Assaad , Shuxi Zeng , Chenyang Tao , Shounak Datta , Nikhil Mehta , Ricardo Henao , Fan Li , Lawrence Carin

Causal representation learning (CRL) enhances machine learning models' robustness and generalizability by learning structural causal models associated with data-generating processes. We focus on a family of CRL methods that uses contrastive…

Machine Learning · Statistics 2025-03-17 Xiusi Li , Sékou-Oumar Kaba , Siamak Ravanbakhsh

Estimating causal effects from nonexperimental data is a fundamental problem in many fields of science. A key component of this task is selecting an appropriate set of covariates for confounding adjustment to avoid bias. Most existing…

Machine Learning · Computer Science 2025-10-28 Zheng Li , Xichen Guo , Feng Xie , Yan Zeng , Hao Zhang , Zhi Geng

Inducing causal relationships from observations is a classic problem in machine learning. Most work in causality starts from the premise that the causal variables themselves are observed. However, for AI agents such as robots trying to make…

Identifying latent variables and causal structures from observational data is essential to many real-world applications involving biological data, medical data, and unstructured data such as images and languages. However, this task can be…

Machine Learning · Computer Science 2023-11-01 Lingjing Kong , Biwei Huang , Feng Xie , Eric Xing , Yuejie Chi , Kun Zhang

Addressing selection bias in latent variable causal discovery is important yet underexplored, largely due to a lack of suitable statistical tools: While various tools beyond basic conditional independencies have been developed to handle…

Machine Learning · Computer Science 2025-12-15 Haoyue Dai , Yiwen Qiu , Ignavier Ng , Xinshuai Dong , Peter Spirtes , Kun Zhang

Causal representation learning (CRL) offers the promise of uncovering the underlying causal model by which observed data was generated, but the practical applicability of existing methods remains limited by the strong assumptions required…

Machine Learning · Computer Science 2026-01-30 Yuhang Liu , Zhen Zhang , Dong Gong , Erdun Gao , Biwei Huang , Mingming Gong , Anton van den Hengel , Kun Zhang , Javen Qinfeng Shi

Identifying the direct causes or causal parents of a target variable is crucial for scientific discovery. Focusing on linear models, the invariant prediction framework was built upon the invariance principle, namely, the conditional…

Methodology · Statistics 2023-07-19 Kang Du , Yu Xiang , Ilya Soloveychik

Massive data collection holds the promise of a better understanding of complex phenomena and, ultimately, better decisions. Representation learning has become a key driver of deep learning applications, as it allows learning latent spaces…

Machine Learning · Computer Science 2025-11-10 Caroline Uhler , Jiaqi Zhang