English
Related papers

Related papers: Invariance & Causal Representation Learning: Prosp…

200 papers

To discover new drugs is to seek and to prove causality. As an emerging approach leveraging human knowledge and creativity, data, and machine intelligence, causal inference holds the promise of reducing cognitive bias and improving decision…

Quantitative Methods · Quantitative Biology 2025-04-09 Tom Michoel , Jitao David Zhang

There exist well-developed frameworks for causal modelling, but these require rather a lot of human domain expertise to define causal variables and perform interventions. In order to enable autonomous agents to learn abstract causal models…

Artificial Intelligence · Computer Science 2022-08-15 Taco Cohen

Causal reasoning can be considered a cornerstone of intelligent systems. Having access to an underlying causal graph comes with the promise of cause-effect estimation and the identification of efficient and safe interventions. However,…

Machine Learning · Computer Science 2023-11-10 Amir Mohammad Karimi Mamaghan , Andrea Dittadi , Stefan Bauer , Karl Henrik Johansson , Francesco Quinzan

Rule-based models, such as decision trees, appeal to practitioners due to their interpretable nature. However, the learning algorithms that produce such models are often vulnerable to spurious associations and thus, they are not guaranteed…

Machine Learning · Computer Science 2025-03-25 Thibaud Godon , Baptiste Bauvin , Pascal Germain , Jacques Corbeil , Alexandre Drouin

Discovering causal structures with latent variables from observational data is a fundamental challenge in causal discovery. Existing methods often rely on constraint-based, iterative discrete searches, limiting their scalability to large…

Machine Learning · Computer Science 2024-12-02 Parjanya Prashant , Ignavier Ng , Kun Zhang , Biwei Huang

Recent work has shown promising results in causal discovery by leveraging interventional data with gradient-based methods, even when the intervened variables are unknown. However, previous work assumes that the correspondence between…

Machine Learning · Computer Science 2022-07-12 Gonçalo R. A. Faria , André F. T. Martins , Mário A. T. Figueiredo

Due to spurious correlations, machine learning systems often fail to generalize to environments whose distributions differ from the ones used at training time. Prior work addressing this, either explicitly or implicitly, attempted to find a…

Machine Learning · Computer Science 2022-10-19 Chaochao Lu , Yuhuai Wu , Jośe Miguel Hernández-Lobato , Bernhard Schölkopf

Much of our experiments are designed to uncover the cause(s) and effect(s) behind a data generating mechanism (i.e., phenomenon) we happen to be interested in. Uncovering such relationships allows us to identify the true working of a…

Machine Learning · Computer Science 2023-07-11 M. Z. Naser

Self-supervised representation learning has shown remarkable success in a number of domains. A common practice is to perform data augmentation via hand-crafted transformations intended to leave the semantics of the data invariant. We seek…

A standard assumption for causal inference from observational data is that one has measured a sufficiently rich set of covariates to ensure that within covariate strata, subjects are exchangeable across observed treatment values. Skepticism…

Methodology · Statistics 2020-09-24 Eric J Tchetgen Tchetgen , Andrew Ying , Yifan Cui , Xu Shi , Wang Miao

Identifying the causal relations between interested variables plays a pivotal role in representation learning as it provides deep insights into the dataset. Identifiability, as the central theme of this approach, normally hinges on…

Machine Learning · Computer Science 2024-08-13 Boyang Sun , Ignavier Ng , Guangyi Chen , Yifan Shen , Qirong Ho , Kun Zhang

It has been observed that neural networks perform poorly when the data or tasks are presented sequentially. Unlike humans, neural networks suffer greatly from catastrophic forgetting, making it impossible to perform life-long learning. To…

Machine Learning · Computer Science 2023-01-31 Longhui Yu , Tianyang Hu , Lanqing Hong , Zhen Liu , Adrian Weller , Weiyang Liu

We consider the problem of function estimation in the case where an underlying causal model can be inferred. This has implications for popular scenarios such as covariate shift, concept drift, transfer learning and semi-supervised learning.…

Machine Learning · Computer Science 2012-07-03 Bernhard Schoelkopf , Dominik Janzing , Jonas Peters , Eleni Sgouritsa , Kun Zhang , Joris Mooij

Linear causal disentanglement is a recent method in causal representation learning to describe a collection of observed variables via latent variables with causal dependencies between them. It can be viewed as a generalization of both…

Machine Learning · Statistics 2024-07-08 Paula Leyes Carreno , Chiara Meroni , Anna Seigal

Linear causal models are important tools for modeling causal dependencies and yet in practice, only a subset of the variables can be observed. In this paper, we examine the parameter identifiability of these models by investigating whether…

Machine Learning · Computer Science 2025-02-11 Xinshuai Dong , Ignavier Ng , Biwei Huang , Yuewen Sun , Songyao Jin , Roberto Legaspi , Peter Spirtes , Kun Zhang

Prediction invariance of causal models under heterogeneous settings has been exploited by a number of recent methods for causal discovery, typically focussing on recovering the causal parents of a target variable of interest. Existing…

Methodology · Statistics 2026-03-10 Alice Polinelli , Veronica Vinciotti , Ernst C. Wit

We consider linear non-Gaussian structural equation models that involve latent confounding. In this setting, the causal structure is identifiable, but, in general, it is not possible to identify the specific causal effects. Instead, a…

Machine Learning · Statistics 2024-08-12 Daniela Schkoda , Elina Robeva , Mathias Drton

Current supervised learning can learn spurious correlation during the data-fitting process, imposing issues regarding interpretability, out-of-distribution (OOD) generalization, and robustness. To avoid spurious correlation, we propose a…

Machine Learning · Computer Science 2021-04-29 Xinwei Sun , Botong Wu , Xiangyu Zheng , Chang Liu , Wei Chen , Tao Qin , Tie-yan Liu

Drawbacks of ignoring the causal mechanisms when performing imitation learning have recently been acknowledged. Several approaches both to assess the feasibility of imitation and to circumvent causal confounding and causal misspecifications…

Machine Learning · Computer Science 2023-06-13 Fateme Jamshidi , Sina Akbari , Negar Kiyavash

Latent variable models provide a powerful framework for incorporating and inferring unobserved factors in observational data. In causal inference, they help account for hidden factors influencing treatment or outcome, thereby addressing…

Machine Learning · Computer Science 2025-08-29 Tetsuro Morimura , Tatsushi Oka , Yugo Suzuki , Daisuke Moriwaki