English
Related papers

Related papers: Linear Causal Disentanglement via Interventions

200 papers

Linear structural causal models (SCMs) -- in which each observed variable is generated by a subset of the other observed variables as well as a subset of the exogenous sources -- are pervasive in causal inference and casual discovery.…

Machine Learning · Computer Science 2022-11-09 Yuqin Yang , Mohamed Nafea , AmirEmad Ghassami , Negar Kiyavash

We propose a framework to analyze how multivariate representations disentangle ground-truth generative factors. A quantitative analysis of disentanglement has been based on metrics designed to compare how one variable explains each…

Machine Learning · Statistics 2022-02-11 Seiya Tokui , Issei Sato

Disentangled representations, where the higher level data generative factors are reflected in disjoint latent dimensions, offer several benefits such as ease of deriving invariant representations, transferability to other tasks,…

Machine Learning · Computer Science 2018-12-31 Abhishek Kumar , Prasanna Sattigeri , Avinash Balakrishnan

Latent traversal is a popular approach to visualize the disentangled latent representations. Given a bunch of variations in a single unit of the latent representation, it is expected that there is a change in a single factor of variation of…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Xinqi Zhu , Chang Xu , Dacheng Tao

Observed associations in a database may be due in whole or part to variations in unrecorded (latent) variables. Identifying such variables and their causal relationships with one another is a principal goal in many scientific and practical…

Machine Learning · Computer Science 2012-12-12 Ricardo Silva , Richard Scheines , Clark Glymour , Peter L. Spirtes

Causal representation learning has showed a variety of settings in which we can disentangle latent variables with identifiability guarantees (up to some reasonable equivalence class). Common to all of these approaches is the assumption that…

Machine Learning · Computer Science 2023-10-31 Amin Mansouri , Jason Hartford , Yan Zhang , Yoshua Bengio

Identifying the underlying time-delayed latent causal processes in sequential data is vital for grasping temporal dynamics and making downstream reasoning. While some recent methods can robustly identify these latent causal variables, they…

Machine Learning · Computer Science 2024-05-31 Guangyi Chen , Yifan Shen , Zhenhao Chen , Xiangchen Song , Yuewen Sun , Weiran Yao , Xiao Liu , Kun Zhang

Generalizations of Bell's framework to causal networks have yielded new foundational insights and applications, including the use of interventions to enhance the detection of nonclassicality in scenarios with communication. Such…

Quantum Physics · Physics 2026-01-13 Santiago Zamora , Pedro Lauand , Isadora Veeren , Davide Poderini , Rafael Chaves

In designing generative models, it is commonly believed that in order to learn useful latent structure, we face a fundamental tension between expressivity and structure. In this paper we challenge this view by proposing a new approach to…

Machine Learning · Statistics 2026-04-03 Alex Markham , Isaac Hirsch , Jeri A. Chang , Liam Solus , Bryon Aragam

In many problems, the measured variables (e.g., image pixels) are just mathematical functions of the latent causal variables (e.g., the underlying concepts or objects). For the purpose of making predictions in changing environments or…

Machine Learning · Computer Science 2024-08-13 Kun Zhang , Shaoan Xie , Ignavier Ng , Yujia Zheng

Faithful evaluation of language model capabilities is crucial for deriving actionable insights that can inform model development. However, rigorous causal evaluations in this domain face significant methodological challenges, including…

Machine Learning · Computer Science 2025-06-13 Jikai Jin , Vasilis Syrgkanis , Sham Kakade , Hanlin Zhang

Much of scientific data is collected as randomized experiments intervening on some and observing other variables of interest. Quite often, a given phenomenon is investigated in several studies, and different sets of variables are involved…

Methodology · Statistics 2012-10-19 Antti Hyttinen , Frederick Eberhardt , Patrik O. Hoyer

Causal disentanglement from soft interventions is identifiable under the assumptions of linear interventional faithfulness and availability of both observational and interventional data. Previous research has looked into this problem from…

Machine Learning · Computer Science 2025-09-03 Jifan Zhang , Michelle M. Li , Elena Zheleva

In causal models, a given mechanism is assumed to be invariant to changes of other mechanisms. While this principle has been utilized for inference in settings where the causal variables are observed, theoretical insights when the variables…

Machine Learning · Statistics 2023-12-07 Simon Bing , Jonas Wahl , Urmi Ninad , Jakob Runge

In many real-world scenarios, such as gene knockout experiments, targeted interventions are often accompanied by unknown interventions at off-target sites. Moreover, different units can get randomly exposed to different unknown…

Machine Learning · Statistics 2022-10-10 Abhinav Kumar , Gaurav Sinha

Identifying variables responsible for changes to a biological system enables applications in drug target discovery and cell engineering. Given a pair of observational and interventional datasets, the goal is to isolate the subset of…

Machine Learning · Computer Science 2025-06-02 Menghua Wu , Umesh Padia , Sean H. Murphy , Regina Barzilay , Tommi Jaakkola

Most causal discovery algorithms find causal structure among a set of observed variables. Learning the causal structure among latent variables remains an important open problem, particularly when using high-dimensional data. In this paper,…

Machine Learning · Computer Science 2020-09-09 Jonathan D. Young , Bryan Andrews , Gregory F. Cooper , Xinghua Lu

We develop a criterion to certify whether causal effects are identifiable in linear structural equation models with latent variables. Linear structural equation models correspond to directed graphs whose nodes represent the random variables…

Statistics Theory · Mathematics 2025-07-25 Nils Sturma , Mathias Drton

By adhering to the dictum, "No causation without manipulation (treatment, intervention)", cause and effect data analysis represents changes in observed data in terms of changes in the causal factors. When causal factors are not amenable for…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 M. Alex O. Vasilescu , Eric Kim , Xiao S. Zeng

Deep latent-variable models learn representations of high-dimensional data in an unsupervised manner. A number of recent efforts have focused on learning representations that disentangle statistically independent axes of variation by…