English
Related papers

Related papers: Bayesian ICA for Causal Discovery

200 papers

Causal discovery is to learn cause-effect relationships among variables given observational data and is important for many applications. Existing causal discovery methods assume data sufficiency, which may not be the case in many real world…

Machine Learning · Computer Science 2022-06-20 Zijun Cui , Naiyu Yin , Yuru Wang , Qiang Ji

We present a new algorithm for Independent Component Analysis (ICA) which has provable performance guarantees. In particular, suppose we are given samples of the form $y = Ax + \eta$ where $A$ is an unknown $n \times n$ matrix and $x$ is a…

Machine Learning · Computer Science 2012-11-13 Sanjeev Arora , Rong Ge , Ankur Moitra , Sushant Sachdeva

Independent Component Analysis (ICA) uses a measure of non-Gaussianity to identify latent sources from data and estimate their mixing coefficients (Shimizu et al., 2006). Meanwhile, higher-order Orthogonal Machine Learning (OML) exploits…

Machine Learning · Statistics 2026-03-02 Patrik Reizinger , Lester Mackey , Wieland Brendel , Rahul Krishnan

We present a sound and complete algorithm, called iterative causal discovery (ICD), for recovering causal graphs in the presence of latent confounders and selection bias. ICD relies on the causal Markov and faithfulness assumptions and…

Machine Learning · Computer Science 2022-01-19 Raanan Y. Rohekar , Shami Nisimov , Yaniv Gurwicz , Gal Novik

We address the problem of distinguishing cause from effect in bivariate setting. Based on recent developments in nonlinear independent component analysis (ICA), we train nonparametrically general nonlinear causal models that allow…

Machine Learning · Statistics 2021-01-19 Pengzhou Wu , Kenji Fukumizu

We investigate the task of learning causal structure in the presence of latent variables, including locating latent variables and determining their quantity, and identifying causal relationships among both latent and observed variables. To…

Machine Learning · Computer Science 2024-06-11 Feng Xie , Biwei Huang , Zhengming Chen , Ruichu Cai , Clark Glymour , Zhi Geng , Kun Zhang

Independent Component Analysis (ICA) aims to recover independent latent variables from observed mixtures thereof. Causal Representation Learning (CRL) aims instead to infer causally related (thus often statistically dependent) latent…

Independent component analysis (ICA) is a fundamental statistical tool used to reveal hidden generative processes from observed data. However, traditional ICA approaches struggle with the rotational invariance inherent in Gaussian…

Machine Learning · Computer Science 2024-08-21 Ignavier Ng , Yujia Zheng , Xinshuai Dong , Kun Zhang

We generalize Shimizu et al's (2006) ICA-based approach for discovering linear non-Gaussian acyclic (LiNGAM) Structural Equation Models (SEMs) from causally sufficient, continuous-valued observational data. By relaxing the assumption that…

Artificial Intelligence · Computer Science 2012-06-18 Gustavo Lacerda , Peter L. Spirtes , Joseph Ramsey , Patrik O. Hoyer

Independent component analysis (ICA) decomposes multivariate data into mutually independent components (ICs). The ICA model is subject to a constraint that at most one of these components is Gaussian, which is required for model…

Methodology · Statistics 2018-05-18 Ze Jin , Benjamin B. Risk , David S. Matteson

Causal discovery with latent confounders is an important but challenging task in many scientific areas. Despite the success of some overcomplete independent component analysis (OICA) based methods in certain domains, they are…

Machine Learning · Computer Science 2023-06-01 Ruichu Cai , Zhiyi Huang , Wei Chen , Zhifeng Hao , Kun Zhang

The traditional two-stage approach to causal inference first identifies a single causal model (or equivalence class of models), which is then used to answer causal queries. However, this neglects any epistemic model uncertainty. In…

Machine Learning · Computer Science 2025-04-25 Christian Toth , Christian Knoll , Franz Pernkopf , Robert Peharz

Causal discovery is a difficult problem that typically relies on strong assumptions on the data-generating model, such as non-Gaussianity. In practice, many modern applications provide multiple related views of the same system, which has…

Machine Learning · Computer Science 2025-09-29 Ambroise Heurtebise , Omar Chehab , Pierre Ablin , Alexandre Gramfort , Aapo Hyvärinen

We address the problem of two-variable causal inference without intervention. This task is to infer an existing causal relation between two random variables, i.e. $X \rightarrow Y$ or $Y \rightarrow X$ , from purely observational data. As…

Machine Learning · Statistics 2020-01-07 Maximilian Kurthen , Torsten A. Enßlin

A fundamental problem of causal discovery is cause-effect inference, learning the correct causal direction between two random variables. Significant progress has been made through modelling the effect as a function of its cause and a noise…

Machine Learning · Computer Science 2023-10-27 Xiangyu Sun , Oliver Schulte

Reasoning based on causality, instead of association has been considered as a key ingredient towards real machine intelligence. However, it is a challenging task to infer causal relationship/structure among variables. In recent years, an…

Machine Learning · Computer Science 2019-09-15 Zhitang Chen , Shengyu Zhu , Yue Liu , Tim Tse

Learning causality from observational data has received increasing interest across various scientific fields. However, most existing methods assume the absence of latent confounders and restrict the underlying causal graph to be acyclic,…

Methodology · Statistics 2025-11-18 Wei Jin , Lang Lang , Amanda B. Spence , Leah H. Rubin , Yanxun Xu

Causal knowledge is vital for effective reasoning in science, as causal relations, unlike correlations, allow one to reason about the outcomes of interventions. Algorithms that can discover causal relations from observational data are based…

Machine Learning · Statistics 2019-11-12 Anish Dhir , Ciarán M. Lee

Causal discovery methods seek to identify causal relations between random variables from purely observational data, as opposed to actively collected experimental data where an experimenter intervenes on a subset of correlates. One of the…

Machine Learning · Computer Science 2021-02-08 Samir Wadhwa , Roy Dong

Nonlinear independent component analysis (ICA) aims to recover the underlying independent latent sources from their observable nonlinear mixtures. How to make the nonlinear ICA model identifiable up to certain trivial indeterminacies is a…

Machine Learning · Computer Science 2024-02-27 Yujia Zheng , Ignavier Ng , Kun Zhang