English
Related papers

Related papers: Learning Linear Causal Representations from Interv…

200 papers

Finding the parameters of a latent variable causal model is central to causal inference and causal identification. In this article, we show that existing graphical structures that are used in causal inference are not stable under…

Machine Learning · Statistics 2025-10-03 Mehrzad Saremi

One critical challenge of time-series modeling is how to learn and quickly correct the model under unknown distribution shifts. In this work, we propose a principled framework, called LiLY, to first recover time-delayed latent causal…

Machine Learning · Statistics 2022-02-25 Weiran Yao , Guangyi Chen , Kun Zhang

We propose a simple method to learn linear causal cyclic models in the presence of latent variables. The method relies on equilibrium data of the model recorded under a specific kind of interventions ("shift interventions"). The location…

Methodology · Statistics 2016-01-11 Dominik Rothenhäusler , Christina Heinze , Jonas Peters , Nicolai Meinshausen

The theory of representation learning aims to build methods that provably invert the data generating process with minimal domain knowledge or any source of supervision. Most prior approaches require strong distributional assumptions on the…

Machine Learning · Computer Science 2022-06-03 Kartik Ahuja , Jason Hartford , Yoshua Bengio

We study optimal covariate balance for causal inferences from observational data when rich covariates and complex relationships necessitate flexible modeling with neural networks. Standard approaches such as propensity weighting and…

Machine Learning · Statistics 2018-02-16 Nathan Kallus

Graphical models can represent a multivariate distribution in a convenient and accessible form as a graph. Causal models can be viewed as a special class of graphical models that not only represent the distribution of the observed system…

Methodology · Statistics 2017-06-29 Christina Heinze-Deml , Marloes H. Maathuis , Nicolai Meinshausen

Our goal is to recover time-delayed latent causal variables and identify their relations from measured temporal data. Estimating causally-related latent variables from observations is particularly challenging as the latent variables are not…

Machine Learning · Statistics 2022-02-10 Weiran Yao , Yuewen Sun , Alex Ho , Changyin Sun , Kun Zhang

We study causal effect estimation from a mixture of observational and interventional data in a confounded linear regression model with multivariate treatments. We show that the statistical efficiency in terms of expected squared error can…

Analyzing neural network dynamics via stochastic gradient descent (SGD) is crucial to building theoretical foundations for deep learning. Previous work has analyzed structured inputs within the \textit{hidden manifold model}, often under…

Machine Learning · Statistics 2025-12-01 Jaeyong Bae , Hawoong Jeong

We propose to learn latent graphical models when data have mixed variables and missing values. This model could be used for further data analysis, including regression, classification, ranking etc. It also could be used for imputing missing…

Methodology · Statistics 2015-11-17 Xiao Li , Jinzhu Jia , Yuan Yao

We address the problem of estimating causal effects from observational data in the presence of network confounding, a setting where both treatment assignment and observed outcomes of individuals may be influenced by their neighbors within a…

Machine Learning · Computer Science 2026-03-24 Abhishek Dalvi , Neil Ashtekar , Vasant Honavar

Causal inference from observational data plays critical role in many applications in trustworthy machine learning. While sound and complete algorithms exist to compute causal effects, many of them assume access to conditional likelihoods,…

Machine Learning · Computer Science 2024-11-04 Md Musfiqur Rahman , Matt Jordan , Murat Kocaoglu

Accuracy and generalization capabilities are key objectives when learning dynamical system models. To obtain such models from limited data, current works exploit prior knowledge and assumptions about the system. However, the fusion of…

Machine Learning · Statistics 2025-08-22 Björn Volkmann , Jan-Hendrik Ewering , Michael Meindl , Simon F. G. Ehlers , Thomas Seel

As machine learning systems get widely adopted for high-stake decisions, quantifying uncertainty over predictions becomes crucial. While modern neural networks are making remarkable gains in terms of predictive accuracy, characterizing…

Machine Learning · Computer Science 2019-06-14 Melanie F. Pradier , Weiwei Pan , Jiayu Yao , Soumya Ghosh , Finale Doshi-velez

Fisher's linear discriminant analysis is a classical method for classification, yet it is limited to capturing linear features only. Kernel discriminant analysis as an extension is known to successfully alleviate the limitation through a…

Machine Learning · Statistics 2022-07-29 Jiae Kim , Yoonkyung Lee , Zhiyu Liang

Representation learning of textual networks poses a significant challenge as it involves capturing amalgamated information from two modalities: (i) underlying network structure, and (ii) node textual attributes. For this, most existing…

Computation and Language · Computer Science 2020-11-06 Tony Gracious , Ambedkar Dukkipati

Standard imitation learning can fail when the expert demonstrators have different sensory inputs than the imitating agent. This is because partial observability gives rise to hidden confounders in the causal graph. In previous work, to work…

Machine Learning · Computer Science 2024-08-27 Risto Vuorio , Pim de Haan , Johann Brehmer , Hanno Ackermann , Daniel Dijkman , Taco Cohen

Estimating causal treatment effects in observational settings is frequently compromised by selection bias arising from unobserved confounders. While traditional econometric methods struggle when these confounders are orthogonal to…

Artificial Intelligence · Computer Science 2026-01-06 Ahmed Dawoud , Osama El-Shamy

In this paper we present a fully Bayesian latent variable model which exploits conditional nonlinear(in)-dependence structures to learn an efficient latent representation. The latent space is factorized to represent shared and private…

Machine Learning · Computer Science 2012-06-22 Andreas Damianou , Carl Ek , Michalis Titsias , Neil Lawrence

We develop a criterion to certify whether causal effects are identifiable in linear structural equation models with latent variables. Linear structural equation models correspond to directed graphs whose nodes represent the random variables…

Statistics Theory · Mathematics 2025-07-25 Nils Sturma , Mathias Drton