English
Related papers

Related papers: Recovering Latent Confounders from High-dimensiona…

200 papers

This paper introduces a novel sparse latent factor modeling framework using sparse asymptotic Principal Component Analysis (APCA) to analyze the co-movements of high-dimensional panel data over time. Unlike existing methods based on sparse…

Methodology · Statistics 2025-08-08 Zhaoxing Gao

Selecting powerful predictors for an outcome is a cornerstone task for machine learning. However, some types of questions can only be answered by identifying the predictors that causally affect the outcome. A recent approach to this causal…

Machine Learning · Computer Science 2022-03-01 Guillaume Martinet , Alexander Strzalkowski , Barbara E. Engelhardt

Estimating the individual treatment effect (ITE) from observational data is essential in medicine. A central challenge in estimating the ITE is handling confounders, which are factors that affect both an intervention and its outcome. Most…

Machine Learning · Computer Science 2018-11-28 Changhee Lee , Nicholas Mastronarde , Mihaela van der Schaar

Causal inference from observational data requires assumptions. These assumptions range from measuring confounders to identifying instruments. Traditionally, causal inference assumptions have focused on estimation of effects for a single…

Machine Learning · Statistics 2019-03-04 Rajesh Ranganath , Adler Perotte

We consider a causal effect that is confounded by an unobserved variable, but with observed proxy variables of the confounder. We show that, with at least two independent proxy variables satisfying a certain rank condition, the causal…

Methodology · Statistics 2018-06-29 Wang Miao , Zhi Geng , Eric Tchetgen Tchetgen

An important problem in causal inference is to break down the total effect of a treatment on an outcome into different causal pathways and to quantify the causal effect in each pathway. For instance, in causal fairness, the total effect of…

Machine Learning · Statistics 2022-01-10 Lu Cheng , Ruocheng Guo , Huan Liu

Nowadays, the need for causal discovery is ubiquitous. A better understanding of not just the stochastic dependencies between parts of a system, but also the actual cause-effect relations, is essential for all parts of science. Thus, the…

Machine Learning · Computer Science 2024-12-10 Boris Lorbeer , Mustafa Mohsen

Causal inference is difficult in the presence of unobserved confounders. We introduce the instrumented common confounding (ICC) approach to (nonparametrically) identify causal effects with instruments, which are exogenous only conditional…

Econometrics · Economics 2022-09-20 Christian Tien

Confounding variables are a recurrent challenge for causal discovery and inference. In many situations, complex causal mechanisms only manifest themselves in extreme events, or take simpler forms in the extremes. Stimulated by data on…

Methodology · Statistics 2024-11-14 Olivier C. Pasche , Valérie Chavez-Demoulin , Anthony C. Davison

This paper studies the principal components (PC) estimator for high dimensional approximate factor models with weak factors in that the factor loading ($\boldsymbol{\Lambda}^0$) scales sublinearly in the number $N$ of cross-section units,…

Econometrics · Economics 2024-02-12 Jungjun Choi , Ming Yuan

Panel data are widely used in political science to draw causal inferences. However, these models often rely on the strong and untested assumption of sequential ignorability--that no unmeasured variables influence both the independent and…

Methodology · Statistics 2026-02-17 Bang Quan Zheng

Estimating an individual's potential response to continuously varied treatments is crucial for addressing causal questions across diverse domains, from healthcare to social sciences. However, existing methods are limited either to…

Machine Learning · Computer Science 2024-10-22 Shutong Chen , Yang Li

Inferring causal relationships from observational data is rarely straightforward, but the problem is especially difficult in high dimensions. For these applications, causal discovery algorithms typically require parametric restrictions or…

Methodology · Statistics 2022-06-29 David S. Watson , Ricardo Silva

This paper introduces a Projected Principal Component Analysis (Projected-PCA), which employs principal component analysis to the projected (smoothed) data matrix onto a given linear space spanned by covariates. When it applies to…

Methodology · Statistics 2016-01-18 Jianqing Fan , Yuan Liao , Weichen Wang

Owing to the cross-pollination between causal discovery and deep learning, non-statistical data (e.g., images, text, etc.) encounters significant conflicts in terms of properties and methods with traditional causal data. To unify these data…

Machine Learning · Computer Science 2023-08-14 Hang Chen , Xinyu Yang , Qing Yang

Unobserved confounding is a fundamental obstacle to establishing valid causal conclusions from observational data. Two complementary types of approaches have been developed to address this obstacle: obtaining identification using fortuitous…

Methodology · Statistics 2023-06-27 Ilya Shpitser , Zach Wood-Doughty , Eric J. Tchetgen Tchetgen

Analysis of observational studies increasingly confronts the challenge of determining which of a possibly high-dimensional set of available covariates are required to satisfy the assumption of ignorable treatment assignment for estimation…

Methodology · Statistics 2022-03-23 Chanmin Kim , Mauricio Tec , Corwin M Zigler

Estimating counterfactual outcomes over time from observational data is relevant for many applications (e.g., personalized medicine). Yet, state-of-the-art methods build upon simple long short-term memory (LSTM) networks, thus rendering…

Machine Learning · Computer Science 2022-06-06 Valentyn Melnychuk , Dennis Frauen , Stefan Feuerriegel

Aggregate outcome variables collected through surveys and administrative records are often subject to systematic measurement error. For instance, in disaster loss databases, county-level losses reported may differ from the true damages due…

Machine Learning · Computer Science 2026-03-17 Saketh Vishnubhatla , Shu Wan , Andre Harrison , Adrienne Raglin , Huan Liu

Distinguishing causal connections from correlations is important in many scenarios. However, the presence of unobserved variables, such as the latent confounder, can introduce bias in conditional independence testing commonly employed in…

Methodology · Statistics 2024-05-03 Mingzhou Liu , Xinwei Sun , Yu Qiao , Yizhou Wang