English
Related papers

Related papers: Latent confounding in high-dimensional nonlinear m…

200 papers

Causal variable selection in time-varying treatment settings is challenging due to evolving confounding effects. Existing methods mainly focus on time-fixed exposures and are not directly applicable to time-varying scenarios. We propose a…

Estimating causal effects is vital for decision making. In standard causal effect estimation, treatments are usually binary- or continuous-valued. However, in many important real-world settings, treatments can be structured,…

Machine Learning · Statistics 2024-12-02 Oriol Corcoll Andreu , Athanasios Vlontzos , Michael O'Riordan , Ciaran M. Gilligan-Lee

Detecting and measuring confounding effects from data is a key challenge in causal inference. Existing methods frequently assume causal sufficiency, disregarding the presence of unobserved confounding variables. Causal sufficiency is both…

Artificial Intelligence · Computer Science 2024-09-27 Abbavaram Gowtham Reddy , Vineeth N Balasubramanian

Controlled Direct Effect (CDE) is one of the causal estimands used to evaluate both exposure and mediation effects on an outcome. When there are unmeasured confounders existing between the mediator and the outcome, the ordinary…

Methodology · Statistics 2024-10-30 Shunichiro Orihara , Shinpei Imori , Kosuke Morikawa , Atsushi Goto , Masataka Taguri

Confounding can lead to spurious associations. Typically, one must observe confounders in order to adjust for them, but in high-dimensional settings, recent research has shown that it becomes possible to adjust even for unobserved…

Methodology · Statistics 2025-10-07 Yujing Lu , Patrick Breheny

Regression on observational data can fail to capture a causal relationship in the presence of unobserved confounding. Confounding strength measures this mismatch, but estimating it requires itself additional assumptions. A common assumption…

Machine Learning · Statistics 2022-11-04 Luca Rendsburg , Leena Chennuru Vankadara , Debarghya Ghoshdastidar , Ulrike von Luxburg

This paper combines causal mediation analysis with double machine learning to control for observed confounders in a data-driven way under a selection-on-observables assumption in a high-dimensional setting. We consider the average indirect…

Econometrics · Economics 2021-02-17 Helmut Farbmacher , Martin Huber , Lukáš Lafférs , Henrika Langen , Martin Spindler

Standard regression adjustment gives inconsistent estimates of causal effects when there are time-varying treatment effects and time-varying covariates. Loosely speaking, the issue is that some covariates are post-treatment variables…

Methodology · Statistics 2024-03-12 Stephen Bates , Edward Kennedy , Robert Tibshirani , Valerie Ventura , Larry Wasserman

Valid causal inference in observational studies often requires controlling for confounders. However, in practice measurements of confounders may be noisy, and can lead to biased estimates of causal effects. We show that we can reduce the…

Machine Learning · Statistics 2018-06-05 Nathan Kallus , Xiaojie Mao , Madeleine Udell

High-dimensional covariates often admit linear factor structure. To effectively screen correlated covariates in high-dimension, we propose a conditional variable screening test based on non-parametric regression using neural networks due to…

Econometrics · Economics 2024-08-21 Jianqing Fan , Weining Wang , Yue Zhao

Estimating long-term causal effects based on short-term surrogates is a significant but challenging problem in many real-world applications, e.g., marketing and medicine. Despite its success in certain domains, most existing methods…

Machine Learning · Computer Science 2023-11-22 Ruichu Cai , Weilin Chen , Zeqin Yang , Shu Wan , Chen Zheng , Xiaoqing Yang , Jiecheng Guo

Long-term causal inference has drawn increasing attention in many scientific domains. Existing methods mainly focus on estimating average long-term causal effects by combining long-term observational data and short-term experimental data.…

Machine Learning · Computer Science 2025-03-04 Weilin Chen , Ruichu Cai , Junjie Wan , Zeqin Yang , José Miguel Hernández-Lobato

Causal inference from observational data often assumes "ignorability," that all confounders are observed. This assumption is standard yet untestable. However, many scientific studies involve multiple causes, different variables whose…

Machine Learning · Statistics 2019-04-16 Yixin Wang , David M. Blei

We consider linear models where $d$ potential causes $X_1,...,X_d$ are correlated with one target quantity $Y$ and propose a method to infer whether the association is causal or whether it is an artifact caused by overfitting or hidden…

Machine Learning · Statistics 2018-03-05 Dominik Janzing , Bernhard Schoelkopf

Observational studies of causal effects require adjustment for confounding factors. In the tabular setting, where these factors are well-defined, separate random variables, the effect of confounding is well understood. However, in public…

Machine Learning · Computer Science 2023-02-16 Connor T. Jerzak , Fredrik Johansson , Adel Daoud

The era of big data has witnessed an increasing availability of multiple data sources for statistical analyses. We consider estimation of causal effects combining big main data with unmeasured confounders and smaller validation data with…

Methodology · Statistics 2021-08-24 Shu Yang , Peng Ding

In causal inference about two treatments, Conditional Average Treatment Effects (CATEs) play an important role as a quantity representing an individualized causal effect, defined as a difference between the expected outcomes of the two…

Econometrics · Economics 2023-10-26 Masahiro Kato , Masaaki Imaizumi

We consider a high-dimensional linear regression problem. Unlike many papers on the topic, we do not require sparsity of the regression coefficients; instead, our main structural assumption is a decay of eigenvalues of the covariance matrix…

Statistics Theory · Mathematics 2021-10-01 Igor Silin , Jianqing Fan

Owing to the cross-pollination between causal discovery and deep learning, non-statistical data (e.g., images, text, etc.) encounters significant conflicts in terms of properties and methods with traditional causal data. To unify these data…

Machine Learning · Computer Science 2023-08-14 Hang Chen , Xinyu Yang , Qing Yang

There is growing interest in extending average treatment effect (ATE) estimation to incorporate non-tabular data, such as images and text, which may act as sources of confounding. Neglecting these effects risks biased results and flawed…

Machine Learning · Statistics 2025-10-23 Rickmer Schulte , David Rügamer , Thomas Nagler