English
Related papers

Related papers: Ultra-high Dimensional Variable Selection for Doub…

200 papers

Feature selection is an important but challenging task in causal inference for obtaining unbiased estimates of causal quantities. Properly selected features in causal inference not only significantly reduce the time required to implement a…

Methodology · Statistics 2025-02-04 Tianyu Yang , Md. Noor-E-Alam

Instrumental variables have been widely used to estimate the causal effect of a treatment on an outcome. Existing confidence intervals for causal effects based on instrumental variables assume that all of the putative instrumental variables…

Methodology · Statistics 2020-06-03 Hyunseung Kang , Youjin Lee , T. Tony Cai , Dylan S. Small

A ubiquitous feature of data of our era is their extra-large sizes and dimensions. Analyzing such high-dimensional data poses significant challenges, since the feature dimension is often much larger than the sample size. This thesis…

Statistics Theory · Mathematics 2025-09-11 Kai Yang

Unlike parametric regression, machine learning (ML) methods do not generally require precise knowledge of the true data generating mechanisms. As such, numerous authors have advocated for ML methods to estimate causal effects.…

Methodology · Statistics 2020-05-15 Ashley I Naimi , Alan E Mishler , Edward H Kennedy

Causal effect estimation has been studied by many researchers when only observational data is available. Sound and complete algorithms have been developed for pointwise estimation of identifiable causal queries. For non-identifiable causal…

Machine Learning · Statistics 2023-06-26 Ziwei Jiang , Lai Wei , Murat Kocaoglu

Detecting and measuring confounding effects from data is a key challenge in causal inference. Existing methods frequently assume causal sufficiency, disregarding the presence of unobserved confounding variables. Causal sufficiency is both…

Artificial Intelligence · Computer Science 2024-09-27 Abbavaram Gowtham Reddy , Vineeth N Balasubramanian

Structural breaks have been commonly seen in applications. Specifically for detection of change points in time, research gap still remains on the setting in ultra high dimension, where the covariates may bear spurious correlations. In this…

Methodology · Statistics 2021-06-10 Xin Liu , Liwen Zhang , Zhen Zhang

The emergence of large-scale pre-trained vision foundation models has greatly advanced the medical imaging field through the pre-training and fine-tuning paradigm. However, selecting appropriate medical data for downstream fine-tuning…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Anyang Ji , Qingbo Kang , Wei Xu , Changfan Wang , Kang Li , Qicheng Lao

Although understanding and characterizing causal effects have become essential in observational studies, it is challenging when the confounders are high-dimensional. In this article, we develop a general framework $\textit{CausalEGM}$ for…

Machine Learning · Statistics 2023-03-20 Qiao Liu , Zhongren Chen , Wing Hung Wong

Estimating average causal effect (ACE) is useful whenever we want to know the effect of an intervention on a given outcome. In the absence of a randomized experiment, many methods such as stratification and inverse propensity weighting have…

Machine Learning · Computer Science 2019-07-11 Rathin Desai , Amit Sharma

Text features that are correlated with class labels, but do not directly cause them, are sometimesuseful for prediction, but they may not be insightful. As an alternative to traditional correlation-basedfeature selection, causal inference…

Machine Learning · Computer Science 2020-10-12 Guohou Shan , James Foulds , Shimei Pan

Learning causal relationships between pairs of complex traits from observational studies is of great interest across various scientific domains. However, most existing methods assume the absence of unmeasured confounding and restrict causal…

Methodology · Statistics 2024-07-17 Wei Li , Rui Duan , Sai Li

The goal of recommendation is to show users items that they will like. Though usually framed as a prediction, the spirit of recommendation is to answer an interventional question---for each user and movie, what would the rating be if we…

Information Retrieval · Computer Science 2019-05-28 Yixin Wang , Dawen Liang , Laurent Charlin , David M. Blei

Causal inference explores the causation between actions and the consequent rewards on a covariate set. Recently deep learning has achieved a remarkable performance in causal inference, but existing statistical theories cannot well explain…

Machine Learning · Computer Science 2020-11-04 Minshuo Chen , Hao Liu , Wenjing Liao , Tuo Zhao

Estimating causal effects is vital for decision making. In standard causal effect estimation, treatments are usually binary- or continuous-valued. However, in many important real-world settings, treatments can be structured,…

Machine Learning · Statistics 2024-12-02 Oriol Corcoll Andreu , Athanasios Vlontzos , Michael O'Riordan , Ciaran M. Gilligan-Lee

Selective inference (post-selection inference) is a methodology that has attracted much attention in recent years in the fields of statistics and machine learning. Naive inference based on data that are also used for model selection tends…

Methodology · Statistics 2021-11-25 Yoshiyuki Ninomiya , Yuta Umezu , Ichiro Takeuchi

Unobserved confounding is a central barrier to drawing causal inferences from observational data. Several authors have recently proposed that this barrier can be overcome in the case where one attempts to infer the effects of several…

Machine Learning · Statistics 2019-03-20 Alexander D'Amour

It is important to draw causal inference from observational studies, which, however, becomes challenging if the confounders have missing values. Generally, causal effects are not identifiable if the confounders are missing not at random. We…

Methodology · Statistics 2019-02-04 Shu Yang , Linbo Wang , Peng Ding

Estimating effects of spatially structured exposures is complicated by unmeasured spatial confounders, which undermine identifiability in spatial linear regression models unless structural assumptions are imposed. We develop a general…

Methodology · Statistics 2025-12-30 Anik Burman , Elizabeth L. Ogburn , Abhirup Datta

Instrumental variable methods provide useful tools for inferring causal effects in the presence of unmeasured confounding. To apply these methods with large-scale data sets, a major challenge is to find valid instruments from a possibly…

Methodology · Statistics 2024-09-24 Xinyi Zhang , Linbo Wang , Stanislav Volgushev , Dehan Kong