English
Related papers

Related papers: Regularization and confounding in linear regressio…

200 papers

Regularized models are often sensitive to the scales of the features in the data and it has therefore become standard practice to normalize (center and scale) the features before fitting the model. But there are many different ways to…

Machine Learning · Statistics 2025-07-04 Johan Larsson , Jonas Wallin

Reconstructing lens potentials and lensed sources can easily become an underconstrained problem, even when the degrees of freedom are low, due to degeneracies, particularly when potential perturbations superimposed on a smooth lens are…

Astrophysics of Galaxies · Physics 2022-07-27 Georgios Vernardos , Leon V. E. Koopmans

Covariate-adaptive randomization is widely used in clinical trials to balance prognostic factors, and regression adjustments are often adopted to further enhance the estimation and inference efficiency. In practice, the covariates may…

Methodology · Statistics 2025-08-15 Wanjia Fu , Yingying Ma , Hanzhong Liu

We study the problem of learning causal models from observational data through the lens of interpolation and its counterpart -- regularization. A large volume of recent theoretical, as well as empirical work, suggests that, in highly…

Machine Learning · Statistics 2022-02-21 Leena Chennuru Vankadara , Luca Rendsburg , Ulrike von Luxburg , Debarghya Ghoshdastidar

Applied researchers are increasingly interested in whether and how treatment effects vary in randomized evaluations, especially variation not explained by observed covariates. We propose a model-free approach for testing for the presence of…

Methodology · Statistics 2014-12-17 Peng Ding , Avi Feller , Luke Miratrix

Identifying effects of actions (treatments) on outcome variables from observational data and causal assumptions is a fundamental problem in causal inference. This identification is made difficult by the presence of confounders which can be…

Methodology · Statistics 2012-03-19 Ilya Shpitser , Tyler VanderWeele , James M. Robins

Inferring causal effects of continuous-valued treatments from observational data is a crucial task promising to better inform policy- and decision-makers. A critical assumption needed to identify these effects is that all confounding…

Regularization methods allow one to handle a variety of inferential problems where there are more covariates than cases. This allows one to consider a potentially enormous number of covariates for a problem. We exploit the power of these…

Methodology · Statistics 2012-10-03 Yoonkyung Lee , Steven N. MacEachern , Yoonsuh Jung

We consider the problem of estimating the expected causal effect $E[Y|do(X)]$ for a target variable $Y$ when treatment $X$ is set by intervention, focusing on continuous random variables. In settings without selection bias or confounding,…

Machine Learning · Statistics 2025-03-27 Marlies Hafer , Alexander Marx

Results in epidemiology and social science often require the removal of confounding effects from measurements of the pairwise correlation of variables in survey data. This is typically accomplished by some variant of linear regression…

Methodology · Statistics 2025-12-02 William H. Press

As statistical classifiers become integrated into real-world applications, it is important to consider not only their accuracy but also their robustness to changes in the data distribution. In this paper, we consider the case where there is…

Artificial Intelligence · Computer Science 2018-01-12 Virgile Landeiro , Aron Culotta

Unmeasured confounding presents a significant challenge in causal inference from observational studies. Classical approaches often rely on collecting proxy variables, such as instrumental variables. However, in applications where the…

Methodology · Statistics 2025-01-16 Xiaochuan Shi , Dehan Kong , Linbo Wang

Estimating causal effects in a target population with unmeasured confounders is challenging, especially when instrumental variables (IVs) are unavailable. However, IVs from auxiliary populations with similar problems can help infer causal…

Methodology · Statistics 2025-08-06 Wei Li , Jiapeng Liu , Peng Ding , Zhi Geng

The estimation of the treatment effect is often biased in the presence of unobserved confounding variables which are commonly referred to as hidden variables. Although a few methods have been recently proposed to handle the effect of hidden…

Methodology · Statistics 2022-08-01 Kevin Jiang , Yang Ning

Conditioning on some set of confounders that causally affect both treatment and outcome variables can be sufficient for eliminating bias introduced by all such confounders when estimating causal effect of the treatment on the outcome from…

Methodology · Statistics 2018-04-24 Priyantha Wijayatunga

Identification of treatment effects in the presence of unmeasured confounding is a persistent problem in the social, biological, and medical sciences. The problem of unmeasured confounding in settings with multiple treatments is most common…

Methodology · Statistics 2022-07-12 Wang Miao , Wenjie Hu , Elizabeth L. Ogburn , Xiaohua Zhou

Obtaining valid treatment effect inference remains a challenging problem when dealing with numerous instruments and non-sparse control variables. In this paper, we propose a novel ridge regularization-based instrumental variables method for…

Econometrics · Economics 2025-10-17 Xiduo Chen , Xingdong Feng , Antonio F. Galvao , Yeheng Ge

Objective: This paper investigates how generative models, trained on ground-truth images, can be used \changes{as} priors for inverse problems, penalizing reconstructions far from images the generator can produce. The aim is that learned…

Image and Video Processing · Electrical Eng. & Systems 2023-08-07 Margaret Duff , Ivor J. A. Simpson , Matthias J. Ehrhardt , Neill D. F. Campbell

Estimating causal effects from observational data is not always possible due to confounding. Identifying a set of appropriate covariates (adjustment set) and adjusting for their influence can remove confounding bias; however, such a set is…

Methodology · Statistics 2020-11-19 Sofia Triantafillou , Gregory Cooper

Although randomized controlled trials have long been regarded as the ``gold standard'' for evaluating treatment effects, there is no natural prevention from post-treatment events. For example, non-compliance makes the actual treatment…

Methodology · Statistics 2025-04-25 Qinqing Liu , Xiang Peng , Tao Zhang , Yuhao Deng