English
Related papers

Related papers: Regularization and confounding in linear regressio…

200 papers

Restricting randomization in the design of experiments (e.g., using blocking/stratification, pair-wise matching, or rerandomization) can improve the treatment-control balance on important covariates and therefore improve the estimation of…

Econometrics · Economics 2020-11-02 Brian Quistorff , Gentry Johnson

Standard regression adjustment gives inconsistent estimates of causal effects when there are time-varying treatment effects and time-varying covariates. Loosely speaking, the issue is that some covariates are post-treatment variables…

Methodology · Statistics 2024-03-12 Stephen Bates , Edward Kennedy , Robert Tibshirani , Valerie Ventura , Larry Wasserman

Meta-analysis is commonly used to combine results from multiple clinical trials, but traditional meta-analysis methods do not refer explicitly to a population of individuals to whom the results apply and it is not clear how to use their…

We study the problem of treatment effect estimation in randomized experiments with high-dimensional covariate information, and show that essentially any risk-consistent regression adjustment can be used to obtain efficient estimates of the…

Methodology · Statistics 2022-06-08 Stefan Wager , Wenfei Du , Jonathan Taylor , Robert Tibshirani

The presence of confounding by high-dimensional variables complicates estimation of the average effect of a point treatment. On the one hand, it necessitates the use of variable selection strategies or more general data-adaptive…

Methodology · Statistics 2017-08-15 Vahe Avagyan , Stijn Vansteelandt

In this paper, we address the issue of estimating and inferring distributional treatment effects in randomized experiments. The distributional treatment effect provides a more comprehensive understanding of treatment heterogeneity compared…

Econometrics · Economics 2025-01-15 Tatsushi Oka , Shota Yasui , Yuta Hayakawa , Undral Byambadalai

Statistical inferences for high-dimensional regression models have been extensively studied for their wide applications ranging from genomics, neuroscience, to economics. However, in practice, there are often potential unmeasured…

Methodology · Statistics 2023-09-12 Jing Ouyang , Kean Ming Tan , Gongjun Xu

Regularization-based approaches for injecting constraints in Machine Learning (ML) were introduced to improve a predictive model via expert knowledge. We tackle the issue of finding the right balance between the loss (the accuracy of the…

Machine Learning · Computer Science 2020-05-22 Michele Lombardi , Federico Baldo , Andrea Borghesi , Michela Milano

This article studies the estimation of the causal effect of a time-varying treatment on time-to-an-event or on some other continuously distributed outcome. The paper applies to the situation where treatment is repeatedly adapted to…

Statistics Theory · Mathematics 2008-06-19 Judith J. Lok

When engagement with a randomized trial is driven by factors that affect the outcome or when trial engagement directly affects the outcome independent of treatment, the average treatment effect among trial participants is unlikely to…

Explanation regularisation (ER) has been introduced as a way to guide text classifiers to form their predictions relying on input tokens that humans consider plausible. This is achieved by introducing an auxiliary explanation loss that…

Computation and Language · Computer Science 2025-02-06 Pedro Ferreira , Ivan Titov , Wilker Aziz

We study identifying and estimating the causal effect of a treatment variable on a long-term outcome using data from an observational and an experimental domain. The observational data are subject to unobserved confounding. Furthermore,…

Randomized trials balance all covariates on average and provide the gold standard for estimating treatment effects. Chance imbalances nevertheless exist more or less in realized treatment allocations and intrigue an important question: what…

Methodology · Statistics 2023-07-18 Anqi Zhao , Peng Ding

The large capacity of neural networks enables them to learn complex functions. To avoid overfitting, networks however require a lot of training data that can be expensive and time-consuming to collect. A common practical approach to…

Machine Learning · Computer Science 2020-03-10 Majed El Helou , Frederike Dümbgen , Sabine Süsstrunk

Understanding treatment effect heterogeneity has become increasingly important in many fields. In this paper we study distributions and quantiles of individual treatment effects to provide a more comprehensive and robust understanding of…

Methodology · Statistics 2026-03-31 Zhe Chen , Xinran Li

This paper investigates the problem of learning robust, generalizable prediction models from a combination of multiple datasets and qualitative assumptions about the underlying data-generating model. Part of the challenge of learning robust…

Machine Learning · Statistics 2022-02-04 Alexis Bellot , Mihaela van der Schaar

Mixed-effect models are very popular for analyzing data with a hierarchical structure, e.g. repeated observations within subjects in a longitudinal design, patients nested within centers in a multicenter design. However, recently, due to…

Methodology · Statistics 2019-05-09 Abhik Ghosh , Magne Thoresen

Recent work has made important contributions in the development of causally-interpretable meta-analysis. These methods transport treatment effects estimated in a collection of randomized trials to a target population of interest. Ideally,…

Methodology · Statistics 2023-02-08 Justin M. Clark , Kollin W. Rott , James S. Hodges , Jared D. Huling

Regularized regression models are well studied and, under appropriate conditions, offer fast and statistically interpretable results. However, large data in many applications are heterogeneous in the sense of harboring distributional…

Methodology · Statistics 2022-10-25 Konstantinos Perrakis , Thomas Lartigue , Frank Dondelinger , Sach Mukherjee

This article introduces a leave-one-out regression adjustment (LOORA) for estimating average treatment effects in randomized controlled trials. In finite samples, LOORA removes the bias of conventional regression adjustment and yields exact…

Econometrics · Economics 2026-05-08 Alberto Abadie , Mehrdad Ghadiri , Ali Jadbabaie , Mahyar JafariNodeh