English
Related papers

Related papers: A Partial Initialization Strategy to Mitigate the …

200 papers

This paper develops a performant Bayesian approach to conditional average treatment effect (CATE) estimation in regression discontinuity designs (RDD), an increasingly prevalent form of quasi-experiment that facilitates causal inference.…

Methodology · Statistics 2026-05-18 Rafael Alcantara , P. Richard Hahn , Hedibert F. Lopes

Foundation models based on prior-data fitted networks (PFNs) have shown strong empirical performance in causal inference by framing the task as an in-context learning problem.However, it is unclear whether PFN-based causal estimators…

Machine Learning · Computer Science 2026-03-13 Valentyn Melnychuk , Vahid Balazadeh , Stefan Feuerriegel , Rahul G. Krishnan

This paper studies inference in two-stage randomized experiments under covariate-adaptive randomization. In the initial stage of this experimental design, clusters (e.g., households, schools, or graph partitions) are stratified and randomly…

Econometrics · Economics 2026-01-16 Jizhou Liu

High complexity models are notorious in machine learning for overfitting, a phenomenon in which models well represent data but fail to generalize an underlying data generating process. A typical procedure for circumventing overfitting…

Machine Learning · Statistics 2025-03-11 James Schmidt

We regularly consider answering counterfactual questions in practice, such as "Would people with diabetes take a turn for the better had they choose another medication?". Observational studies are growing in significance in answering such…

Machine Learning · Computer Science 2022-08-16 Guanglin Zhou , Lina Yao , Xiwei Xu , Chen Wang , Liming Zhu

There is growing interest in estimating and analyzing heterogeneous treatment effects in experimental and observational studies. We describe a number of meta-algorithms that can take advantage of any supervised learning or regression method…

Statistics Theory · Mathematics 2019-06-18 Sören R. Künzel , Jasjeet S. Sekhon , Peter J. Bickel , Bin Yu

We argue that randomized controlled trials (RCTs) are special even among settings where average treatment effects are identified by a nonparametric unconfoundedness assumption. This claim follows from two results of Robins and Ritov (1997):…

Methodology · Statistics 2021-09-28 P. M. Aronow , James M. Robins , Theo Saarinen , Fredrik Sävje , Jasjeet Sekhon

Individual Treatment Effects (ITE) estimation methods have risen in popularity in the last years. Most of the time, individual effects are better presented as Conditional Average Treatment Effects (CATE). Recently, representation balancing…

Machine Learning · Statistics 2022-03-30 Ayoub Abraich , Agathe Guilloux , Blaise Hanczar

Recent progress in motion forecasting has been substantially driven by self-supervised pre-training. However, adapting pre-trained models for specific downstream tasks, especially motion prediction, through extensive fine-tuning is often…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Jifeng Wang , Kaouther Messaoud , Yuejiang Liu , Juergen Gall , Alexandre Alahi

Covariate adjustment is an approach to improve the precision of trial analyses by adjusting for baseline variables that are prognostic of the primary endpoint. Motivated by the SEARCH Universal HIV Test-and-Treat Trial (2013-2017), we tell…

Methodology · Statistics 2025-12-16 Laura B. Balzer , Mark J. van der Laan , Maya L. Petersen

When estimating heterogeneous treatment effects, missing outcome data can complicate treatment effect estimation, causing certain subgroups of the population to be poorly represented. In this work, we discuss this commonly overlooked…

Machine Learning · Statistics 2025-04-15 Matthew Pryce , Karla Diaz-Ordaz , Ruth H. Keogh , Stijn Vansteelandt

Causal inference is a critical research area with multi-disciplinary origins and applications, ranging from statistics, computer science, economics, psychology to public health. In many scientific research, randomized experiments provide a…

Methodology · Statistics 2022-07-26 Jingying Zeng

Many applications of causal inference require using treatment effects estimated on a study population to make decisions in a separate target population. We consider the challenging setting where there are covariates that are observed in the…

Machine Learning · Computer Science 2024-10-22 Khurram Yamin , Vibhhu Sharma , Ed Kennedy , Bryan Wilder

Accurately estimating treatment effects over time is crucial in fields such as precision medicine, epidemiology, economics, and marketing. Many current methods for estimating treatment effects over time assume that all confounders are…

Machine Learning · Statistics 2025-11-11 Mouad El Bouchattaoui , Myriam Tami , Benoit Lepetit , Paul-Henry Cournède

We study a practical setting of continual learning: fine-tuning on a pre-trained model continually. Previous work has found that, when training on new tasks, the features (penultimate layer representations) of previous data will change,…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Shibo Jie , Zhi-Hong Deng , Ziheng Li

The Average Treatment Effect (ATE) is a global measure of the effectiveness of an experimental treatment intervention. Classical methods of its estimation either ignore relevant covariates or do not fully exploit them. Moreover, past work…

Methodology · Statistics 2013-11-05 Emil Pitkin , Richard Berk , Lawrence Brown , Andreas Buja , Ed George , Kai Zhang , Linda Zhao

We propose nonparametric identification and semiparametric estimation of joint potential outcome distributions in the presence of confounding. First, in settings with observed confounding, we derive tighter, covariate-informed bounds on the…

Methodology · Statistics 2026-02-19 Jianle Sun , Kun Zhang

Causal inference from observational datasets often relies on measuring and adjusting for covariates. In practice, measurements of the covariates can often be noisy and/or biased, or only measurements of their proxies may be available.…

Machine Learning · Computer Science 2022-02-23 Wenshuo Guo , Mingzhang Yin , Yixin Wang , Michael I. Jordan

Continual post-training (CPT) is a popular and effective technique for adapting foundation models like multimodal large language models to specific and ever-evolving downstream tasks. While existing research has primarily concentrated on…

Machine Learning · Computer Science 2026-01-22 Song Lai , Haohan Zhao , Rong Feng , Changyi Ma , Wenzhuo Liu , Hongbo Zhao , Xi Lin , Dong Yi , Qingfu Zhang , Hongbin Liu , Gaofeng Meng , Fei Zhu

We study a class of prediction problems in which relatively few observations have associated responses, but all observations include both standard covariates as well as additional "helper" covariates. While the end goal is to make…

Statistics Theory · Mathematics 2024-12-13 Eric Xia , Martin J. Wainwright