English
Related papers

Related papers: Generalizing experimental findings: identification…

200 papers

Understanding causality should be a core requirement of any attempt to build real impact through AI. Due to the inherent unobservability of counterfactuals, large randomised trials (RCTs) are the standard for causal inference. But large…

Randomized controlled trials (RCTs) frequently utilize covariate-adaptive randomization (CAR) (e.g., stratified block randomization) and commonly suffer from imperfect compliance. This paper studies the identification and inference for the…

Econometrics · Economics 2025-05-02 Federico A. Bugni , Mengsi Gao , Filip Obradovic , Amilcar Velez

While randomised controlled trials (RCTs) are the gold standard for estimating causal treatment effects, their limited sample sizes and restrictive criteria make it difficult to extrapolate to a broader population. Observational data, while…

Methodology · Statistics 2025-09-09 Stephanie Riley , Ricardo Silva , Matthew Sperrin

Investigators are increasingly using novel methods for extending (generalizing or transporting) causal inferences from a trial to a target population. In many generalizability and transportability analyses, the trial and the observational…

Methodology · Statistics 2022-09-20 Yu-Han Chiu , Issa J. Dahabreh

When assessing causal effects, determining the target population to which the results are intended to generalize is a critical decision. Randomized and observational studies each have strengths and limitations for estimating causal effects…

Methodology · Statistics 2022-10-21 Irina Degtiar , Sherri Rose

Randomized experiments are an excellent tool for estimating internally valid causal effects with the sample at hand, but their external validity is frequently debated. While classical results on the estimation of Population Average…

Methodology · Statistics 2023-01-13 Apoorva Lal , Wenjing Zheng , Simon Ejdemyr

Randomized controlled trials (RCTs) are the gold standard for evaluating causal effects but are often costly and difficult to scale; consequently, they are frequently augmented with auxiliary external controls in many applications. Prior…

Methodology · Statistics 2026-05-28 Jiawei Shan , Yiteng Tu , Guanbo Wang , Chao Ying , Jiwei Zhao

Scientists frequently generalize population level causal quantities such as average treatment effect from a source population to a target population. When the causal effects are heterogeneous, differences in subject characteristics between…

Methodology · Statistics 2023-06-16 Rui Chen , Guanhua Chen , Menggang Yu

While many areas of machine learning have benefited from the increasing availability of large and varied datasets, the benefit to causal inference has been limited given the strong assumptions needed to ensure identifiability of causal…

Machine Learning · Computer Science 2022-01-02 Wenshuo Guo , Serena Wang , Peng Ding , Yixin Wang , Michael I. Jordan

Observational studies provide the only evidence on the effectiveness of interventions when randomized controlled trials (RCTs) are impractical due to cost, ethical concerns, or time constraints. While many methodologies aim to draw causal…

Randomized Controlled Trials (RCTs) may suffer from limited scope. In particular, samples may be unrepresentative: some RCTs over- or under- sample individuals with certain characteristics compared to the target population, for which one…

Methodology · Statistics 2024-03-15 Bénédicte Colnet , Julie Josse , Gaël Varoquaux , Erwan Scornet

Randomized controlled trials (RCTs) are widely regarded as the gold standard for causal inference in biomedical research. For instance, when estimating the average treatment effect on the treated (ATT), a doubly robust estimation procedure…

Methodology · Statistics 2025-09-26 Chi-Shian Dai , Chao Ying , Yang Ning , Jiwei Zhao

Practitioners in diverse fields such as healthcare, economics and education are eager to apply machine learning to improve decision making. The cost and impracticality of performing experiments and a recent monumental increase in electronic…

Machine Learning · Computer Science 2023-08-01 Fredrik D. Johansson , Uri Shalit , Nathan Kallus , David Sontag

Trial engagement effects are effects of trial participation on the outcome that are not mediated by treatment assignment. Most work on extending (generalizing or transporting) causal inferences from a randomized trial to a target population…

Methodology · Statistics 2024-07-23 Lawson Ung , Tyler J. VanderWeele , Issa J. Dahabreh

Randomized Controlled Trials (RCTs) are often considered the gold standard for estimating causal effect, but they may lack external validity when the population eligible to the RCT is substantially different from the target population.…

Methodology · Statistics 2023-01-11 Bénédicte Colnet , Julie Josse , Erwan Scornet , Gaël Varoquaux

Background: Randomized controlled trials are often used to inform policy and practice for broad populations. The average treatment effect (ATE) for a target population, however, may be different from the ATE observed in a trial if there are…

Despite their cost, randomized controlled trials (RCTs) are widely regarded as gold-standard evidence in disciplines ranging from social science to medicine. In recent decades, researchers have increasingly sought to reduce the resource…

Methodology · Statistics 2026-02-24 Guilherme Duarte

Identifying patient subgroups with different treatment responses is an important task to inform medical recommendations, guidelines, and the design of future clinical trials. Existing approaches for treatment effect estimation primarily…

Methodology · Statistics 2025-12-10 Vincent Jeanselme , Chang Ho Yoon , Fabian Falck , Brian Tom , Jessica Barrett

When treatment effect modifiers influence the decision to participate in a randomized trial, the average treatment effect in the population represented by the randomized individuals will differ from the effect in other populations. In this…

We extend Fisher's randomization test (FRT) to test conditional independence between observed outcomes and treatments given covariates in both randomized experiments and observational studies, with no restriction on the variable type of…

Methodology · Statistics 2025-06-12 Zhen Zhong