English
Related papers

Related papers: Benchmarking Estimators for Natural Experiments: A…

200 papers

Evaluating the performance of an ongoing policy plays a vital role in many areas such as medicine and economics, to provide crucial instructions on the early-stop of the online experiment and timely feedback from the environment. Policy…

Machine Learning · Statistics 2024-08-05 Ye Shen , Hengrui Cai , Rui Song

Training large-scale mixture of experts models efficiently on modern hardware requires assigning datapoints in a batch to different experts, each with a limited capacity. Recently proposed assignment procedures lack a probabilistic…

Machine Learning · Computer Science 2021-12-09 Wouter Kool , Chris J. Maddison , Andriy Mnih

Suppose we are interested in the mean of an outcome variable missing not at random. Suppose however that one has available a fully observed shadow variable, which is associated with the outcome but independent of the missingness process…

Statistics Theory · Mathematics 2016-01-26 Wang Miao , Eric Tchetgen Tchetgen

Investigators often use multi-source data (e.g., multi-center trials, meta-analyses of randomized trials, pooled analyses of observational cohorts) to learn about the effects of interventions in subgroups of some well-defined target…

Methodology · Statistics 2024-02-06 Guanbo Wang , Alexander Levis , Jon Steingrimsson , Issa Dahabreh

Externally controlled single-arm trials are critical to assess treatment efficacy across therapeutic indications for which randomized controlled trials are not feasible. A closely-related research design, the unanchored indirect treatment…

Methodology · Statistics 2026-02-13 Harlan Campbell , Antonio Remiro-Azócar

Consider sensitivity analysis for estimating average treatment effects under unmeasured confounding, assumed to satisfy a marginal sensitivity model. At the population level, we provide new representations for the sharp population bounds…

Methodology · Statistics 2022-09-26 Zhiqiang Tan

Instrumental variable approaches have gained popularity for estimating causal effects in the presence of unmeasured confounders. However, the availability of instrumental variables in the primary dataset is often challenged due to stringent…

Methodology · Statistics 2026-03-31 Kang Shuai , Shanshan Luo , Wei Li , Yangbo He

We provide a principled way for investigators to analyze randomized experiments when the number of covariates is large. Investigators often use linear multivariate regression to analyze randomized experiments instead of simply reporting the…

Statistics Theory · Mathematics 2022-06-08 Adam Bloniarz , Hanzhong Liu , Cun-Hui Zhang , Jasjeet Sekhon , Bin Yu

Estimating causal effects for survival outcomes in the high-dimensional setting is an extremely important topic for many biomedical applications as well as areas of social sciences. We propose a new orthogonal score method for treatment…

Methodology · Statistics 2024-12-04 Jue Hou , Jelena Bradic , Ronghui Xu

Many research questions involve time-to-event outcomes that can be prevented from occurring due to competing events. In these settings, we must be careful about the causal interpretation of classical statistical estimands. In particular,…

Methodology · Statistics 2020-09-01 Torben Martinussen , Mats Julius Stensrud

Indirect experiments provide a valuable framework for estimating treatment effects in situations where conducting randomized control trials (RCTs) is impractical or unethical. Unlike RCTs, indirect experiments estimate treatment effects by…

Machine Learning · Computer Science 2023-12-06 Yash Chandak , Shiv Shankar , Vasilis Syrgkanis , Emma Brunskill

Transported mediation effects may contribute to understanding how and why interventions may work differently when applied to new populations. However, we are not aware of any estimators for such effects. Thus, we propose several different…

Methodology · Statistics 2020-06-16 Kara E Rudolph , Jonathan Levy , Mark J van der Laan

Statistical and structural modeling represent two distinct approaches to data analysis. In this paper, we propose a set of novel methods for combining statistical and structural models for improved prediction and causal inference. Our first…

Econometrics · Economics 2020-06-11 Jiaming Mao , Jingzhi Xu

Several recently developed methods have the potential to harness machine learning in the pursuit of target quantities inspired by causal inference, including inverse weighting, doubly robust estimating equations and substitution estimators…

Randomized controlled trials are a cornerstone of medicine and the social sciences as they enable reliable estimates of causal effects. However, they are costly and time-consuming to conduct, motivating interest in predicting causal effects…

Developing large language models is expensive and involves making decisions with small experiments, typically by evaluating on large, multi-task evaluation suites. In this work, we analyze specific properties which make a benchmark more…

Computation and Language · Computer Science 2025-08-19 David Heineman , Valentin Hofmann , Ian Magnusson , Yuling Gu , Noah A. Smith , Hannaneh Hajishirzi , Kyle Lo , Jesse Dodge

Studies in environmental and epidemiological sciences are often spatially varying and observational in nature with the aim of establishing cause and effect relationships. One of the major challenges with such studies is the presence of…

Methodology · Statistics 2023-05-16 Sayli Pokal , Yawen Guan , Honglang Wang , Yuzhen Zhou

Causal mediation analysis can improve understanding of the mechanisms underlying epidemiologic associations. However, the utility of natural direct and indirect effect estimation has been limited by the assumption of no confounder of the…

Applications · Statistics 2020-06-16 Kara E. Rudolph , Oleg Sofrygin , Wenjing Zheng , Mark J. van der Laan

In observational studies, covariates with substantial missing data are often omitted, despite their strong predictive capabilities. These excluded covariates are generally believed not to simultaneously affect both treatment and outcome,…

Methodology · Statistics 2024-02-23 Shanshan Luo , Mengchen Shi , Wei Li , Xueli Wang , Zhi Geng

In precision medicine, one of the most important problems is estimating the optimal individualized treatment rules (ITR), which typically involves recommending treatment decisions based on fully observed individual characteristics of…

Methodology · Statistics 2025-10-15 Yue Zhang , Shanshan Luo , Zhi Geng , Yangbo He