English
Related papers

Related papers: Variance reduction combining pre-experiment and in…

200 papers

We propose a novel regression adjustment method designed for estimating distributional treatment effect parameters in randomized experiments. Randomized experiments have been extensively used to estimate treatment effects in various…

Econometrics · Economics 2024-07-24 Undral Byambadalai , Tatsushi Oka , Shota Yasui

Random-effects models are frequently used to synthesise information from different studies in meta-analysis. While likelihood-based inference is attractive both in terms of limiting properties and of implementation, its application in…

Applications · Statistics 2018-05-25 Sophia Kyriakou , Ioannis Kosmidis , Nicola Sartori

Estimating conditional average treatment effects (CATE) from randomized controlled trials (RCTs) and generalizing them to broader populations is essential for personalizing treatment rules but is complicated by selection bias due to trial…

Methodology · Statistics 2026-05-15 Rikuta Hamaya , Etsuji Suzuki , Konan Hara

Observational studies are needed when experiments are not possible. Within study comparisons (WSC) compare observational and experimental estimates that test the same hypothesis using the same treatment group, outcome, and estimand.…

Random-effects models are frequently used to synthesise information from different studies in meta-analysis. While likelihood-based inference is attractive both in terms of limiting properties and of implementation, its application in…

Methodology · Statistics 2018-02-16 Ioannis Kosmidis , Annamaria Guolo , Cristiano Varin

Common variance estimation methods for weighted average treatment effects (WATEs) in observational studies include nonparametric bootstrap and model-based, closed-form sandwich variance estimation. However, the computational cost of…

Methodology · Statistics 2025-09-11 Huiyue Li , Yi Liu , Yunji Zhou , Jiajun Liu , Dezhao Fu , Roland A. Matsouaka

To investigate a dilemma of statistical and computational efficiency faced by long-run variance estimators, we propose a decomposition of kernel weights in a quadratic form and some online inference principles. These proposals allow us to…

Methodology · Statistics 2024-09-10 Man Fung Leung , Kin Wai Chan

There is a growing literature on design-based methods to estimate average treatment effects (ATEs) for randomized controlled trials (RCTs) for full sample analyses. This article extends these methods to estimate ATEs for discrete subgroups…

Methodology · Statistics 2023-10-16 Peter Z. Schochet

Test-time adaptation (TTA) aims at adapting a model pre-trained on the labeled source domain to the unlabeled target domain. Existing methods usually focus on improving TTA performance under covariate shifts, while neglecting semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Zhengqing Gao , Xu-Yao Zhang , Cheng-Lin Liu

In online experiments where the intervention is only exposed, or "triggered", for a small subset of the population, it is critical to use variance reduction techniques to estimate treatment effects with sufficient precision to inform…

Methodology · Statistics 2023-02-01 Alex Deng , Lo-Hua Yuan , Naoya Kanai , Alexandre Salama-Manteau

Real-World Data (RWD), with its large sample sizes and rich clinical detail, offers a compelling alternative to randomized controlled trials (RCTs) for studying treatment effects in diverse and complex patient populations. However, its…

Applications · Statistics 2026-05-26 Yifei Xu , Hwiyoung Lee , Zhenyao Ye , Yezhi Pan , Jingsong Zhou , Yun Yang , Chixiang Chen , Shuo Chen

Previous work on causal inference has primarily focused on averages and conditional averages of treatment effects, with significantly less attention on variability and uncertainty in individual treatment responses. In this paper, we…

Machine Learning · Computer Science 2026-02-10 Liyuan Xu , Bijan Mazaheri

This paper studies inference in randomized controlled trials with covariate-adaptive randomization when there are multiple treatments. More specifically, we study inference about the average effect of one or more treatments relative to…

Econometrics · Economics 2019-01-21 Federico A. Bugni , Ivan A. Canay , Azeem M. Shaikh

We propose a test-based elastic integrative analysis of the randomized trial and real-world data to estimate treatment effect heterogeneity with a vector of known effect modifiers. When the real-world data are not subject to bias, our…

Methodology · Statistics 2022-11-30 Shu Yang , Chenyin Gao , Donglin Zeng , Xiaofei Wang

It has been recently shown in the literature that the sample averages from online learning experiments are biased when used to estimate the mean reward. To correct the bias, off-policy evaluation methods, including importance sampling and…

Machine Learning · Computer Science 2021-12-02 Ningyuan Chen , Xuefeng Gao , Yi Xiong

It is becoming increasingly common for researchers to consider incorporating external information from large studies to improve the accuracy of statistical inference instead of relying on a modestly sized dataset collected internally. With…

Methodology · Statistics 2021-07-20 Tian Gu , Jeremy M. G. Taylor , Bhramar Mukherjee

For the estimation of cumulative link models for ordinal data, the bias-reducing adjusted score equations in \citet{firth:93} are obtained, whose solution ensures an estimator with smaller asymptotic bias than the maximum likelihood…

Methodology · Statistics 2018-02-16 Ioannis Kosmidis

Incrementality experiments compare customers exposed to a marketing action designed to increase sales to those randomly assigned to a control group. These experiments suffer from noisy responses which make precise estimation of the average…

Applications · Statistics 2023-05-11 Ron Berman , Elea McDonnell Feit

Pragmatic trials increasingly define outcomes using real-world data such as electronic health records, where assessments are collected during routine care rather than at fixed timepoints. Consequently, these uncontrolled assessments may be…

One of the major challenges in estimating conditional potential outcomes and conditional average treatment effects (CATE) is the presence of hidden confounders. Since testing for hidden confounders cannot be accomplished only with…

Machine Learning · Computer Science 2025-06-17 Ahmed Aloui , Juncheng Dong , Ali Hasan , Vahid Tarokh