English
Related papers

Related papers: Learning What to Learn: Experimental Design when C…

200 papers

Reproducible research in Machine Learning has seen a salutary abundance of progress lately: workflows, transparency, and statistical analysis of validation and test performance. We build on these efforts and take them further. We offer a…

This paper considers the estimation of treatment effects in randomized experiments with complex experimental designs, including cases with interference between units. We develop a design-based estimation theory for arbitrary experimental…

Econometrics · Economics 2025-05-27 Haoge Chang

This paper studies how to design two-wave experiments in the presence of spillovers for precise inference on treatment effects. We consider units connected through a single network, local dependence among individuals, and a general class of…

Econometrics · Economics 2025-11-25 Davide Viviano

Observational studies provide invaluable opportunities to draw causal inference, but they may suffer from biases due to pretreatment difference between treated and control units. Matching is a popular approach to reduce observed covariate…

Methodology · Statistics 2025-09-17 Xinran Li

Causal structure learning is a key problem in many domains. Causal structures can be learnt by performing experiments on the system of interest. We address the largely unexplored problem of designing a batch of experiments that each…

Machine Learning · Computer Science 2021-11-25 Scott Sussex , Andreas Krause , Caroline Uhler

Traditionally Bayesian decision-theoretic design of experiments proceeds by choosing a design to minimise expectation of a given loss function over the space of all designs. The loss function encapsulates the aim of the experiment, and the…

Methodology · Statistics 2021-08-10 Antony M. Overstall , James M. McGree

For experiments running in field plots or over time, the observations are often correlated due to spatial or serial correlation, which leads to correlated errors in a linear model analyzing the treatment means. Without knowing the exact…

Methodology · Statistics 2016-05-30 Rena K. Mann , Roderick Edwards , Julie Zhou

Estimation of social influence in networks can be substantially biased in observational studies due to homophily and network correlation in exposure to exogenous events. Randomized experiments, in which the researcher intervenes in the…

Social and Information Networks · Computer Science 2017-09-28 Sean J. Taylor , Dean Eckles

Using only a binary intervention and outcome and the design of the randomization within an experiment, we construct a design-based likelihood of the joint distribution of potential outcomes in the sample -- the numbers of always takers,…

Econometrics · Economics 2026-03-24 Neil Christy , Amanda Ellen Kowalski

We study the design and analysis of switchback experiments conducted on a single aggregate unit. The design problem is to partition the continuous time space into intervals and switch treatments between intervals, in order to minimize the…

Methodology · Statistics 2024-06-12 Ruoxuan Xiong , Alex Chin , Sean J. Taylor

For paired comparison experiments involving competing options described by two-level attributes several different methods of constructing designs having block paired observations under the main effects model are presented. These designs are…

Methodology · Statistics 2019-10-16 Eric Nyarko

This article studies the benefits of using spatially randomized experimental designs which partition the experimental area into distinct, non-overlapping units with treatments assigned randomly. Such designs offer improved policy evaluation…

Statistics Theory · Mathematics 2025-11-18 Ying Yang , Chengchun Shi , Fang Yao , Shouyang Wang , Hongtu Zhu

For biological experiments aiming at calibrating models with unknown parameters, a good experimental design is crucial, especially for those subject to various constraints, such as financial limitations, time consumption and physical…

Applications · Statistics 2014-07-22 Xiao Lin , Gabriel Terejanu

Incentives in experimental design are often misaligned: experimenters design and finance experiments to seek regulatory approval, while regulators seek to maximize social-welfare. We propose a framework to resolve this conflict, wherein…

Econometrics · Economics 2026-05-19 Karun Adusumilli , Abhi Vemulapati

Exposure mappings are widely used to model potential outcomes in the presence of interference, where each unit's outcome may depend not only on its own treatment, but also on the treatment of other units as well. However, in practice these…

Methodology · Statistics 2018-07-02 David Choi

Randomized Controlled Trials (RCTs) represent the gold standard for causal inference yet remain a scarce resource. While large-scale observational data is often available, it is utilized only for retrospective fusion, and remains discarded…

Machine Learning · Statistics 2026-03-05 Erdun Gao , Liang Zhang , Jake Fawkes , Aoqi Zuo , Wenqin Liu , Haoxuan Li , Mingming Gong , Dino Sejdinovic

Variance reduction for causal inference in the presence of network interference is often achieved through either outcome modeling, typically analyzed under unit-randomized Bernoulli designs, or clustered experimental designs, typically…

Methodology · Statistics 2026-01-19 Matthew Eichhorn , Samir Khan , Johan Ugander , Christina Lee Yu

A growing number of applications involve settings where, in order to infer heterogeneous effects, a researcher compares various units. Examples of research designs include children moving between different neighborhoods, workers moving…

Econometrics · Economics 2024-04-03 Stephane Bonhomme , Angela Denis

This paper concerns robust inference on average treatment effects following model selection. In the selection on observables framework, we show how to construct confidence intervals based on a doubly-robust estimator that are robust to…

Statistics Theory · Mathematics 2018-04-13 Max H. Farrell

Background: Natural or quasi experiments are appealing for public health research because they enable the evaluation of events or interventions that are difficult or impossible to manipulate experimentally, such as many policy and health…