English
Related papers

Related papers: Minimizing Type 2 Errors in an Experiment-Rich Reg…

200 papers

To minimize the mean squared error (MSE) in global average treatment effect (GATE) estimation under network interference, a popular approach is to use a cluster-randomized design. However, in the presence of homophily, which is common in…

Randomized A/B tests within online learning platforms represent an exciting direction in learning sciences. With minimal assumptions, they allow causal effect estimation without confounding bias and exact statistical inference even in small…

Methodology · Statistics 2023-06-13 Adam C. Sales , Ethan B. Prihar , Johann A. Gagnon-Bartsch , Neil T. Heffernan

We consider an expected-value ranking and selection (R&S) problem where all k solutions' simulation outputs depend on a common parameter whose uncertainty can be modeled by a distribution. We define the most probable best (MPB) to be the…

Methodology · Statistics 2024-04-23 Taeho Kim , Kyoung-kuk Kim , Eunhye Song

Randomized experiments ensure robust causal inference that are critical to effective learning analytics research and practice. However, traditional randomized experiments, like A/B tests, are limiting in large scale digital learning…

Applications · Statistics 2019-02-04 Timothy NeCamp , Josh Gardner , Christopher Brooks

This paper studies a two-stage model of experimentation, where the researcher first samples representative units from an eligible pool, then assigns each sampled unit to treatment or control. To implement balanced sampling and assignment,…

Econometrics · Economics 2023-08-22 Max Cytrynbaum

We consider a risk-averse stochastic capacity planning problem under uncertain demand in each period. Using a scenario tree representation of the uncertainty, we formulate a multistage stochastic integer program to adjust the capacity…

Optimization and Control · Mathematics 2024-11-05 Xian Yu , Siqian Shen

Adaptive experiments use preliminary analyses of the data to inform further course of action and are commonly used in many disciplines including medical and social sciences. Because the null hypothesis and experimental design are…

Methodology · Statistics 2026-05-26 Tobias Freidling , Qingyuan Zhao , Zijun Gao

With medical tests becoming increasingly available, concerns about over-testing and over-treatment dramatically increase. Hence, it is important to understand the influence of testing on treatment selection in general practice. Most…

Methodology · Statistics 2020-08-11 Yun Li , Irina Bondarenko , Michael R. Elliott , Timothy P. Hofer , Jeremy M. G. Taylor

A platform trial with a master protocol provides an infrastructure to ethically and efficiently evaluate multiple treatment options in multiple diseases. Given that certain study drugs can enter or exit a platform trial, the randomization…

Methodology · Statistics 2025-07-15 Tianyu Zhan , Jane Zhang , Lei Shu , Yihua Gu

There has been significant attention given to developing data-driven methods for tailoring patient care based on individual patient characteristics. Dynamic treatment regimes formalize this through a sequence of decision rules that map…

Methodology · Statistics 2022-02-22 Eric J. Rose , Erica E. M. Moodie , Susan Shortreed

Probabilistic values, including Shapley values and semivalues, provide a model-agnostic framework to attribute the behavior of a black-box model to data points or features, with a wide range of applications including explainable artificial…

Artificial Intelligence · Computer Science 2026-05-05 Ziqi Liu , Kiljae Lee , Yuan Zhang , Weijing Tang

Controlled experimentation, also called A/B testing, is widely adopted to accelerate product innovations in the online world. However, how fast we innovate can be limited by how we run experiments. Most experiments go through a "ramp up"…

Applications · Statistics 2018-01-26 Ya Xu , Weitao Duan , Shaochen Huang

Motivated by the need for distributed learning and optimization algorithms with low communication cost, we study communication efficient algorithms for distributed mean estimation. Unlike previous works, we make no probabilistic assumptions…

Machine Learning · Computer Science 2017-09-26 Ananda Theertha Suresh , Felix X. Yu , Sanjiv Kumar , H. Brendan McMahan

In this work, we propose three pilot assignment schemes to reduce the effect of pilot contamination in cell-free massive multiple-input-multiple-output (MIMO) systems. Our first algorithm, which is based on the idea of random sequential…

Information Theory · Computer Science 2021-05-21 Priyabrata Parida , Harpreet S. Dhillon

Matching is a widely used causal inference design that aims to approximate a randomized experiment using observational data by forming matched sets of treated and control units based on similarities in their covariates. Ideally, treated…

Methodology · Statistics 2026-04-06 Jianan Zhu , Jeffrey Zhang , Zijian Guo , Siyu Heng

Many scenarios where agents with restrictions compete for resources can be cast as maximum matching problems on bipartite graphs. Our focus is on resource allocation problems where agents may have restrictions that make them incompatible…

Artificial Intelligence · Computer Science 2022-09-13 Yohai Trabelsi , Abhijin Adiga , Sarit Kraus , S. S. Ravi

This paper considers the classical problem of sampling with Monte Carlo methods a target rare event distribution defined by a score function that is very expensive to compute. We assume we can build using evaluations of the true score, an…

Computation · Statistics 2024-10-25 Frédéric Cérou , Patrick Héas , Mathias Rousset

e consider the experimental design problem in an online environment, an important practical task for reducing the variance of estimates in randomized experiments which allows for greater precision, and in turn, improved decision making. In…

Methodology · Statistics 2022-03-07 David Arbour , Drew Dimmery , Tung Mai , Anup Rao

We develop approximation algorithms for set-selection problems with deterministic constraints, but random objective values, i.e., stochastic probing problems. When the goal is to maximize the objective, approximation algorithms for probing…

Data Structures and Algorithms · Computer Science 2021-11-04 Weina Wang , Anupam Gupta , Jalani Williams

We develop an approach to risk minimization and stochastic optimization that provides a convex surrogate for variance, allowing near-optimal and computationally efficient trading between approximation and estimation error. Our approach…

Machine Learning · Statistics 2017-12-15 John Duchi , Hongseok Namkoong