English
Related papers

Related papers: Online Balanced Experimental Design

200 papers

There is significant interest in deploying machine learning algorithms for diagnostic radiology, as modern learning techniques have made it possible to detect abnormalities in medical images within minutes. While machine-assisted diagnoses…

Data Structures and Algorithms · Computer Science 2022-12-21 Woo-Hyung Cho , Shane Henderson , David Shmoys

In this paper, we consider the online version of the machine minimization problem (introduced by Chuzhoy et al., FOCS 2004), where the goal is to schedule a set of jobs with release times, deadlines, and processing lengths on a minimum…

Discrete Mathematics · Computer Science 2014-03-06 Nikhil Devanur , Konstantin Makarychev , Debmalya Panigrahi , Grigory Yaroslavtsev

Randomized controlled trials generate experimental variation that can credibly identify causal effects, but often suffer from limited scale, while observational datasets are large, but often violate desired identification assumptions. To…

Econometrics · Economics 2023-12-27 George Z. Gui

In the absence of randomized controlled and natural experiments, it is necessary to balance the distributions of (observable) covariates of the treated and control groups in order to obtain an unbiased estimate of a causal effect of…

Methodology · Statistics 2022-03-02 Martin Cousineau , Vedat Verter , Susan A. Murphy , Joelle Pineau

We consider the problem of online linear regression in the stochastic setting. We derive high probability regret bounds for online ridge regression and the forward algorithm. This enables us to compare online regression algorithms more…

Machine Learning · Computer Science 2021-11-03 Reda Ouhamma , Odalric Maillard , Vianney Perchet

Offline policy optimization could have a large impact on many real-world decision-making problems, as online learning may be infeasible in many applications. Importance sampling and its variants are a commonly used type of estimator in…

Machine Learning · Computer Science 2022-07-05 Yao Liu , Yannis Flet-Berliac , Emma Brunskill

Recently, there as been an increasing interest in the use of heavily restricted randomization designs which enforces balance on observed covariates in randomized controlled trials. However, when restrictions are strict, there is a risk that…

Methodology · Statistics 2021-10-15 Mattias Nordin , Mårten Schultzberg

We consider the problem of designing minimax estimators for estimating the parameters of a probability distribution. Unlike classical approaches such as the MLE and minimum distance estimators, we consider an algorithmic approach for…

Machine Learning · Statistics 2020-06-23 Kartik Gupta , Arun Sai Suggala , Adarsh Prasad , Praneeth Netrapalli , Pradeep Ravikumar

This paper investigates regret minimization, statistical inference, and their interplay in high-dimensional online decision-making based on the sparse linear context bandit model. We integrate the $\varepsilon$-greedy bandit algorithm for…

Machine Learning · Computer Science 2025-05-20 Congyuan Duan , Wanteng Ma , Jiashuo Jiang , Dong Xia

Controlled experiments are widely used in many applications to investigate the causal relationship between input factors and experimental outcomes. A completely randomized design is usually used to randomly assign treatment levels to…

Methodology · Statistics 2026-05-12 Yiou Li , Lulu Kang , Xiao Huang

Randomized A/B tests within online learning platforms represent an exciting direction in learning sciences. With minimal assumptions, they allow causal effect estimation without confounding bias and exact statistical inference even in small…

Methodology · Statistics 2023-06-13 Adam C. Sales , Ethan B. Prihar , Johann A. Gagnon-Bartsch , Neil T. Heffernan

We study the online discrepancy minimization problem for vectors in $\mathbb{R}^d$ in the oblivious setting where an adversary is allowed fix the vectors $x_1, x_2, \ldots, x_n$ in arbitrary order ahead of time. We give an algorithm that…

Data Structures and Algorithms · Computer Science 2021-02-09 David Arbour , Drew Dimmery , Tung Mai , Anup Rao

Offline model-based optimization (MBO) seeks to discover high-performing designs using only a fixed dataset of past evaluations. Most existing methods rely on learning a surrogate model via regression and implicitly assume that good…

Machine Learning · Computer Science 2026-03-05 Shen-Huan Lyu , Rong-Xi Tan , Ke Xue , Yi-Xiao He , Yu Huang , Qingfu Zhang , Chao Qian

A/B testing, or controlled experiments, is the gold standard approach to causally compare the performance of algorithms on online platforms. However, conventional Bernoulli randomization in A/B testing faces many challenges such as…

Machine Learning · Computer Science 2023-02-13 Yongkang Guo , Yuan Yuan , Jinshan Zhang , Yuqing Kong , Zhihua Zhu , Zheng Cai

User-randomized A/B testing has emerged as the gold standard for online experimentation. However, when this kind of approach is not feasible due to legal, ethical or practical considerations, experimenters have to consider alternatives like…

Methodology · Statistics 2025-06-17 Paul Missault , Lorenzo Masoero , Christian Delbé , Thomas Richardson , Guido Imbens

The online assignment problem plays an important role in operational research and computer science which is why immense attention has been given to improving its solution quality. Due to the incomplete information about the input, it is…

Computational Complexity · Computer Science 2022-08-09 Clarence Gabriel R. Kasilag , Pollux M. Rey , Jhoirene B. Clemente

We study the problems of offline and online contextual optimization with feedback information, where instead of observing the loss, we observe, after-the-fact, the optimal action an oracle with full knowledge of the objective function would…

Machine Learning · Computer Science 2023-07-04 Omar Besbes , Yuri Fonseca , Ilan Lobel

A/B testing is critical for modern technological companies to evaluate the effectiveness of newly developed products against standard baselines. This paper studies optimal designs that aim to maximize the amount of information obtained from…

Methodology · Statistics 2023-11-07 Ting Li , Chengchun Shi , Jianing Wang , Fan Zhou , Hongtu Zhu

In today's era of big data, robust least-squares regression becomes a more challenging problem when considering the adversarial corruption along with explosive growth of datasets. Traditional robust methods can handle the noise but suffer…

Data Structures and Algorithms · Computer Science 2017-10-04 Xuchao Zhang , Liang Zhao , Arnold P. Boedihardjo , Chang-Tien Lu

In the stochastic online vector balancing problem, vectors $v_1,v_2,\ldots,v_T$ chosen independently from an arbitrary distribution in $\mathbb{R}^n$ arrive one-by-one and must be immediately given a $\pm$ sign. The goal is to keep the norm…

Data Structures and Algorithms · Computer Science 2020-07-22 Nikhil Bansal , Haotian Jiang , Raghu Meka , Sahil Singla , Makrand Sinha