English
Related papers

Related papers: Adaptive Experimentation at Scale: A Computational…

200 papers

Tactical selection of experiments to estimate an underlying model is an innate task across various fields. Since each experiment has costs associated with it, selecting statistically significant experiments becomes necessary. Classic linear…

Optimization and Control · Mathematics 2021-03-30 Raj K. Velicheti , Amber Srivastava , Srinivasa M. Salapaka

Estimation and inference for the Average Treatment Effect (ATE) is a cornerstone of causal inference and often serves as the foundation for developing procedures for more complicated settings. Although traditionally analyzed in a batch…

Machine Learning · Statistics 2025-02-10 Ojash Neopane , Aaditya Ramdas , Aarti Singh

Predictive models that generalize well under distributional shift are often desirable and sometimes crucial to building robust and reliable machine learning applications. We focus on distributional shift that arises in causal inference from…

Machine Learning · Statistics 2018-02-27 Fredrik D. Johansson , Nathan Kallus , Uri Shalit , David Sontag

Randomized experiments have been the gold standard for assessing the effectiveness of a treatment or policy. The classical complete randomization approach assigns treatments based on a prespecified probability and may lead to inefficient…

Methodology · Statistics 2023-10-26 Waverly Wei , Xinwei Ma , Jingshen Wang

Adaptive experiments such as multi-arm bandits adapt the treatment-allocation policy and/or the decision to stop the experiment to the data observed so far. This has the potential to improve outcomes for study participants within the…

Methodology · Statistics 2024-05-03 Aurélien Bibaut , Nathan Kallus

Specifying reward functions for complex tasks like object manipulation or driving is challenging to do by hand. Reward learning seeks to address this by learning a reward model using human feedback on selected query policies. This shifts…

Machine Learning · Computer Science 2023-02-27 Kush Bhatia , Wenshuo Guo , Jacob Steinhardt

Distributed model fitting refers to the process of fitting a mathematical or statistical model to the data using distributed computing resources, such that computing tasks are divided among multiple interconnected computers or nodes, often…

Computation · Statistics 2024-06-04 Xiaofei Wu , Rongmei Liang , Fabio Roli , Marcello Pelillo , Jing Yuan

Like with most large-scale systems, the evaluation of quantitative properties of collective adaptive systems is an important issue that crosscuts all its development stages, from design (in the case of engineered systems) to runtime…

Systems and Control · Computer Science 2016-07-12 Mirco Tribastone

A fundamental challenge for any intelligent system is prediction: given some inputs, can you predict corresponding outcomes? Most work on supervised learning has focused on producing accurate marginal predictions for each input. However, we…

Machine Learning · Computer Science 2022-05-25 Zheng Wen , Ian Osband , Chao Qin , Xiuyuan Lu , Morteza Ibrahimi , Vikranth Dwaracherla , Mohammad Asghari , Benjamin Van Roy

We study a sequential resource allocation problem where a decision maker selects subsets of agents at each period to maximize overall outcomes without prior knowledge of individual-level effects. Our framework applies to settings such as…

Machine Learning · Computer Science 2025-08-29 Katherine B. Adams , Justin J. Boutilier , Qinyang He , Yonatan Mintz

Statistical inference with bandit data presents fundamental challenges due to adaptive sampling, which violates the independence assumptions underlying classical asymptotic theory. Recent work has identified stability as a sufficient…

Machine Learning · Statistics 2026-03-12 Budhaditya Halder , Ishan Sengupta , Koustav Chowdhury , Koulik Khamaru

As the adoption of federated learning increases for learning from sensitive data local to user devices, it is natural to ask if the learning can be done using implicit signals generated as users interact with the applications of interest,…

Machine Learning · Computer Science 2023-03-21 Alekh Agarwal , H. Brendan McMahan , Zheng Xu

Most bandit policies are designed to either minimize regret in any problem instance, making very few assumptions about the underlying environment, or in a Bayesian sense, assuming a prior distribution over environment parameters. The former…

Machine Learning · Computer Science 2021-01-07 Branislav Kveton , Martin Mladenov , Chih-Wei Hsu , Manzil Zaheer , Csaba Szepesvari , Craig Boutilier

In this work we revisit two classic high-dimensional online learning problems, namely linear regression and contextual bandits, from the perspective of adversarial robustness. Existing works in algorithmic robust statistics make strong…

Machine Learning · Computer Science 2021-06-14 Sitan Chen , Frederic Koehler , Ankur Moitra , Morris Yau

Achieving ultimate bounds in estimation processes is the main objective of quantum metrology. In this context, several problems require measurement of multiple parameters by employing only a limited amount of resources. To this end,…

Randomized algorithms, such as randomized sketching or stochastic optimization, are a promising approach to ease the computational burden in analyzing large datasets. However, randomized algorithms also produce non-deterministic outputs,…

Methodology · Statistics 2025-05-13 Zhixiang Zhang , Sokbae Lee , Edgar Dobriban

While experimental design often focuses on selecting the single best alternative from a finite set (e.g., in ranking and selection or best-arm identification), many pure-exploration problems pursue richer goals. Given a specific goal,…

Machine Learning · Statistics 2025-05-28 Chao Qin , Wei You

This paper proposes an adaptive neural-compilation framework to address the problem of efficient program learning. Traditional code optimisation strategies used in compilers are based on applying pre-specified set of transformations that…

Artificial Intelligence · Computer Science 2016-05-27 Rudy Bunel , Alban Desmaison , Pushmeet Kohli , Philip H. S. Torr , M. Pawan Kumar

Sequential decision-making is central to sustainable agricultural management and precision agriculture, where resource inputs must be optimized under uncertainty and over time. However, such decisions must often be made with limited…

Machine Learning · Statistics 2026-02-24 Sakshi Arya , Wentao Lin

Contextual bandit algorithms are sensitive to the estimation method of the outcome model as well as the exploration method used, particularly in the presence of rich heterogeneity or complex outcome models, which can lead to difficult…

Machine Learning · Statistics 2018-12-18 Maria Dimakopoulou , Zhengyuan Zhou , Susan Athey , Guido Imbens