English
Related papers

Related papers: Adaptive Experimentation with Delayed Binary Feedb…

200 papers

We provide a distributed online algorithm for multi-agent submodular maximization under communication delays. We are motivated by the future distributed information-gathering tasks in unknown and dynamic environments, where utility…

Machine Learning · Computer Science 2026-03-31 Zirui Xu , Vasileios Tzoumas

This work explores adaptations of successful multi-armed bandits policies to the online contextual bandits scenario with binary rewards using binary classification algorithms such as logistic regression as black-box oracles. Some of these…

Machine Learning · Computer Science 2019-11-26 David Cortes

Most reinforcement learning algorithms implicitly assume strong synchrony. We present novel attacks targeting Q-learning that exploit a vulnerability entailed by this assumption by delaying the reward signal for a limited time period. We…

Machine Learning · Computer Science 2022-09-09 Anindya Sarkar , Jiarui Feng , Yevgeniy Vorobeychik , Christopher Gill , Ning Zhang

We consider a multiobjective multiarmed bandit problem with lexicographically ordered objectives. In this problem, the goal of the learner is to select arms that are lexicographic optimal as much as possible without knowing the arm reward…

Machine Learning · Computer Science 2019-07-30 Alihan Hüyük , Cem Tekin

The goal of this article is to investigate how human participants allocate their limited time to decisions with different properties. We report the results of two behavioral experiments. In each trial of the experiments, the participant…

Neurons and Cognition · Quantitative Biology 2016-07-20 Arash Khodadadi , Pegah Fakhari , Jerome R. Busemeyer

We propose an adaptive sampling approach for multiple testing which aims to maximize statistical power while ensuring anytime false discovery control. We consider $n$ distributions whose means are partitioned by whether they are below or…

Machine Learning · Statistics 2019-07-18 Kevin Jamieson , Lalit Jain

We study a variant of the stochastic $K$-armed bandit problem, which we call "bandits with delayed, aggregated anonymous feedback". In this problem, when the player pulls an arm, a reward is generated, however it is not immediately…

Machine Learning · Statistics 2018-06-14 Ciara Pike-Burke , Shipra Agrawal , Csaba Szepesvari , Steffen Grunewalder

Enabling multi-fingered robots to grasp and manipulate objects with human-like dexterity is especially challenging during the dynamic, continuous hand-object interactions. Closed-loop feedback control is essential for dexterous hands to…

Robotics · Computer Science 2024-12-24 Dongying Tian , Xiangbo Lin , Yi Sun

We study how to adapt to smoothly-varying ('easy') environments in well-known online learning problems where acquiring information is expensive. For the problem of label efficient prediction, which is a budgeted version of prediction with…

Machine Learning · Computer Science 2019-12-09 Siddharth Mitra , Aditya Gopalan

We propose that feedback-delayed manual tracking performance is limited by fundamental constraints imposed by the physics of negative group delay. To test this hypothesis, the results of an experiment in which subjects demonstrate both…

Adaptation and Self-Organizing Systems · Physics 2016-06-27 Henning U. Voss , Nigel Stepp

On-line experimentation (also known as A/B testing) has become an integral part of software development. To timely incorporate user feedback and continuously improve products, many software companies have adopted the culture of agile…

Applications · Statistics 2019-08-13 Yu Wang , Somit Gupta , Jiannan Lu , Ali Mahmoudzadeh , Sophia Liu

Delayed feedback control is an easy realizable control method which generates control force by comparing the current and the delayed version of the system states. In this paper, a new form of the delayed feedback structure is introduced.…

Systems and Control · Computer Science 2019-02-08 Zahed Dastan , Mahsan Tavakoli-Kakhki

Adaptive designs are increasingly used in clinical trials and online experiments to improve participant outcomes by dynamically updating treatment allocation as data accumulate. In practice, experimenters often consider multiple candidate…

Methodology · Statistics 2026-04-08 Wenxin Zhang , Aaron Hudson , Maya Petersen , Mark van der Laan

Online experiments in internet systems, also known as A/B tests, are used for a wide range of system tuning problems, such as optimizing recommender system ranking policies and learning adaptive streaming controllers. Decision-makers…

Machine Learning · Computer Science 2025-07-01 Qing Feng , Samuel Daulton , Benjamin Letham , Maximilian Balandat , Eytan Bakshy

Meta-reinforcement learning algorithms provide a data-driven way to acquire policies that quickly adapt to many tasks with varying rewards or dynamics functions. However, learned meta-policies are often effective only on the exact task…

Machine Learning · Computer Science 2023-07-13 Anurag Ajay , Abhishek Gupta , Dibya Ghosh , Sergey Levine , Pulkit Agrawal

Covariate-adjusted response-adaptive (CARA) designs have gained widespread adoption for their clear benefits in enhancing experimental efficiency and participant welfare. These designs dynamically adjust treatment allocations during interim…

Methodology · Statistics 2025-12-10 Xinwei Ma , Jingshen Wang , Waverly Wei

We study the sequential resource allocation problem where a decision maker repeatedly allocates budgets between resources. Motivating examples include allocating limited computing time or wireless spectrum bands to multiple users (i.e.,…

Machine Learning · Computer Science 2021-05-11 Jinhang Zuo , Carlee Joe-Wong

Clinical trials with time-to-event endpoints, such as overall survival (OS) or progression-free survival (PFS), are fundamental for evaluating new treatments, particularly in immuno-oncology. However, modern therapies, such as…

Methodology · Statistics 2025-09-10 James Salsbury , Jeremy Oakley , Steven Julious , Lisa Hampson

Large Language Models (LLMs) have transformed code auto-completion by generating context-aware suggestions. Yet, deciding when to present these suggestions remains underexplored, often leading to interruptions or wasted inference calls. We…

Software Engineering · Computer Science 2026-02-10 Mohammad Nour Al Awad , Sergey Ivanov , Olga Tikhonova

Bayesian optimization (BO) is a widely-used sequential method for zeroth-order optimization of complex and expensive-to-compute black-box functions. The existing BO methods assume that the function evaluation (feedback) is available to the…

Machine Learning · Computer Science 2022-06-22 Arun Verma , Zhongxiang Dai , Bryan Kian Hsiang Low