English
Related papers

Related papers: Closing the Gap on the Sample Complexity of 1-Iden…

200 papers

We present an algorithm, "constrained successive accept or reject (CSAR)," for the problem of identifying the subset of top feasible-arms from a given finite set of arms with the limited sampling-budget equal to a given time-horizon when…

Optimization and Control · Mathematics 2025-01-22 Hyeong Soo Chang

In this paper, we study a variant of best-arm identification involving elements of risk sensitivity and communication constraints. Specifically, the goal of the learner is to identify the arm with the highest quantile reward, while the…

Machine Learning · Statistics 2025-02-11 Ivan Lau , Jonathan Scarlett

The best arm identification problem requires identifying the best alternative (i.e., arm) in active experimentation using the smallest number of experiments (i.e., arm pulls), which is crucial for cost-efficient and timely decision-making…

Machine Learning · Computer Science 2025-06-17 Kapilan Balagopalan , Tuan Ngo Nguyen , Yao Zhao , Kwang-Sung Jun

Consider the problem of best arm identification with a security constraint. Specifically, assume a setup of stochastic linear bandits with $K$ arms of dimension $d$. In each arm pull, the player receives a reward that is the sum of the dot…

Machine Learning · Computer Science 2025-07-29 Asaf Cohen , Onur Günlü

We propose a novel technique for analyzing adaptive sampling called the {\em Simulator}. Our approach differs from the existing methods by considering not how much information could be gathered by any fixed sampling strategy, but how…

Machine Learning · Computer Science 2023-04-25 Max Simchowitz , Kevin Jamieson , Benjamin Recht

We focus on the problem of best-arm identification in a stochastic multi-arm bandit with temporally decreasing variances for the arms' rewards. We model arm rewards as Gaussian random variables with fixed means and variances that decrease…

Machine Learning · Computer Science 2025-02-12 Tamojeet Roychowdhury , Kota Srinivas Reddy , Krishna P Jagannathan , Sharayu Moharir

We consider a multi-armed bandit setting in which each arm has a public and a private reward distribution. An observer expects an agent to follow Thompson Sampling according to the public rewards, however, the deceptive agent aims to…

Machine Learning · Computer Science 2025-10-13 I. Arda Vurankaya , Mustafa O. Karabag , Wesley A. Suttle , Jesse Milzman , David Fridovich-Keil , Ufuk Topcu

We consider fixed-budget best-arm identification in two-armed Gaussian bandit problems. One of the longstanding open questions is the existence of an optimal strategy under which the probability of misidentification matches a lower bound.…

Machine Learning · Statistics 2023-01-02 Masahiro Kato , Kaito Ariu , Masaaki Imaizumi , Masahiro Nomura , Chao Qin

We give a new algorithm for best arm identification in linearly parameterised bandits in the fixed confidence setting. The algorithm generalises the well-known LUCB algorithm of Kalyanakrishnan et al. (2012) by playing an arm which…

Machine Learning · Computer Science 2019-11-11 Mohammadi Zaki , Avinash Mohan , Aditya Gopalan

We introduce the "inverse bandit" problem of estimating the rewards of a multi-armed bandit instance from observing the learning process of a low-regret demonstrator. Existing approaches to the related problem of inverse reinforcement…

Machine Learning · Statistics 2022-02-23 Wenshuo Guo , Kumar Krishna Agrawal , Aditya Grover , Vidya Muthukumar , Ashwin Pananjady

In good arm identification (GAI), the goal is to identify one arm whose average performance exceeds a given threshold, referred to as a good arm, if it exists. Few works have studied GAI in the fixed-budget setting when the sampling budget…

Machine Learning · Statistics 2026-01-08 Marc Jourdan , Andrée Delahaye-Duriez , Clémence Réda

In pure-exploration problems, information is gathered sequentially to answer a question on the stochastic environment. While best-arm identification for linear bandits has been extensively studied in recent years, few works have been…

Machine Learning · Statistics 2022-06-10 Marc Jourdan , Rémy Degenne

Many algorithms for data analysis exist, especially for classification problems. To solve a data analysis problem, a proper algorithm should be chosen, and also its hyperparameters should be selected. In this paper, we present a new method…

Machine Learning · Computer Science 2016-11-08 Valeria Efimova , Andrey Filchenkov , Anatoly Shalyto

We study a novel pure exploration problem: the $\epsilon$-Thresholding Bandit Problem (TBP) with fixed confidence in stochastic linear bandits. We prove a lower bound for the sample complexity and extend an algorithm designed for Best Arm…

Machine Learning · Statistics 2024-02-16 Eduardo Ochoa Rivera , Ambuj Tewari

This paper introduces the framework of multi-armed sampling, which serves as the sampling counterpart to the optimization problem of multi-armed bandits. Our primary motivation is to rigorously examine the exploration-exploitation trade-off…

Machine Learning · Computer Science 2026-05-14 Mohammad Pedramfar , Siamak Ravanbakhsh

In this paper, we consider a bandit problem in which there are a number of groups each consisting of infinitely many arms. Whenever a new arm is requested from a given group, its mean reward is drawn from an unknown reservoir distribution…

Machine Learning · Statistics 2023-02-02 Ivan Lau , Yan Hao Ling , Mayank Shrivastava , Jonathan Scarlett

The exploration/exploitation (E/E) dilemma arises naturally in many subfields of Science. Multi-armed bandit problems formalize this dilemma in its canonical form. Most current research in this field focuses on generic solutions that can be…

Artificial Intelligence · Computer Science 2012-07-24 Francis Maes , Damien Ernst , Louis Wehenkel

We study best arm identification in a federated multi-armed bandit setting with a central server and multiple clients, when each client has access to a {\em subset} of arms and each arm yields independent Gaussian observations. The goal is…

Machine Learning · Computer Science 2023-12-20 Zhirui Chen , P. N. Karthik , Vincent Y. F. Tan , Yeow Meng Chee

We consider the best-k-arm identification problem for multi-armed bandits, where the objective is to select the exact set of k arms with the highest mean rewards by sequentially allocating measurement effort. We characterize the necessary…

Machine Learning · Statistics 2023-07-18 Wei You , Chao Qin , Zihao Wang , Shuoguang Yang

We consider a novel stochastic multi-armed bandit setting, where playing an arm makes it unavailable for a fixed number of time slots thereafter. This models situations where reusing an arm too often is undesirable (e.g. making the same…

Machine Learning · Computer Science 2024-07-31 Soumya Basu , Rajat Sen , Sujay Sanghavi , Sanjay Shakkottai