English
Related papers

Related papers: Fixed Confidence Best Arm Identification in the Ba…

200 papers

In the Best-$K$ identification problem (Best-$K$-Arm), we are given $N$ stochastic bandit arms with unknown reward distributions. Our goal is to identify the $K$ arms with the largest means with high confidence, by drawing samples from the…

Machine Learning · Computer Science 2017-05-22 Haotian Jiang , Jian Li , Mingda Qiao

We study the best arm identification (BEST-1-ARM) problem, which is defined as follows. We are given $n$ stochastic bandit arms. The $i$th arm has a reward distribution $D_i$ with an unknown mean $\mu_{i}$. Upon each play of the $i$th arm,…

Machine Learning · Computer Science 2016-08-24 Lijie Chen , Jian Li

In fixed budget bandit identification, an algorithm sequentially observes samples from several distributions up to a given final time. It then answers a query about the set of distributions. A good algorithm will have a small probability of…

Machine Learning · Statistics 2023-07-03 Rémy Degenne

We give a complete characterization of the complexity of best-arm identification in one-parameter bandit problems. We prove a new, tight lower bound on the sample complexity. We propose the `Track-and-Stop' strategy, which we prove to be…

Statistics Theory · Mathematics 2016-06-02 Aurélien Garivier , Emilie Kaufmann

We propose EB-TC$\varepsilon$, a novel sampling rule for $\varepsilon$-best arm identification in stochastic bandits. It is the first instance of Top Two algorithm analyzed for approximate best arm identification. EB-TC$\varepsilon$ is an…

Machine Learning · Statistics 2023-11-07 Marc Jourdan , Rémy Degenne , Emilie Kaufmann

The paper proposes a novel upper confidence bound (UCB) procedure for identifying the arm with the largest mean in a multi-armed bandit game in the fixed confidence setting using a small number of total samples. The procedure cannot be…

Machine Learning · Statistics 2013-12-30 Kevin Jamieson , Matthew Malloy , Robert Nowak , Sébastien Bubeck

This paper studies active learning in the context of robust statistics. Specifically, we propose a variant of the Best Arm Identification problem for \emph{contaminated bandits}, where each arm pull has probability $\varepsilon$ of…

Statistics Theory · Mathematics 2021-11-16 Jason Altschuler , Victor-Emmanuel Brunel , Alan Malek

The challenge of identifying the best feasible arm within a fixed budget has attracted considerable interest in recent years. However, a notable gap remains in the literature: the exact exponential rate at which the error probability…

Machine Learning · Computer Science 2025-06-04 Jie Bian , Vincent Y. F. Tan

This paper targets a variant of the stochastic multi-armed bandit problem called good arm identification (GAI). GAI is a pure-exploration bandit problem with the goal to output as many good arms using as few samples as possible, where a…

Machine Learning · Computer Science 2024-02-19 Yun-Da Tsai , Tzu-Hsien Tsai , Shou-De Lin

We consider the quantum version of the bandit problem known as {\em best arm identification} (BAI). We first propose a quantum modeling of the BAI problem, which assumes that both the learning agent and the environment are quantum; we then…

Machine Learning · Computer Science 2020-09-23 Balthazar Casalé , Giuseppe Di Molfetta , Hachem Kadri , Liva Ralaivola

This study investigates the experimental design problem for identifying the arm with the highest expected outcome, referred to as best arm identification (BAI). In our experiments, the number of treatment-allocation rounds is fixed. During…

Statistics Theory · Mathematics 2024-03-12 Masahiro Kato

We formulate, analyze and solve the problem of best arm identification with fairness constraints on subpopulations (BAICS). Standard best arm identification problems aim at selecting an arm that has the largest expected reward where the…

Machine Learning · Computer Science 2023-04-11 Yuhang Wu , Zeyu Zheng , Tingyu Zhu

Top-$2$ methods have become popular in solving the best arm identification (BAI) problem. The best arm, or the arm with the largest mean amongst finitely many, is identified through an algorithm that at any sequential step independently…

Machine Learning · Computer Science 2024-12-17 Agniv Bandyopadhyay , Sandeep Juneja , Shubhada Agrawal

We study the best-arm identification (BAI) problem with a fixed budget and contextual (covariate) information. In each round of an adaptive experiment, after observing contextual information, we choose a treatment arm using past…

Machine Learning · Computer Science 2023-01-05 Masahiro Kato , Masaaki Imaizumi , Takuya Ishihara , Toru Kitagawa

We study a multi-objective pure exploration problem in a multi-armed bandit model. Each arm is associated to an unknown multi-variate distribution and the goal is to identify the distributions whose mean is not uniformly worse than that of…

Machine Learning · Statistics 2025-01-15 Cyrille Kone , Emilie Kaufmann , Laura Richert

We give a new algorithm for best arm identification in linearly parameterised bandits in the fixed confidence setting. The algorithm generalises the well-known LUCB algorithm of Kalyanakrishnan et al. (2012) by playing an arm which…

Machine Learning · Computer Science 2019-11-11 Mohammadi Zaki , Avinash Mohan , Aditya Gopalan

The expected improvement (EI) algorithm is a popular strategy for information collection in optimization under uncertainty. The algorithm is widely known to be too greedy, but nevertheless enjoys wide use due to its simplicity and ability…

Machine Learning · Computer Science 2017-05-30 Chao Qin , Diego Klabjan , Daniel Russo

In this paper, we introduce the constrained best mixed arm identification (CBMAI) problem with a fixed budget. This is a pure exploration problem in a stochastic finite armed bandit model. Each arm is associated with a reward and multiple…

Machine Learning · Computer Science 2024-05-27 Dengwang Tang , Rahul Jain , Ashutosh Nayyar , Pierluigi Nuzzo

Motivated by the task of hyperparameter optimization, we introduce the non-stochastic best-arm identification problem. Within the multi-armed bandit literature, the cumulative regret objective enjoys algorithms and analyses for both the…

Machine Learning · Computer Science 2015-03-02 Kevin Jamieson , Ameet Talwalkar

Motivated by a natural problem in online model selection with bandit information, we introduce and analyze a best arm identification problem in the rested bandit setting, wherein arm expected losses decrease with the number of times the arm…

Machine Learning · Statistics 2020-12-08 Leonardo Cella , Claudio Gentile , Massimiliano Pontil