English
Related papers

Related papers: An $\varepsilon$-Best-Arm Identification Algorithm…

200 papers

Stochastic Rising Bandits (SRBs) model sequential decision-making problems in which the expected reward of the available options increases every time they are selected. This setting captures a wide range of scenarios in which the available…

Machine Learning · Computer Science 2024-05-29 Marco Mussi , Alessandro Montenegro , Francesco Trovó , Marcello Restelli , Alberto Maria Metelli

In this paper we consider the problem of best-arm identification in multi-armed bandits in the fixed confidence setting, where the goal is to identify, with probability $1-\delta$ for some $\delta>0$, the arm with the highest mean reward in…

Machine Learning · Statistics 2021-09-13 Samarth Gupta , Gauri Joshi , Osman Yağan

We address the problem of best arm identification (BAI) with a fixed budget for two-armed Gaussian bandits. In BAI, given multiple arms, we aim to find the best arm, an arm with the highest expected reward, through an adaptive experiment.…

Machine Learning · Computer Science 2024-03-19 Masahiro Kato

This paper investigates a hitherto unaddressed aspect of best arm identification (BAI) in stochastic multi-armed bandits in the fixed-confidence setting. Two key metrics for assessing bandit algorithms are computational efficiency and…

Machine Learning · Statistics 2023-06-26 Arpan Mukherjee , Ali Tajer

This paper considers the optimal adaptive allocation of measurement effort for identifying the best among a finite set of options or designs. An experimenter sequentially chooses designs to measure and observes noisy signals of their…

Machine Learning · Computer Science 2018-06-11 Daniel Russo

This paper studies the problem of identifying any $k$ distinct arms among the top $\rho$ fraction (e.g., top 5\%) of arms from a finite or infinite set with a probably approximately correct (PAC) tolerance $\epsilon$. We consider two cases:…

Machine Learning · Computer Science 2020-11-20 Wenbo Ren , Jia Liu , Ness Shroff

We consider a variant of the best arm identification task in stochastic multi-armed bandits. Motivated by risk-averse decision-making problems, our goal is to identify a set of $m$ arms with the highest $\tau$-quantile values within a fixed…

Machine Learning · Computer Science 2023-02-22 Mengyan Zhang , Cheng Soon Ong

In good arm identification (GAI), the goal is to identify one arm whose average performance exceeds a given threshold, referred to as a good arm, if it exists. Few works have studied GAI in the fixed-budget setting when the sampling budget…

Machine Learning · Statistics 2026-01-08 Marc Jourdan , Andrée Delahaye-Duriez , Clémence Réda

Motivated by the need to efficiently identify multiple candidates in high trial-and-error cost tasks such as drug discovery, we propose a near-optimal algorithm to identify all {\epsilon}-best arms (i.e., those at most {\epsilon} worse than…

Machine Learning · Statistics 2025-10-02 Zhekai Li , Tianyi Ma , Cheng Hua , Ruihao Zhu

We study the fixed-budget best-arm identification (BAI) problem in non-stationary linear bandits. Concretely, given a fixed time budget $T\in \mathbb{N}$, finite arm set $\mathcal{X} \subset \mathbb{R}^d$, and a potentially adversarial…

Machine Learning · Statistics 2026-03-12 Leo Maynard-Zhang , Zhihan Xiong , Kevin Jamieson , Maryam Fazel

We study the minimax sample complexity of $\varepsilon$-best arm identification in linear bandits. Given a compact action set $\mathcal{X}$ that spans $\mathbb{R}^d$ and an unknown reward vector $\theta\in\mathbb{R}^d$, the goal is to…

Machine Learning · Computer Science 2026-05-18 Arnab Maiti , Yunbei Xu , Kevin Jamieson

We consider the best arm identification problem, where the goal is to identify the arm with the highest mean reward from a set of $K$ arms under a limited sampling budget. This problem models many practical scenarios such as A/B testing. We…

Machine Learning · Statistics 2026-05-05 Junpei Komiyama , Kyoungseok Jang , Junya Honda

We consider the problem of identifying the best arm in stochastic Multi-Armed Bandits (MABs) using a fixed sampling budget. Characterizing the minimal instance-specific error probability for this problem constitutes one of the important…

Machine Learning · Computer Science 2024-02-21 Po-An Wang , Ruo-Chun Tzeng , Alexandre Proutiere

In fixed-confidence best arm identification (BAI), the objective is to quickly identify the optimal option while controlling the probability of error below a desired threshold. Despite the plethora of BAI algorithms, existing methods…

Machine Learning · Computer Science 2026-01-05 Brian M. Cho , Nathan Kallus

We consider the problem of best arm identification in a variant of multi-armed bandits called linked bandits. In a single interaction with linked bandits, multiple arms are played sequentially until one of them receives a positive reward.…

Machine Learning · Computer Science 2019-01-29 Anant Gupta

We study the best-arm identification problem in linear bandit, where the rewards of the arms depend linearly on an unknown parameter $\theta^*$ and the objective is to return the arm with the largest reward. We characterize the complexity…

Machine Learning · Computer Science 2014-11-05 Marta Soare , Alessandro Lazaric , Rémi Munos

We investigate the fixed-budget best-arm identification (BAI) problem for linear bandits in a potentially non-stationary environment. Given a finite arm set $\mathcal{X}\subset\mathbb{R}^d$, a fixed budget $T$, and an unpredictable sequence…

Machine Learning · Computer Science 2024-02-16 Zhihan Xiong , Romain Camilleri , Maryam Fazel , Lalit Jain , Kevin Jamieson

This paper investigates the best arm identification (BAI) problem in stochastic multi-armed bandits in the fixed confidence setting. The general class of the exponential family of bandits is considered. The existing algorithms for the…

Machine Learning · Statistics 2023-06-26 Arpan Mukherjee , Ali Tajer

We study the problem of identifying the best arm in a multi-armed bandit environment when each arm is a time-homogeneous and ergodic discrete-time Markov process on a common, finite state space. The state evolution on each arm is governed…

Machine Learning · Statistics 2022-03-30 P. N. Karthik , Kota Srinivas Reddy , Vincent Y. F. Tan

We study best arm identification in a federated multi-armed bandit setting with a central server and multiple clients, when each client has access to a {\em subset} of arms and each arm yields independent Gaussian observations. The goal is…

Machine Learning · Computer Science 2023-12-20 Zhirui Chen , P. N. Karthik , Vincent Y. F. Tan , Yeow Meng Chee