English
Related papers

Related papers: Bayesian Fixed-Budget Best-Arm Identification

200 papers

We consider best arm identification in the multi-armed bandit problem. Assuming certain continuity conditions of the prior, we characterize the rate of the Bayesian simple regret. Differing from Bayesian regret minimization (Lai, 1987), the…

Machine Learning · Computer Science 2023-07-27 Junpei Komiyama , Kaito Ariu , Masahiro Kato , Chao Qin

We study best-arm identification with fixed confidence in bandit models with graph smoothness constraint. We provide and analyze an efficient gradient ascent algorithm to compute the sample complexity of this problem as a solution of a…

Machine Learning · Computer Science 2020-05-21 Tomáš Kocák , Aurélien Garivier

Best arm identification (BAI) aims to identify the highest-performance arm among a set of $K$ arms by collecting stochastic samples from each arm. In real-world problems, the best arm needs to satisfy additional feasibility constraints.…

Machine Learning · Computer Science 2026-01-26 Ting Cai , Kirthevasan Kandasamy

We study the problem of best-arm identification with fixed confidence in stochastic linear bandits. The objective is to identify the best arm with a given level of certainty while minimizing the sampling budget. We devise a simple algorithm…

Machine Learning · Statistics 2020-06-30 Yassir Jedra , Alexandre Proutiere

In fixed budget bandit identification, an algorithm sequentially observes samples from several distributions up to a given final time. It then answers a query about the set of distributions. A good algorithm will have a small probability of…

Machine Learning · Statistics 2023-07-03 Rémy Degenne

We consider a multi-armed bandit setting with finitely many arms, in which each arm yields an $M$-dimensional vector reward upon selection. We assume that the reward of each dimension (a.k.a. {\em objective}) is generated independently of…

Machine Learning · Computer Science 2025-01-24 Zhirui Chen , P. N. Karthik , Yeow Meng Chee , Vincent Y. F. Tan

We consider the fixed-budget best arm identification problem with rewards following normal distributions. In this problem, the forecaster is given $K$ arms (or treatments) and $T$ time steps. The forecaster attempts to find the arm with the…

Machine Learning · Statistics 2024-04-16 Junpei Komiyama

Stochastic Rising Bandits (SRBs) model sequential decision-making problems in which the expected reward of the available options increases every time they are selected. This setting captures a wide range of scenarios in which the available…

Machine Learning · Computer Science 2024-05-29 Marco Mussi , Alessandro Montenegro , Francesco Trovó , Marcello Restelli , Alberto Maria Metelli

We consider a novel stochastic multi-armed bandit problem called {\em good arm identification} (GAI), where a good arm is defined as an arm with expected reward greater than or equal to a given threshold. GAI is a pure-exploration problem…

Motivated by real-world applications that necessitate responsible experimentation, we introduce the problem of best arm identification (BAI) with minimal regret. This innovative variant of the multi-armed bandit problem elegantly…

Machine Learning · Computer Science 2024-09-30 Junwen Yang , Vincent Y. F. Tan , Tianyuan Jin

We study a multi-objective pure exploration problem in a multi-armed bandit model. Each arm is associated to an unknown multi-variate distribution and the goal is to identify the distributions whose mean is not uniformly worse than that of…

Machine Learning · Statistics 2025-01-15 Cyrille Kone , Emilie Kaufmann , Laura Richert

In fixed-confidence best arm identification (BAI), the objective is to quickly identify the optimal option while controlling the probability of error below a desired threshold. Despite the plethora of BAI algorithms, existing methods…

Machine Learning · Computer Science 2026-01-05 Brian M. Cho , Nathan Kallus

We consider a variant of the best arm identification task in stochastic multi-armed bandits. Motivated by risk-averse decision-making problems, our goal is to identify a set of $m$ arms with the highest $\tau$-quantile values within a fixed…

Machine Learning · Computer Science 2023-02-22 Mengyan Zhang , Cheng Soon Ong

In this paper, we introduce the constrained best mixed arm identification (CBMAI) problem with a fixed budget. This is a pure exploration problem in a stochastic finite armed bandit model. Each arm is associated with a reward and multiple…

Machine Learning · Computer Science 2024-05-27 Dengwang Tang , Rahul Jain , Ashutosh Nayyar , Pierluigi Nuzzo

We consider the best arm identification problem in the stochastic multi-armed bandit framework where each arm has a tiny probability of realizing large rewards while with overwhelming probability the reward is zero. A key application of…

Machine Learning · Computer Science 2023-03-15 Anirban Bhattacharjee , Sushant Vijayan , Sandeep K Juneja

This study investigates the experimental design problem for identifying the arm with the highest expected outcome, referred to as best arm identification (BAI). In our experiments, the number of treatment-allocation rounds is fixed. During…

Statistics Theory · Mathematics 2024-03-12 Masahiro Kato

In good arm identification (GAI), the goal is to identify one arm whose average performance exceeds a given threshold, referred to as a good arm, if it exists. Few works have studied GAI in the fixed-budget setting when the sampling budget…

Machine Learning · Statistics 2026-01-08 Marc Jourdan , Andrée Delahaye-Duriez , Clémence Réda

We consider the problem of identifying the best arm in a multi-armed bandit model. Despite a wealth of literature in the traditional fixed budget and fixed confidence regimes of the best arm identification problem, it still remains a…

Machine Learning · Statistics 2025-12-08 Michael O. Harding , Kirthevasan Kandasamy

We study the best-arm identification (BAI) problem with a fixed budget and contextual (covariate) information. In each round of an adaptive experiment, after observing contextual information, we choose a treatment arm using past…

Machine Learning · Computer Science 2023-01-05 Masahiro Kato , Masaaki Imaizumi , Takuya Ishihara , Toru Kitagawa

We study the fixed-confidence best arm identification (BAI) problem within the multi-armed bandit (MAB) framework under the Entropic Value-at-Risk (EVaR) criterion. Our analysis considers a nonparametric setting, allowing for general reward…

Machine Learning · Computer Science 2025-10-07 Mehrasa Ahmadipour , Aurélien Garivier