English
Related papers

Related papers: Best Arm Identification with Contextual Informatio…

200 papers

We consider the fixed-budget best arm identification problem where the goal is to find the arm of the largest mean with a fixed number of samples. It is known that the probability of misidentifying the best arm is exponentially small to the…

Machine Learning · Statistics 2022-10-28 Junpei Komiyama , Taira Tsuchiya , Junya Honda

This paper studies two variants of the best arm identification (BAI) problem under the streaming model, where we have a stream of $n$ arms with reward distributions supported on $[0,1]$ with unknown means. The arms in the stream are…

Machine Learning · Computer Science 2024-10-24 Tianyuan Jin , Keke Huang , Jing Tang , Xiaokui Xiao

We study the best-arm identification problem in linear bandit, where the rewards of the arms depend linearly on an unknown parameter $\theta^*$ and the objective is to return the arm with the largest reward. We characterize the complexity…

Machine Learning · Computer Science 2014-11-05 Marta Soare , Alessandro Lazaric , Rémi Munos

This study investigates minimax and Bayes optimal strategies for fixed-budget best-arm identification. We consider an adaptive procedure consisting of a sampling phase followed by a recommendation phase, and we design an adaptive experiment…

Econometrics · Economics 2026-02-05 Masahiro Kato

This paper investigates the best arm identification (BAI) problem in stochastic multi-armed bandits in the fixed confidence setting. The general class of the exponential family of bandits is considered. The existing algorithms for the…

Machine Learning · Statistics 2023-06-26 Arpan Mukherjee , Ali Tajer

Top-$2$ methods have become popular in solving the best arm identification (BAI) problem. The best arm, or the arm with the largest mean amongst finitely many, is identified through an algorithm that at any sequential step independently…

Machine Learning · Computer Science 2024-12-17 Agniv Bandyopadhyay , Sandeep Juneja , Shubhada Agrawal

This paper considers a stochastic Multi-Armed Bandit (MAB) problem with dual objectives: (i) quick identification and commitment to the optimal arm, and (ii) reward maximization throughout a sequence of $T$ consecutive rounds. Though each…

Machine Learning · Computer Science 2024-05-31 Qining Zhang , Lei Ying

Motivated by the task of hyperparameter optimization, we introduce the non-stochastic best-arm identification problem. Within the multi-armed bandit literature, the cumulative regret objective enjoys algorithms and analyses for both the…

Machine Learning · Computer Science 2015-03-02 Kevin Jamieson , Ameet Talwalkar

The challenge of identifying the best feasible arm within a fixed budget has attracted considerable interest in recent years. However, a notable gap remains in the literature: the exact exponential rate at which the error probability…

Machine Learning · Computer Science 2025-06-04 Jie Bian , Vincent Y. F. Tan

We consider a variant of the best arm identification task in stochastic multi-armed bandits. Motivated by risk-averse decision-making problems, our goal is to identify a set of $m$ arms with the highest $\tau$-quantile values within a fixed…

Machine Learning · Computer Science 2023-02-22 Mengyan Zhang , Cheng Soon Ong

We study a grouped bandit setting where each arm comprises multiple independent sub-arms referred to as attributes. Each attribute of each arm has an independent stochastic reward. We impose the constraint that for an arm to be deemed…

Machine Learning · Computer Science 2024-12-12 Sahil Dharod , Malyala Preethi Sravani , Sakshi Heda , Sharayu Moharir

In many applications, e.g. in healthcare and e-commerce, the goal of a contextual bandit may be to learn an optimal treatment assignment policy at the end of the experiment. That is, to minimize simple regret. However, this objective…

Machine Learning · Computer Science 2023-11-06 Sanath Kumar Krishnamurthy , Ruohan Zhan , Susan Athey , Emma Brunskill

In multi-armed bandit problems, the typical goal is to identify the arm with the highest reward. This paper explores a threshold-based bandit problem, aiming to select an arm based on its relation to a prescribed threshold \(\tau \). We…

Machine Learning · Computer Science 2025-09-03 Chanakya Varude , Jay Chaudhary , Siddharth Kaushik , Prasanna Chaporkar

Stochastic multi-armed bandits are a sequential-decision-making framework, where, at each interaction step, the learner selects an arm and observes a stochastic reward. Within the context of best-arm identification (BAI) problems, the goal…

Machine Learning · Computer Science 2024-01-15 Riccardo Poiani , Alberto Maria Metelli , Marcello Restelli

We study the problem of identifying the best arm in a stochastic multi-armed bandit game. Given a set of $n$ arms indexed from $1$ to $n$, each arm $i$ is associated with an unknown reward distribution supported on $[0,1]$ with mean…

Machine Learning · Computer Science 2023-05-30 Pinyan Lu , Chao Tao , Xiaojin Zhang

We introduce the problem of best arm identification (BAI) with post-action context, a new BAI problem in a stochastic multi-armed bandit environment and the fixed-confidence setting. The problem addresses the scenarios in which the learner…

Machine Learning · Computer Science 2026-05-13 Mohammad Shahverdikondori , Amir Mohammad Abouei , Alireza Rezaeimoghadam , Negar Kiyavash

We study the best-arm identification problem in multi-armed bandits with stochastic, potentially private rewards, when the goal is to identify the arm with the highest quantile at a fixed, prescribed level. First, we propose a (non-private)…

Machine Learning · Statistics 2022-12-06 Kontantinos E. Nikolakakis , Dionysios S. Kalogerias , Or Sheffet , Anand D. Sarwate

We give a complete characterization of the complexity of best-arm identification in one-parameter bandit problems. We prove a new, tight lower bound on the sample complexity. We propose the `Track-and-Stop' strategy, which we prove to be…

Statistics Theory · Mathematics 2016-06-02 Aurélien Garivier , Emilie Kaufmann

We consider the best arm identification problem, where the goal is to identify the arm with the highest mean reward from a set of $K$ arms under a limited sampling budget. This problem models many practical scenarios such as A/B testing. We…

Machine Learning · Statistics 2026-05-05 Junpei Komiyama , Kyoungseok Jang , Junya Honda

In the classical best arm identification (Best-$1$-Arm) problem, we are given $n$ stochastic bandit arms, each associated with a reward distribution with an unknown mean. We would like to identify the arm with the largest mean with…

Machine Learning · Computer Science 2017-05-25 Lijie Chen , Jian Li , Mingda Qiao