中文
相关论文

相关论文: On the Optimal Sample Complexity for Best Arm Iden…

200 篇论文

The improving multi-armed bandits problem is a formal model for allocating effort under uncertainty, motivated by scenarios such as investing research effort into new technologies, performing clinical trials, and hyperparameter selection…

机器学习 · 计算机科学 2026-05-22 Avrim Blum , Marten Garicano , Kavya Ravichandran , Dravyansh Sharma

We consider the best arm identification problem, where the goal is to identify the arm with the highest mean reward from a set of $K$ arms under a limited sampling budget. This problem models many practical scenarios such as A/B testing. We…

机器学习 · 统计学 2026-05-05 Junpei Komiyama , Kyoungseok Jang , Junya Honda

We study the fixed-budget best-arm identification (BAI) problem in non-stationary linear bandits. Concretely, given a fixed time budget $T\in \mathbb{N}$, finite arm set $\mathcal{X} \subset \mathbb{R}^d$, and a potentially adversarial…

机器学习 · 统计学 2026-03-12 Leo Maynard-Zhang , Zhihan Xiong , Kevin Jamieson , Maryam Fazel

We study the robust best-arm identification problem (RBAI) in the case of linear rewards. The primary objective is to identify a near-optimal robust arm, which involves selecting arms at every round and assessing their robustness by…

机器学习 · 计算机科学 2023-11-09 Wei Wang , Sattar Vakili , Ilija Bogunovic

In fixed budget bandit identification, an algorithm sequentially observes samples from several distributions up to a given final time. It then answers a query about the set of distributions. A good algorithm will have a small probability of…

机器学习 · 统计学 2023-07-03 Rémy Degenne

This paper investigates a hitherto unaddressed aspect of best arm identification (BAI) in stochastic multi-armed bandits in the fixed-confidence setting. Two key metrics for assessing bandit algorithms are computational efficiency and…

机器学习 · 统计学 2023-06-26 Arpan Mukherjee , Ali Tajer

We study the pure exploration problem subject to a matroid constraint (Best-Basis) in a stochastic multi-armed bandit game. In a Best-Basis instance, we are given $n$ stochastic arms with unknown reward distributions, as well as a matroid…

机器学习 · 计算机科学 2016-05-26 Lijie Chen , Anupam Gupta , Jian Li

We consider the problem of identifying any $k$ out of the best $m$ arms in an $n$-armed stochastic multi-armed bandit. Framed in the PAC setting, this particular problem generalises both the problem of `best subset selection' and that of…

机器学习 · 计算机科学 2019-01-25 Arghya Roy Chaudhuri , Shivaram Kalyanakrishnan

This paper studies the problem of identifying any $k$ distinct arms among the top $\rho$ fraction (e.g., top 5\%) of arms from a finite or infinite set with a probably approximately correct (PAC) tolerance $\epsilon$. We consider two cases:…

机器学习 · 计算机科学 2020-11-20 Wenbo Ren , Jia Liu , Ness Shroff

In this paper, we introduce a multi-armed bandit problem termed max-min grouped bandits, in which the arms are arranged in possibly-overlapping groups, and the goal is to find the group whose worst arm has the highest mean reward. This…

机器学习 · 统计学 2022-03-16 Zhenlin Wang , Jonathan Scarlett

Fixed-budget best-arm identification (BAI) is a bandit problem where the agent maximizes the probability of identifying the optimal arm within a fixed budget of observations. In this work, we study this problem in the Bayesian setting. We…

机器学习 · 计算机科学 2023-06-16 Alexia Atsidakou , Sumeet Katariya , Sujay Sanghavi , Branislav Kveton

We consider the problem of \textit{best arm identification} with a \textit{fixed budget $T$}, in the $K$-armed stochastic bandit setting, with arms distribution defined on $[0,1]$. We prove that any bandit strategy, for at least one bandit…

机器学习 · 统计学 2016-05-31 Alexandra Carpentier , Andrea Locatelli

This paper investigates the best arm identification (BAI) problem in stochastic multi-armed bandits in the fixed confidence setting. The general class of the exponential family of bandits is considered. The existing algorithms for the…

机器学习 · 统计学 2023-06-26 Arpan Mukherjee , Ali Tajer

This study investigates the experimental design problem for identifying the arm with the highest expected outcome, referred to as best arm identification (BAI). In our experiments, the number of treatment-allocation rounds is fixed. During…

统计理论 · 数学 2024-03-12 Masahiro Kato

We consider the problem of identifying the best arm in a multi-armed bandit model. Despite a wealth of literature in the traditional fixed budget and fixed confidence regimes of the best arm identification problem, it still remains a…

机器学习 · 统计学 2025-12-08 Michael O. Harding , Kirthevasan Kandasamy

We consider the problem of near-optimal arm identification in the fixed confidence setting of the infinitely armed bandit problem when nothing is known about the arm reservoir distribution. We (1) introduce a PAC-like framework within which…

机器学习 · 统计学 2018-05-22 Maryam Aziz , Jesse Anderton , Emilie Kaufmann , Javed Aslam

Recently multi-armed bandit problem arises in many real-life scenarios where arms must be sampled in batches, due to limited time the agent can wait for the feedback. Such applications include biological experimentation and online…

机器学习 · 统计学 2023-12-22 Shengyu Cao , Simai He , Ruoqing Jiang , Jin Xu , Hongsong Yuan

In the infinite-armed bandit problem, each arm's average reward is sampled from an unknown distribution, and each arm can be sampled further to obtain noisy estimates of the average reward of that arm. Prior work focuses on identifying the…

机器学习 · 计算机科学 2022-11-04 Yifei Wang , Tavor Baharav , Yanjun Han , Jiantao Jiao , David Tse

Consider the problem of best arm identification with a security constraint. Specifically, assume a setup of stochastic linear bandits with $K$ arms of dimension $d$. In each arm pull, the player receives a reward that is the sum of the dot…

机器学习 · 计算机科学 2025-07-29 Asaf Cohen , Onur Günlü

We study the problem of best arm identification in linearly parameterised multi-armed bandits. Given a set of feature vectors $\mathcal{X}\subset\mathbb{R}^d,$ a confidence parameter $\delta$ and an unknown vector $\theta^*,$ the goal is to…

机器学习 · 计算机科学 2020-06-16 Mohammadi Zaki , Avi Mohan , Aditya Gopalan