中文
相关论文

相关论文: Finding All {\epsilon}-Good Arms in Stochastic Ban…

200 篇论文

We study the best-arm identification problem in linear bandit, where the rewards of the arms depend linearly on an unknown parameter $\theta^*$ and the objective is to return the arm with the largest reward. We characterize the complexity…

机器学习 · 计算机科学 2014-11-05 Marta Soare , Alessandro Lazaric , Rémi Munos

We consider the problem of the best arm identification in the presence of stochastic constraints, where there is a finite number of arms associated with multiple performance measures. The goal is to identify the arm that optimizes the…

机器学习 · 计算机科学 2025-01-08 Le Yang , Siyang Gao , Cheng Li , Yi Wang

In bandit best-arm identification, an algorithm is tasked with finding the arm with highest mean reward with a specified accuracy as fast as possible. We study multi-fidelity best-arm identification, in which the algorithm can choose to…

机器学习 · 计算机科学 2025-05-27 Riccardo Poiani , Rémy Degenne , Emilie Kaufmann , Alberto Maria Metelli , Marcello Restelli

Motivated by the need to efficiently identify multiple candidates in high trial-and-error cost tasks such as drug discovery, we propose a near-optimal algorithm to identify all {\epsilon}-best arms (i.e., those at most {\epsilon} worse than…

机器学习 · 统计学 2025-10-02 Zhekai Li , Tianyi Ma , Cheng Hua , Ruihao Zhu

We consider the question introduced by \cite{Mason2020} of identifying all the $\varepsilon$-optimal arms in a finite stochastic multi-armed bandit with Gaussian rewards. We give two lower bounds on the sample complexity of any algorithm…

机器学习 · 统计学 2022-04-07 Aymen Al Marjani , Tomáš Kocák , Aurélien Garivier

We propose the first fully-adaptive algorithm for pure exploration in linear bandits---the task to find the arm with the largest expected reward, which depends on an unknown parameter linearly. While existing methods partially or entirely…

机器学习 · 统计学 2017-10-17 Liyuan Xu , Junya Honda , Masashi Sugiyama

Although many algorithms for the multi-armed bandit problem are well-understood theoretically, empirical confirmation of their effectiveness is generally scarce. This paper presents a thorough empirical study of the most popular multi-armed…

人工智能 · 计算机科学 2014-02-26 Volodymyr Kuleshov , Doina Precup

We study best arm identification in a variant of the multi-armed bandit problem where the learner has limited precision in arm selection. The learner can only sample arms via certain exploration bundles, which we refer to as boxes. In…

机器学习 · 计算机科学 2023-05-11 Kota Srinivas Reddy , P. N. Karthik , Nikhil Karamchandani , Jayakrishnan Nair

We consider the best arm identification problem in the stochastic multi-armed bandit framework where each arm has a tiny probability of realizing large rewards while with overwhelming probability the reward is zero. A key application of…

机器学习 · 计算机科学 2023-03-15 Anirban Bhattacharjee , Sushant Vijayan , Sandeep K Juneja

Motivated by drug design, we consider the best-arm identification problem in generalized linear bandits. More specifically, we assume each arm has a vector of covariates, there is an unknown vector of parameters that is common across the…

机器学习 · 计算机科学 2019-05-21 Abbas Kazerouni , Lawrence M. Wein

We consider a stochastic bandit problem with a possibly infinite number of arms. We write $p^*$ for the proportion of optimal arms and $\Delta$ for the minimal mean-gap between optimal and sub-optimal arms. We characterize the optimal…

机器学习 · 计算机科学 2021-11-08 Rianne de Heide , James Cheshire , Pierre Ménard , Alexandra Carpentier

We consider the problem of best arm identification in a variant of multi-armed bandits called linked bandits. In a single interaction with linked bandits, multiple arms are played sequentially until one of them receives a positive reward.…

机器学习 · 计算机科学 2019-01-29 Anant Gupta

Motivated by the task of hyperparameter optimization, we introduce the non-stochastic best-arm identification problem. Within the multi-armed bandit literature, the cumulative regret objective enjoys algorithms and analyses for both the…

机器学习 · 计算机科学 2015-03-02 Kevin Jamieson , Ameet Talwalkar

We study a grouped bandit setting where each arm comprises multiple independent sub-arms referred to as attributes. Each attribute of each arm has an independent stochastic reward. We impose the constraint that for an arm to be deemed…

机器学习 · 计算机科学 2024-12-12 Sahil Dharod , Malyala Preethi Sravani , Sakshi Heda , Sharayu Moharir

We study a novel pure exploration problem: the $\epsilon$-Thresholding Bandit Problem (TBP) with fixed confidence in stochastic linear bandits. We prove a lower bound for the sample complexity and extend an algorithm designed for Best Arm…

机器学习 · 统计学 2024-02-16 Eduardo Ochoa Rivera , Ambuj Tewari

In multi-armed bandits, the tasks of reward maximization and pure exploration are often at odds with each other. The former focuses on exploiting arms with the highest means, while the latter may require constant exploration across all…

机器学习 · 计算机科学 2024-10-22 Brian Cho , Dominik Meier , Kyra Gan , Nathan Kallus

We study the combinatorial pure exploration problem Best-Set in stochastic multi-armed bandits. In a Best-Set instance, we are given $n$ arms with unknown reward distributions, as well as a family $\mathcal{F}$ of feasible subsets over the…

机器学习 · 计算机科学 2017-06-06 Lijie Chen , Anupam Gupta , Jian Li , Mingda Qiao , Ruosong Wang

We propose EB-TC$\varepsilon$, a novel sampling rule for $\varepsilon$-best arm identification in stochastic bandits. It is the first instance of Top Two algorithm analyzed for approximate best arm identification. EB-TC$\varepsilon$ is an…

机器学习 · 统计学 2023-11-07 Marc Jourdan , Rémy Degenne , Emilie Kaufmann

Identifying the best arm of a multi-armed bandit is a central problem in bandit optimization. We study a quantum computational version of this problem with coherent oracle access to states encoding the reward probabilities of each arm as…

量子物理 · 物理学 2023-02-02 Daochen Wang , Xuchen You , Tongyang Li , Andrew M. Childs

We consider two multi-armed bandit problems with $n$ arms: (i) given an $\epsilon > 0$, identify an arm with mean that is within $\epsilon$ of the largest mean and (ii) given a threshold $\mu_0$ and integer $k$, identify $k$ arms with means…

机器学习 · 统计学 2019-06-18 Julian Katz-Samuels , Kevin Jamieson