中文
相关论文

相关论文: Pure Exploration in Bandits with Linear Constraint…

200 篇论文

We study the problem of best-arm identification with fixed confidence in stochastic linear bandits. The objective is to identify the best arm with a given level of certainty while minimizing the sampling budget. We devise a simple algorithm…

机器学习 · 统计学 2020-06-30 Yassir Jedra , Alexandre Proutiere

The best arm identification problem in the multi-armed bandit setting is an excellent model of many real-world decision-making problems, yet it fails to capture the fact that in the real-world, safety constraints often must be met while…

机器学习 · 计算机科学 2021-11-25 Zhenlin Wang , Andrew Wagenmaker , Kevin Jamieson

We investigate an active pure-exploration setting, that includes best-arm identification, in the context of linear stochastic bandits. While asymptotically optimal algorithms exist for standard multi-arm bandits, the existence of such…

机器学习 · 统计学 2020-07-03 Rémy Degenne , Pierre Ménard , Xuedong Shang , Michal Valko

We study best-arm identification in stochastic multi-armed bandits under the fixed-confidence setting, focusing on instances with multiple optimal arms. Unlike prior work that addresses the unknown-number-of-optimal-arms case, we consider…

机器学习 · 计算机科学 2026-03-05 Lan V. Truong

We consider the problem of near-optimal arm identification in the fixed confidence setting of the infinitely armed bandit problem when nothing is known about the arm reservoir distribution. We (1) introduce a PAC-like framework within which…

机器学习 · 统计学 2018-05-22 Maryam Aziz , Jesse Anderton , Emilie Kaufmann , Javed Aslam

We consider a multi-armed bandit setting with finitely many arms, in which each arm yields an $M$-dimensional vector reward upon selection. We assume that the reward of each dimension (a.k.a. {\em objective}) is generated independently of…

机器学习 · 计算机科学 2025-01-24 Zhirui Chen , P. N. Karthik , Yeow Meng Chee , Vincent Y. F. Tan

We give a complete characterization of the complexity of best-arm identification in one-parameter bandit problems. We prove a new, tight lower bound on the sample complexity. We propose the `Track-and-Stop' strategy, which we prove to be…

统计理论 · 数学 2016-06-02 Aurélien Garivier , Emilie Kaufmann

We study the fixed-confidence best-arm identification problem in unimodal bandits, in which the means of the arms increase with the index of the arm up to their maximum, then decrease. We derive two lower bounds on the stopping time of any…

机器学习 · 计算机科学 2025-05-27 Riccardo Poiani , Marc Jourdan , Emilie Kaufmann , Rémy Degenne

We study best arm identification in a variant of the multi-armed bandit problem where the learner has limited precision in arm selection. The learner can only sample arms via certain exploration bundles, which we refer to as boxes. In…

机器学习 · 计算机科学 2023-05-11 Kota Srinivas Reddy , P. N. Karthik , Nikhil Karamchandani , Jayakrishnan Nair

We study the best-arm identification problem in linear bandit, where the rewards of the arms depend linearly on an unknown parameter $\theta^*$ and the objective is to return the arm with the largest reward. We characterize the complexity…

机器学习 · 计算机科学 2014-11-05 Marta Soare , Alessandro Lazaric , Rémi Munos

We study a specific \textit{combinatorial pure exploration stochastic bandit problem} where the learner aims at finding the set of arms whose means are above a given threshold, up to a given precision, and \textit{for a fixed time horizon}.…

机器学习 · 统计学 2016-05-30 Andrea Locatelli , Maurilio Gutzeit , Alexandra Carpentier

We consider the problem of \textit{best arm identification} with a \textit{fixed budget $T$}, in the $K$-armed stochastic bandit setting, with arms distribution defined on $[0,1]$. We prove that any bandit strategy, for at least one bandit…

机器学习 · 统计学 2016-05-31 Alexandra Carpentier , Andrea Locatelli

In this paper, we consider a best action identification problem in the stochastic linear bandit setup with a fixed confident constraint. In the considered best action identification problem, instead of minimizing the accumulative regret as…

机器学习 · 计算机科学 2018-12-04 Jun Geng , Lifeng Lai

In bandit best-arm identification, an algorithm is tasked with finding the arm with highest mean reward with a specified accuracy as fast as possible. We study multi-fidelity best-arm identification, in which the algorithm can choose to…

机器学习 · 计算机科学 2025-05-27 Riccardo Poiani , Rémy Degenne , Emilie Kaufmann , Alberto Maria Metelli , Marcello Restelli

We consider a constrained, pure exploration, stochastic multi-armed bandit formulation under a fixed budget. Each arm is associated with an unknown, possibly multi-dimensional distribution and is described by multiple attributes that are a…

机器学习 · 计算机科学 2022-11-29 Fathima Zarin Faizal , Jayakrishnan Nair

Active learning methods have shown great promise in reducing the number of samples necessary for learning. As automated learning systems are adopted into real-time, real-world decision-making pipelines, it is increasingly important that…

机器学习 · 计算机科学 2022-06-23 Romain Camilleri , Andrew Wagenmaker , Jamie Morgenstern , Lalit Jain , Kevin Jamieson

In pure-exploration problems, information is gathered sequentially to answer a question on the stochastic environment. While best-arm identification for linear bandits has been extensively studied in recent years, few works have been…

机器学习 · 统计学 2022-06-10 Marc Jourdan , Rémy Degenne

We study a grouped bandit setting where each arm comprises multiple independent sub-arms referred to as attributes. Each attribute of each arm has an independent stochastic reward. We impose the constraint that for an arm to be deemed…

机器学习 · 计算机科学 2024-12-12 Sahil Dharod , Malyala Preethi Sravani , Sakshi Heda , Sharayu Moharir

In a fixed-confidence pure exploration problem in stochastic multi-armed bandits, an algorithm iteratively samples arms and should stop as early as possible and return the correct answer to a query about the arms distributions. We are…

机器学习 · 计算机科学 2025-02-04 Adrienne Tuynman , Rémy Degenne

We study the pure exploration problem subject to a matroid constraint (Best-Basis) in a stochastic multi-armed bandit game. In a Best-Basis instance, we are given $n$ stochastic arms with unknown reward distributions, as well as a matroid…

机器学习 · 计算机科学 2016-05-26 Lijie Chen , Anupam Gupta , Jian Li
‹ 上一页 1 2 3 10 下一页 ›