中文
相关论文

相关论文: Best Arm Identification in Stochastic Bandits: Bey…

200 篇论文

We study best-arm identification in stochastic multi-armed bandits under the fixed-confidence setting, focusing on instances with multiple optimal arms. Unlike prior work that addresses the unknown-number-of-optimal-arms case, we consider…

机器学习 · 计算机科学 2026-03-05 Lan V. Truong

We consider the best arm identification problem in the stochastic multi-armed bandit framework where each arm has a tiny probability of realizing large rewards while with overwhelming probability the reward is zero. A key application of…

机器学习 · 计算机科学 2023-03-15 Anirban Bhattacharjee , Sushant Vijayan , Sandeep K Juneja

We study best arm identification (BAI) in linear bandits in the fixed-budget regime under differential privacy constraints, when the arm rewards are supported on the unit interval. Given a finite budget $T$ and a privacy parameter…

机器学习 · 计算机科学 2024-01-18 Zhirui Chen , P. N. Karthik , Yeow Meng Chee , Vincent Y. F. Tan

We study the problem of Bayesian fixed-budget best-arm identification (BAI) in structured bandits. We propose an algorithm that uses fixed allocations based on the prior information and the structure of the environment. We provide…

机器学习 · 统计学 2025-04-28 Nicolas Nguyen , Imad Aouali , András György , Claire Vernade

Stochastic Rising Bandits (SRBs) model sequential decision-making problems in which the expected reward of the available options increases every time they are selected. This setting captures a wide range of scenarios in which the available…

This paper studies two variants of the best arm identification (BAI) problem under the streaming model, where we have a stream of $n$ arms with reward distributions supported on $[0,1]$ with unknown means. The arms in the stream are…

机器学习 · 计算机科学 2024-10-24 Tianyuan Jin , Keke Huang , Jing Tang , Xiaokui Xiao

Top-$2$ methods have become popular in solving the best arm identification (BAI) problem. The best arm, or the arm with the largest mean amongst finitely many, is identified through an algorithm that at any sequential step independently…

机器学习 · 计算机科学 2024-12-17 Agniv Bandyopadhyay , Sandeep Juneja , Shubhada Agrawal

We study the fixed-confidence best arm identification (BAI) problem within the multi-armed bandit (MAB) framework under the Entropic Value-at-Risk (EVaR) criterion. Our analysis considers a nonparametric setting, allowing for general reward…

机器学习 · 计算机科学 2025-10-07 Mehrasa Ahmadipour , Aurélien Garivier

We give a new algorithm for best arm identification in linearly parameterised bandits in the fixed confidence setting. The algorithm generalises the well-known LUCB algorithm of Kalyanakrishnan et al. (2012) by playing an arm which…

机器学习 · 计算机科学 2019-11-11 Mohammadi Zaki , Avinash Mohan , Aditya Gopalan

We study the problem of best arm identification in linear bandits in the fixed-budget setting. By leveraging properties of the G-optimal design and incorporating it into the arm allocation rule, we design a parameter-free algorithm, Optimal…

机器学习 · 计算机科学 2022-09-22 Junwen Yang , Vincent Y. F. Tan

We study the robust best-arm identification problem (RBAI) in the case of linear rewards. The primary objective is to identify a near-optimal robust arm, which involves selecting arms at every round and assessing their robustness by…

机器学习 · 计算机科学 2023-11-09 Wei Wang , Sattar Vakili , Ilija Bogunovic

We consider a multi-armed bandit setting with finitely many arms, in which each arm yields an $M$-dimensional vector reward upon selection. We assume that the reward of each dimension (a.k.a. {\em objective}) is generated independently of…

机器学习 · 计算机科学 2025-01-24 Zhirui Chen , P. N. Karthik , Yeow Meng Chee , Vincent Y. F. Tan

In fixed-confidence best arm identification (BAI), the objective is to quickly identify the optimal option while controlling the probability of error below a desired threshold. Despite the plethora of BAI algorithms, existing methods…

机器学习 · 计算机科学 2026-01-05 Brian M. Cho , Nathan Kallus

This paper studies the fixed-confidence best arm identification (BAI) problem in the bandit framework in the canonical single-parameter exponential models. For this problem, many policies have been proposed, but most of them require solving…

机器学习 · 统计学 2025-08-12 Jongyeong Lee , Junya Honda , Masashi Sugiyama

In multi-armed bandits, the tasks of reward maximization and pure exploration are often at odds with each other. The former focuses on exploiting arms with the highest means, while the latter may require constant exploration across all…

机器学习 · 计算机科学 2024-10-22 Brian Cho , Dominik Meier , Kyra Gan , Nathan Kallus

Motivated by real-world applications that necessitate responsible experimentation, we introduce the problem of best arm identification (BAI) with minimal regret. This innovative variant of the multi-armed bandit problem elegantly…

机器学习 · 计算机科学 2024-09-30 Junwen Yang , Vincent Y. F. Tan , Tianyuan Jin

We consider a stochastic bandit problem with a possibly infinite number of arms. We write $p^*$ for the proportion of optimal arms and $\Delta$ for the minimal mean-gap between optimal and sub-optimal arms. We characterize the optimal…

机器学习 · 计算机科学 2021-11-08 Rianne de Heide , James Cheshire , Pierre Ménard , Alexandra Carpentier

We consider a variant of the best arm identification (BAI) problem in multi-armed bandits (MAB) in which there are two sets of arms (source and target), and the objective is to determine the best target arm while only pulling source arms.…

机器学习 · 计算机科学 2021-12-09 Ojash Neopane , Aaditya Ramdas , Aarti Singh

We study the best-arm identification problem in linear bandit, where the rewards of the arms depend linearly on an unknown parameter $\theta^*$ and the objective is to return the arm with the largest reward. We characterize the complexity…

机器学习 · 计算机科学 2014-11-05 Marta Soare , Alessandro Lazaric , Rémi Munos

The stochastic multi-armed bandit model is a simple abstraction that has proven useful in many different contexts in statistics and machine learning. Whereas the achievable limit in terms of regret minimization is now well known, our aim is…

机器学习 · 统计学 2016-11-15 Emilie Kaufmann , Olivier Cappé , Aurélien Garivier