中文
相关论文

相关论文: Multi-Agent Best Arm Identification in Stochastic …

200 篇论文

In bandit best-arm identification, an algorithm is tasked with finding the arm with highest mean reward with a specified accuracy as fast as possible. We study multi-fidelity best-arm identification, in which the algorithm can choose to…

机器学习 · 计算机科学 2025-05-27 Riccardo Poiani , Rémy Degenne , Emilie Kaufmann , Alberto Maria Metelli , Marcello Restelli

We address the M-best-arm identification problem in multi-armed bandits. A player has a limited budget to explore K arms (M<K), and once pulled, each arm yields a reward drawn (independently) from a fixed, unknown distribution. The goal is…

机器学习 · 统计学 2017-07-11 Shahin Shahrampour , Vahid Tarokh

In this paper, we introduce a distributed version of the classical stochastic Multi-Arm Bandit (MAB) problem. Our setting consists of a large number of agents $n$ that collaboratively and simultaneously solve the same instance of $K$ armed…

机器学习 · 计算机科学 2019-11-06 Abishek Sankararaman , Ayalvadi Ganesh , Sanjay Shakkottai

We study the stochastic Multiplayer Multi-Armed Bandit (MMAB) problem, where multiple players select arms to maximize their cumulative rewards. Collisions occur when two or more players select the same arm, resulting in no reward, and are…

机器学习 · 计算机科学 2025-10-09 Daoyuan Zhou , Xuchuang Wang , Lin Yang , Yang Gao

Stochastic Rising Bandits (SRBs) model sequential decision-making problems in which the expected reward of the available options increases every time they are selected. This setting captures a wide range of scenarios in which the available…

We investigate an active pure-exploration setting, that includes best-arm identification, in the context of linear stochastic bandits. While asymptotically optimal algorithms exist for standard multi-arm bandits, the existence of such…

机器学习 · 统计学 2020-07-03 Rémy Degenne , Pierre Ménard , Xuedong Shang , Michal Valko

Stochastic multi-armed bandits are a sequential-decision-making framework, where, at each interaction step, the learner selects an arm and observes a stochastic reward. Within the context of best-arm identification (BAI) problems, the goal…

机器学习 · 计算机科学 2024-01-15 Riccardo Poiani , Alberto Maria Metelli , Marcello Restelli

We consider a stochastic bandit problem with a possibly infinite number of arms. We write $p^*$ for the proportion of optimal arms and $\Delta$ for the minimal mean-gap between optimal and sub-optimal arms. We characterize the optimal…

机器学习 · 计算机科学 2021-11-08 Rianne de Heide , James Cheshire , Pierre Ménard , Alexandra Carpentier

We study the Stochastic Multi-armed Bandit problem under bounded arm-memory. In this setting, the arms arrive in a stream, and the number of arms that can be stored in the memory at any time, is bounded. The decision-maker can only pull…

机器学习 · 计算机科学 2020-12-10 Arnab Maiti , Vishakha Patil , Arindam Khan

Many modern AI and ML problems require evaluating partners' contributions through shared yet asymmetric, computationally intensive processes and the simultaneous selection of the most beneficial candidates. Sequential approaches to these…

机器学习 · 计算机科学 2026-01-01 András Antos , András Millinghoffer , Péter Antal

As users in small cell networks increasingly rely on computation-intensive services, cloud-based access often results in high latency. Multi-access edge computing (MEC) mitigates this by bringing computational resources closer to end users,…

网络与互联网体系结构 · 计算机科学 2026-04-08 Mariam Yahya , Aydin Sezgin , Setareh Maghsudi

We consider the problem of best arm identification in a variant of multi-armed bandits called linked bandits. In a single interaction with linked bandits, multiple arms are played sequentially until one of them receives a positive reward.…

机器学习 · 计算机科学 2019-01-29 Anant Gupta

We investigate the fixed-budget best-arm identification (BAI) problem for linear bandits in a potentially non-stationary environment. Given a finite arm set $\mathcal{X}\subset\mathbb{R}^d$, a fixed budget $T$, and an unpredictable sequence…

机器学习 · 计算机科学 2024-02-16 Zhihan Xiong , Romain Camilleri , Maryam Fazel , Lalit Jain , Kevin Jamieson

This paper introduces a general multi-agent bandit model in which each agent is facing a finite set of arms and may communicate with other agents through a central controller in order to identify, in pure exploration, or play, in regret…

机器学习 · 计算机科学 2022-10-31 Clémence Réda , Sattar Vakili , Emilie Kaufmann

We introduce a new graphical bilinear bandit problem where a learner (or a \emph{central entity}) allocates arms to the nodes of a graph and observes for each edge a noisy bilinear reward representing the interaction between the two end…

机器学习 · 计算机科学 2021-06-14 Geovani Rizk , Albert Thomas , Igor Colin , Rida Laraki , Yann Chevaleyre

Motivated by the need to efficiently identify multiple candidates in high trial-and-error cost tasks such as drug discovery, we propose a near-optimal algorithm to identify all {\epsilon}-best arms (i.e., those at most {\epsilon} worse than…

机器学习 · 统计学 2025-10-02 Zhekai Li , Tianyi Ma , Cheng Hua , Ruihao Zhu

This paper investigates the best arm identification (BAI) problem in stochastic multi-armed bandits in the fixed confidence setting. The general class of the exponential family of bandits is considered. The existing algorithms for the…

机器学习 · 统计学 2023-06-26 Arpan Mukherjee , Ali Tajer

We study the fixed-budget best-arm identification (BAI) problem in non-stationary linear bandits. Concretely, given a fixed time budget $T\in \mathbb{N}$, finite arm set $\mathcal{X} \subset \mathbb{R}^d$, and a potentially adversarial…

机器学习 · 统计学 2026-03-12 Leo Maynard-Zhang , Zhihan Xiong , Kevin Jamieson , Maryam Fazel

We define and analyze a multi-agent multi-armed bandit problem in which decision-making agents can observe the choices and rewards of their neighbors. Neighbors are defined by a network graph with heterogeneous and stochastic…

最优化与控制 · 数学 2019-05-22 Udari Madhushani , Naomi Ehrich Leonard

We consider a variant of the best arm identification task in stochastic multi-armed bandits. Motivated by risk-averse decision-making problems, our goal is to identify a set of $m$ arms with the highest $\tau$-quantile values within a fixed…

机器学习 · 计算机科学 2023-02-22 Mengyan Zhang , Cheng Soon Ong