English
Related papers

Related papers: Decentralized Exploration in Multi-Armed Bandits -…

200 papers

In order to distribute the best arm identification task as close as possible to the user's devices, on the edge of the Radio Access Network, we propose a new problem setting, where distributed players collaborate to find the best arm. This…

Artificial Intelligence · Computer Science 2017-03-30 Raphaël Féraud

Multi-player multi-armed bandit is an increasingly relevant decision-making problem, motivated by applications to cognitive radio systems. Most research for this problem focuses exclusively on the settings that players have \textit{full…

Machine Learning · Computer Science 2022-12-14 Guojun Xiong , Jian Li

We consider the best-arm identification problem in multi-armed bandits, which focuses purely on exploration. A player is given a fixed budget to explore a finite set of arms, and the rewards of each arm are drawn independently from a fixed,…

Machine Learning · Statistics 2017-08-02 Shahin Shahrampour , Mohammad Noshad , Vahid Tarokh

Best arm identification (or, pure exploration) in multi-armed bandits is a fundamental problem in machine learning. In this paper we study the distributed version of this problem where we have multiple agents, and they want to learn the…

Machine Learning · Computer Science 2019-09-02 Chao Tao , Qin Zhang , Yuan Zhou

In recent years, multi-player multi-armed bandits (MP-MAB) have been extensively studied due to their wide applications in cognitive radio networks and Internet of Things systems. While most existing research on MP-MAB focuses on…

Machine Learning · Computer Science 2025-10-01 Jingqi Fan , Canzhe Zhao , Shuai Li , Siwei Wang

We study the best-arm identification problem in multi-armed bandits with stochastic, potentially private rewards, when the goal is to identify the arm with the highest quantile at a fixed, prescribed level. First, we propose a (non-private)…

Machine Learning · Statistics 2022-12-06 Kontantinos E. Nikolakakis , Dionysios S. Kalogerias , Or Sheffet , Anand D. Sarwate

Pure exploration in multi-armed bandits has emerged as an important framework for modeling decision-making and search under uncertainty. In modern applications, however, one is often faced with a tremendously large number of options. Even…

Machine Learning · Computer Science 2022-11-22 Parth K. Thaker , Mohit Malu , Nikhil Rao , Gautam Dasarathy

The paper addresses the Multiplayer Multi-Armed Bandit (MMAB) problem, where $M$ decision makers or players collaborate to maximize their cumulative reward. When several players select the same arm, a collision occurs and no reward is…

Machine Learning · Computer Science 2019-10-29 Alexandre Proutiere , Po-An Wang

We consider a multi-armed bandit problem where the decision maker can explore and exploit different arms at every round. The exploited arm adds to the decision maker's cumulative reward (without necessarily observing the reward) while the…

Machine Learning · Computer Science 2012-07-03 Orly Avner , Shie Mannor , Ohad Shamir

We consider the problem of best arm identification in a variant of multi-armed bandits called linked bandits. In a single interaction with linked bandits, multiple arms are played sequentially until one of them receives a positive reward.…

Machine Learning · Computer Science 2019-01-29 Anant Gupta

We consider a decentralized stochastic multi-armed bandit problem with multiple players. Each player aims to maximize his/her own reward by pulling an arm. The arms give rewards based on i.i.d. stochastic Bernoulli distributions. Players…

Machine Learning · Computer Science 2017-12-05 Noyan Evirgen , Alper Kose , Hakan Gokcesu

This paper investigates the problem of best arm identification in $\textit{contaminated}$ stochastic multi-arm bandits. In this setting, the rewards obtained from any arm are replaced by samples from an adversarial model with probability…

Machine Learning · Computer Science 2021-11-16 Arpan Mukherjee , Ali Tajer , Pin-Yu Chen , Payel Das

We study a decentralized cooperative stochastic multi-armed bandit problem with $K$ arms on a network of $N$ agents. In our model, the reward distribution of each arm is the same for each agent and rewards are drawn independently across…

Machine Learning · Computer Science 2019-10-25 David Martínez-Rubio , Varun Kanade , Patrick Rebeschini

We study the federated pure exploration problem of multi-armed bandits and linear bandits, where $M$ agents cooperatively identify the best arm via communicating with the central server. To enhance the robustness against latency and…

Machine Learning · Computer Science 2024-10-01 Zichen Wang , Chuanhao Li , Chenyu Song , Lianghui Wang , Quanquan Gu , Huazheng Wang

Consider the problem of best arm identification with a security constraint. Specifically, assume a setup of stochastic linear bandits with $K$ arms of dimension $d$. In each arm pull, the player receives a reward that is the sum of the dot…

Machine Learning · Computer Science 2025-07-29 Asaf Cohen , Onur Günlü

In this paper, we study the stochastic linear bandit problem under the additional requirements of differential privacy, robustness and batched observations. In particular, we assume an adversary randomly chooses a constant fraction of the…

Machine Learning · Computer Science 2023-04-25 Vasileios Charisopoulos , Hossein Esfandiari , Vahab Mirrokni

In bandit best-arm identification, an algorithm is tasked with finding the arm with highest mean reward with a specified accuracy as fast as possible. We study multi-fidelity best-arm identification, in which the algorithm can choose to…

Machine Learning · Computer Science 2025-05-27 Riccardo Poiani , Rémy Degenne , Emilie Kaufmann , Alberto Maria Metelli , Marcello Restelli

We consider a multi-armed bandit setting with finitely many arms, in which each arm yields an $M$-dimensional vector reward upon selection. We assume that the reward of each dimension (a.k.a. {\em objective}) is generated independently of…

Machine Learning · Computer Science 2025-01-24 Zhirui Chen , P. N. Karthik , Yeow Meng Chee , Vincent Y. F. Tan

We consider decentralized restless multi-armed bandit problems with unknown dynamics and multiple players. The reward state of each arm transits according to an unknown Markovian rule when it is played and evolves according to an arbitrary…

Optimization and Control · Mathematics 2011-02-16 Haoyang Liu , Keqin Liu , Qing Zhao

We study exploration in Multi-Armed Bandits in a setting where $k$ players collaborate in order to identify an $\epsilon$-optimal arm. Our motivation comes from recent employment of bandit algorithms in computationally intensive,…

Machine Learning · Computer Science 2013-11-05 Eshcar Hillel , Zohar Karnin , Tomer Koren , Ronny Lempel , Oren Somekh
‹ Prev 1 2 3 10 Next ›