English
Related papers

Related papers: Decentralized Learning for Multi-player Multi-arme…

200 papers

For a wireless avionics communication system, a Multi-arm bandit game is mathematically formulated, which includes channel states, strategies, and rewards. The simple case includes only two agents sharing the spectrum which is fully studied…

Signal Processing · Electrical Eng. & Systems 2017-11-15 Jingyang Lu , Lun Li , Dan Shen , Genshe Chen , Bin Jia , Erik Blasch , Khanh Pham

In this paper, we investigate a new multi-armed bandit (MAB) online learning model that considers real-world phenomena in many recommender systems: (i) the learning agent cannot pull the arms by itself and thus has to offer rewards to users…

Machine Learning · Computer Science 2021-06-01 Tianchen Zhou , Jia Liu , Chaosheng Dong , Jingyuan Deng

Motivated by cognitive radio networks, we consider the stochastic multiplayer multi-armed bandit problem, where several players pull arms simultaneously and collisions occur if one of them is pulled by several players at the same stage. We…

Machine Learning · Computer Science 2019-11-20 Etienne Boursier , Vianney Perchet

Sequential decision-making under uncertainty often involves multiple agents learning which actions (arms) yield the highest rewards through repeated interaction with a stochastic environment. This setting is commonly modeled by cooperative…

Systems and Control · Electrical Eng. & Systems 2026-03-25 Evagoras Makridis , Themistoklis Charalambous

We study distributed cooperative decision-making under the explore-exploit tradeoff in the multiarmed bandit (MAB) problem. We extend the state-of-the-art frequentist and Bayesian algorithms for single-agent MAB problems to cooperative…

Systems and Control · Computer Science 2019-09-18 Peter Landgren , Vaibhav Srivastava , Naomi Ehrich Leonard

We consider a decentralized stochastic multi-armed bandit problem with multiple players. Each player aims to maximize his/her own reward by pulling an arm. The arms give rewards based on i.i.d. stochastic Bernoulli distributions. Players…

Machine Learning · Computer Science 2017-12-05 Noyan Evirgen , Alper Kose , Hakan Gokcesu

We consider an N-player multi-armed bandit game where each player chooses one out of M arms for T turns. Each player has different expected rewards for the arms, and the instantaneous rewards are independent and identically distributed or…

Computer Science and Game Theory · Computer Science 2021-04-06 Ilai Bistritz , Amir Leshem

We study a decentralized multi-agent multi-armed bandit problem in which multiple clients are connected by time dependent random graphs provided by an environment. The reward distributions of each arm vary across clients and rewards are…

Machine Learning · Computer Science 2023-10-19 Mengfan Xu , Diego Klabjan

We study a multi-armed bandit problem where the rewards exhibit regime switching. Specifically, the distributions of the random rewards generated from all arms are modulated by a common underlying state modeled as a finite-state Markov…

Machine Learning · Computer Science 2021-02-02 Xiang Zhou , Yi Xiong , Ningyuan Chen , Xuefeng Gao

The classical multi-armed bandit (MAB) problem involves a learner and a collection of K independent arms, each with its own ex ante unknown independent reward distribution. At each one of a finite number of rounds, the learner selects one…

Optimization and Control · Mathematics 2024-05-07 Hongda Hu , Arthur Charpentier , Mario Ghossoub , Alexander Schied

We study two-sided matching markets in which one side of the market (the players) does not have a priori knowledge about its preferences for the other side (the arms) and is required to learn its preferences from experience. Also, we assume…

Machine Learning · Computer Science 2021-06-23 Lydia T. Liu , Feng Ruan , Horia Mania , Michael I. Jordan

We consider a novel multi-arm bandit (MAB) setup, where a learner needs to communicate the actions to distributed agents over erasure channels, while the rewards for the actions are directly available to the learner through external…

Machine Learning · Statistics 2024-06-27 Osama Hanna , Merve Karakas , Lin F. Yang , Christina Fragouli

The multi-armed bandit(MAB) problem is a simple yet powerful framework that has been extensively studied in the context of decision-making under uncertainty. In many real-world applications, such as robotic applications, selecting an arm…

Machine Learning · Computer Science 2023-03-21 Tianpeng Zhang , Kasper Johansson , Na Li

We consider decentralized stochastic multi-armed bandit problem with multiple players in the case of different communication probabilities between players. Each player makes a decision of pulling an arm without cooperation while aiming to…

Machine Learning · Computer Science 2017-11-07 Noyan Evirgen , Alper Kose

We consider a variant of the multi-armed bandit model, which we call multi-armed bandit problem with known trend, where the gambler knows the shape of the reward function of each arm but not its distribution. This new problem is motivated…

Machine Learning · Computer Science 2017-05-15 Djallel Bouneffouf , Raphaël Feraud

We study a variant of the classical multi-armed bandit problem (MABP) which we call as Multi-Armed Bandits with dependent arms. More specifically, multiple arms are grouped together to form a cluster, and the reward distributions of arms…

Machine Learning · Computer Science 2020-10-27 Rahul Singh , Fang Liu , Yin Sun , Ness Shroff

We study exploration in Multi-Armed Bandits in a setting where $k$ players collaborate in order to identify an $\epsilon$-optimal arm. Our motivation comes from recent employment of bandit algorithms in computationally intensive,…

Machine Learning · Computer Science 2013-11-05 Eshcar Hillel , Zohar Karnin , Tomer Koren , Ronny Lempel , Oren Somekh

In recent years, multi-player multi-armed bandits (MP-MAB) have been extensively studied due to their wide applications in cognitive radio networks and Internet of Things systems. While most existing research on MP-MAB focuses on…

Machine Learning · Computer Science 2025-10-01 Jingqi Fan , Canzhe Zhao , Shuai Li , Siwei Wang

In this paper, we introduce a distributed version of the classical stochastic Multi-Arm Bandit (MAB) problem. Our setting consists of a large number of agents $n$ that collaboratively and simultaneously solve the same instance of $K$ armed…

Machine Learning · Computer Science 2019-11-06 Abishek Sankararaman , Ayalvadi Ganesh , Sanjay Shakkottai

We define a general framework for a large class of combinatorial multi-armed bandit (CMAB) problems, where subsets of base arms with unknown distributions form super arms. In each round, a super arm is played and the base arms contained in…

Machine Learning · Computer Science 2016-03-30 Wei Chen , Yajun Wang , Yang Yuan , Qinshi Wang