English
Related papers

Related papers: Competing for Shareable Arms in Multi-Player Multi…

200 papers

We propose a novel formulation of group fairness with biased feedback in the contextual multi-armed bandit (CMAB) setting. In the CMAB setting, a sequential decision maker must, at each time step, choose an arm to pull from a finite set of…

Machine Learning · Computer Science 2022-02-17 Candice Schumann , Zhi Lang , Nicholas Mattei , John P. Dickerson

Consider N cooperative but non-communicating players where each plays one out of M arms for T turns. Players have different utilities for each arm, representable as an NxM matrix. These utilities are unknown to the players. In each turn…

Computer Science and Game Theory · Computer Science 2020-08-24 Ilai Bistritz , Tavor Z. Baharav , Amir Leshem , Nicholas Bambos

We consider a multi-player multi-armed bandit setting in the presence of adversaries that attempt to negatively affect the rewards received by the players in the system. The reward distributions for any given arm are heterogeneous across…

Machine Learning · Statistics 2025-01-31 Akshayaa Magesh , Venugopal V. Veeravalli

This paper introduces the informational multi-armed bandit (IMAB) model in which at each round, a player chooses an arm, observes a symbol, and receives an unobserved reward in the form of the symbol's self-information. Thus, the expected…

Information Theory · Computer Science 2022-09-07 Nir Weinberger , Michal Yemini

Restless multi-armed bandits (RMABs) generalize the multi-armed bandits where each arm exhibits Markovian behavior and transitions according to their transition dynamics. Solutions to RMAB exist for both offline and online cases. However,…

Machine Learning · Computer Science 2024-02-12 Archit Sood , Shweta Jain , Sujit Gujar

We study EgalMAB, an egalitarian assignment problem in the context of stochastic multi-armed bandits. In EgalMAB, an agent is tasked with assigning a set of users to arms. At each time step, the agent must assign exactly one arm to each…

Machine Learning · Statistics 2024-10-10 Eugene Lim , Vincent Y. F. Tan , Harold Soh

We study the Improving Multi-Armed Bandit (IMAB) problem, where the reward obtained from an arm increases with the number of pulls it receives. This model provides an elegant abstraction for many real-world problems in domains such as…

Machine Learning · Computer Science 2022-08-22 Vishakha Patil , Vineet Nair , Ganesh Ghalme , Arindam Khan

Multi-player Multi-Armed Bandits (MAB) have been extensively studied in the literature, motivated by applications to Cognitive Radio systems. Driven by such applications as well, we motivate the introduction of several levels of feedback…

Machine Learning · Statistics 2019-04-30 Lilian Besson , Emilie Kaufmann

Humans possess innate collaborative capacities. However, effective teamwork often remains challenging. This study delves into the feasibility of collaboration within teams of rational, self-interested agents who engage in teamwork without…

Multiagent Systems · Computer Science 2024-09-27 Alejandra López de Aberasturi Gómez , Carles Sierra , Jordi Sabater-Mir

Cooperative multi-agent multi-armed bandits (CMA2B) consider the collaborative efforts of multiple agents in a shared multi-armed bandit game. We study latent vulnerabilities exposed by this collaboration and consider adversarial attacks on…

Machine Learning · Computer Science 2023-11-06 Jinhang Zuo , Zhiyao Zhang , Xuchuang Wang , Cheng Chen , Shuai Li , John C. S. Lui , Mohammad Hajiesmaili , Adam Wierman

In this paper, we investigate a new multi-armed bandit (MAB) online learning model that considers real-world phenomena in many recommender systems: (i) the learning agent cannot pull the arms by itself and thus has to offer rewards to users…

Machine Learning · Computer Science 2021-06-01 Tianchen Zhou , Jia Liu , Chaosheng Dong , Jingyuan Deng

This paper considers information sharing in a multi-player repeated game. Every round, each player observes a subset of components of a random vector and then takes a control action. The utility earned by each player depends on the full…

Optimization and Control · Mathematics 2014-12-31 Michael J. Neely

Multiplayer games with selfish agents naturally occur in the design of distributed and embedded systems. As the goals of selfish agents are usually neither equivalent nor antagonistic to each other, such games are non zero-sum games. We…

Computer Science and Game Theory · Computer Science 2012-12-19 Thomas Brihaye , Julie De Pril , Sven Schewe

In many real-world applications, multiple agents seek to learn how to perform highly related yet slightly different tasks in an online bandit learning protocol. We formulate this problem as the $\epsilon$-multi-player multi-armed bandit…

Machine Learning · Computer Science 2021-07-21 Zhi Wang , Chicheng Zhang , Manish Kumar Singh , Laurel D. Riek , Kamalika Chaudhuri

Motivated by cognitive radio networks, we consider the stochastic multiplayer multi-armed bandit problem, where several players pull arms simultaneously and collisions occur if one of them is pulled by several players at the same stage. We…

Machine Learning · Computer Science 2019-11-20 Etienne Boursier , Vianney Perchet

This paper considers an online multi-player resource-sharing game with bandit feedback. Multiple players choose from a finite collection of resources in a time slotted system. In each time slot, each resource brings a random reward that is…

Computer Science and Game Theory · Computer Science 2025-02-18 Mevan Wijewardena , Michael. J Neely

We study the nonstationary stochastic Multi-Armed Bandit (MAB) problem in which the distribution of rewards associated with each arm are assumed to be time-varying and the total variation in the expected rewards is subject to a variation…

Machine Learning · Computer Science 2021-01-25 Lai Wei , Vaibhav Srivastava

We study fairness within the stochastic, \emph{multi-armed bandit} (MAB) decision making framework. We adapt the fairness framework of "treating similar individuals similarly" to this setting. Here, an `individual' corresponds to an arm and…

Machine Learning · Computer Science 2017-07-07 Yang Liu , Goran Radanovic , Christos Dimitrakakis , Debmalya Mandal , David C. Parkes

We introduce a framework for decentralized online learning for multi-armed bandits (MAB) with multiple cooperative players. The reward obtained by the players in each round depends on the actions taken by all the players. It's a team…

Machine Learning · Computer Science 2021-09-10 William Chang , Mehdi Jafarnia-Jahromi , Rahul Jain

The multi-armed bandit(MAB) is a classical sequential decision problem. Most work requires assumptions about the reward distribution (e.g., bounded), while practitioners may have difficulty obtaining information about these distributions to…

Machine Learning · Computer Science 2023-12-14 Han Qi , Fei Guo , Li Zhu