English
Related papers

Related papers: Competing for Shareable Arms in Multi-Player Multi…

200 papers

We study the problem of regret minimization in a multi-armed bandit setup where the agent is allowed to play multiple arms at each round by spreading the resources usually allocated to only one arm. At each iteration the agent selects a…

Machine Learning · Computer Science 2021-06-01 Matias I. Müller , Cristian R. Rojas

We study the open question of how players learn to play a social optimum pure-strategy Nash equilibrium (PSNE) through repeated interactions in general-sum coordination games. A social optimum of a game is the stable Pareto-optimal state…

Computer Science and Game Theory · Computer Science 2023-07-26 Duong Nguyen , Langford White , Hung Nguyen

Classical multi-armed bandit problems use the expected value of an arm as a metric to evaluate its goodness. However, the expected value is a risk-neutral metric. In many applications like finance, one is interested in balancing the…

Machine Learning · Computer Science 2019-06-04 Anmol Kagrecha , Jayakrishnan Nair , Krishna Jagannathan

In practice, incentive providers (i.e., principals) often cannot observe the reward realizations of incentivized agents, which is in contrast to many principal-agent models that have been previously studied. This information asymmetry…

Machine Learning · Computer Science 2023-08-15 Ilgin Dogan , Zuo-Jun Max Shen , Anil Aswani

Combinatorial Multi-Armed Bandit with fairness constraints is a framework where multiple arms form a super arm and can be pulled in each round under uncertainty to maximize cumulative rewards while ensuring the minimum average reward…

Machine Learning · Computer Science 2025-01-14 Xiaoyi Wu , Bo Ji , Bin Li

We consider a game-theoretic setting in which selfish individuals compete over resources of varying quality. The motivating example is a group of animals that disperse over patches of food of different abundances. In such scenarios,…

Computer Science and Game Theory · Computer Science 2018-05-04 Simon Collet , Amos Korman

Traditional multi-armed bandit (MAB) formulations usually make certain assumptions about the underlying arms' distributions, such as bounds on the support or their tail behaviour. Moreover, such parametric information is usually 'baked'…

Machine Learning · Computer Science 2022-03-29 Anmol Kagrecha , Jayakrishnan Nair , Krishna Jagannathan

Coordination is often critical to forming prosocial behaviors -- behaviors that increase the overall sum of rewards received by all agents in a multi-agent game. However, state of the art reinforcement learning algorithms often suffer from…

Multiagent Systems · Computer Science 2021-05-17 Woodrow Z. Wang , Mark Beliaev , Erdem Bıyık , Daniel A. Lazar , Ramtin Pedarsani , Dorsa Sadigh

We consider the problem of online fair division of indivisible goods to players when there are a finite number of types of goods and player values are drawn from distributions with unknown means. Our goal is to maximize social welfare…

Computer Science and Game Theory · Computer Science 2024-12-10 Ariel D. Procaccia , Benjamin Schiffer , Shirley Zhang

We consider the Max $K$-Armed Bandit problem, where a learning agent is faced with several stochastic arms, each a source of i.i.d. rewards of unknown distribution. At each time step the agent chooses an arm, and observes the reward of the…

Machine Learning · Statistics 2015-12-25 Yahel David , Nahum Shimkin

We consider multi-agent decision making where each agent's cost function depends on all agents' strategies. We propose a distributed algorithm to learn a Nash equilibrium, whereby each agent uses only obtained values of her cost function at…

Multiagent Systems · Computer Science 2019-04-04 Tatiana Tatarenko , Maryam Kamgarpour

In budget-limited multi-armed bandit (MAB) problems, the learner's actions are costly and constrained by a fixed budget. Consequently, an optimal exploitation policy may not be to pull the optimal arm repeatedly, as is the case in other…

Artificial Intelligence · Computer Science 2012-04-10 Long Tran-Thanh , Archie Chapman , Alex Rogers , Nicholas R. Jennings

Recent works have shown that agents facing independent instances of a stochastic $K$-armed bandit can collaborate to decrease regret. However, these works assume that each agent always recommends their individual best-arm estimates to other…

Machine Learning · Computer Science 2022-03-02 Daniel Vial , Sanjay Shakkottai , R. Srikant

In this paper, we introduce the notion of replicable policies in the context of stochastic bandits, one of the canonical problems in interactive learning. A policy in the bandit environment is called replicable if it pulls, with high…

Machine Learning · Computer Science 2023-02-16 Hossein Esfandiari , Alkis Kalavasis , Amin Karbasi , Andreas Krause , Vahab Mirrokni , Grigoris Velegkas

Training multi-agent systems (MAS) to achieve realistic equilibria gives us a useful tool to understand and model real-world systems. We consider a general sum partially observable Markov game where agents of different types share a single…

Multiagent Systems · Computer Science 2020-10-26 Nelson Vadori , Sumitra Ganesh , Prashant Reddy , Manuela Veloso

We introduce the problem of sleeping dueling bandits with stochastic preferences and adversarial availabilities (DB-SPAA). In almost all dueling bandit applications, the decision space often changes over time; eg, retail store management,…

Machine Learning · Computer Science 2021-07-07 Aadirupa Saha , Pierre Gaillard

There is a rising interest in industrial online applications where data becomes available sequentially. Inspired by the recommendation of playlists to users where their preferences can be collected during the listening of the entire…

Machine Learning · Computer Science 2022-06-02 Giulia Romano , Andrea Agostini , Francesco Trovò , Nicola Gatti , Marcello Restelli

We study a grouped bandit setting where each arm comprises multiple independent sub-arms referred to as attributes. Each attribute of each arm has an independent stochastic reward. We impose the constraint that for an arm to be deemed…

Machine Learning · Computer Science 2024-12-12 Sahil Dharod , Malyala Preethi Sravani , Sakshi Heda , Sharayu Moharir

A standard assumption adopted in the multi-armed bandit (MAB) framework is that the mean rewards are constant over time. This assumption can be restrictive in the business world as decision-makers often face an evolving environment where…

Machine Learning · Computer Science 2021-08-24 Ningyuan Chen , Chun Wang , Longlin Wang

In the multiarmed bandit problem a gambler chooses an arm of a slot machine to pull considering a tradeoff between exploration and exploitation. We study the stochastic bandit problem where each arm has a reward distribution supported in a…

Statistics Theory · Mathematics 2013-03-29 Junya Honda , Akimichi Takemura