English
Related papers

Related papers: Interactive Restless Multi-armed Bandit Game and S…

200 papers

We consider the problem of selecting a seed set to maximize the expected number of influenced nodes in the social network, referred to as the \textit{influence maximization} (IM) problem. We assume that the topology of the social network is…

Machine Learning · Computer Science 2019-11-26 Xiaojin Zhang

We consider a novel multi-arm bandit (MAB) setup, where a learner needs to communicate the actions to distributed agents over erasure channels, while the rewards for the actions are directly available to the learner through external…

Machine Learning · Statistics 2024-06-27 Osama Hanna , Merve Karakas , Lin F. Yang , Christina Fragouli

Restless Multi-Armed Bandits (RMABs) are powerful models for decision-making under uncertainty, yet classical formulations typically assume fixed dynamics, an assumption often violated in nonstationary environments. We introduce MARBLE…

Machine Learning · Computer Science 2026-04-13 Mohsen Amiri , Konstantin Avrachenkov , Ibtihal El Mimouni , Sindri Magnússon

We consider decentralized stochastic multi-armed bandit problem with multiple players in the case of different communication probabilities between players. Each player makes a decision of pulling an arm without cooperation while aiming to…

Machine Learning · Computer Science 2017-11-07 Noyan Evirgen , Alper Kose

Determining what experience to generate to best facilitate learning (i.e. exploration) is one of the distinguishing features and open challenges in reinforcement learning. The advent of distributed agents that interact with parallel…

Machine Learning · Computer Science 2019-12-17 Tom Schaul , Diana Borsa , David Ding , David Szepesvari , Georg Ostrovski , Will Dabney , Simon Osindero

In the classic Bayesian restless multi-armed bandit (RMAB) problem, there are $N$ arms, with rewards on all arms evolving at each time as Markov chains with known parameters. A player seeks to activate $K \geq 1$ arms at each time in order…

Optimization and Control · Mathematics 2011-12-25 Wenhan Dai , Yi Gai , Bhaskar Krishnamachari , Qing Zhao

Applying Reinforcement Learning (RL) to Restless Multi-Arm Bandits (RMABs) offers a promising avenue for addressing allocation problems with resource constraints and temporal dynamics. However, classic RMAB models largely overlook the…

Machine Learning · Computer Science 2025-03-20 Yunfan Zhao , Tonghan Wang , Dheeraj Nagaraj , Aparna Taneja , Milind Tambe

We formulate and study a decentralized multi-armed bandit (MAB) problem. There are M distributed players competing for N independent arms. Each arm, when played, offers i.i.d. reward according to a distribution with an unknown parameter. At…

Optimization and Control · Mathematics 2015-05-14 Keqin Liu , Qing Zhao

In the latent bandit problem, the learner has access to reward distributions and -- for the non-stationary variant -- transition models of the environment. The reward distributions are conditioned on the arm and unknown latent states. The…

Machine Learning · Computer Science 2022-07-11 Alexander Galozy , Slawomir Nowaczyk

In this paper, we introduce a distributed version of the classical stochastic Multi-Arm Bandit (MAB) problem. Our setting consists of a large number of agents $n$ that collaboratively and simultaneously solve the same instance of $K$ armed…

Machine Learning · Computer Science 2019-11-06 Abishek Sankararaman , Ayalvadi Ganesh , Sanjay Shakkottai

Traditional multi-armed bandit (MAB) formulations usually make certain assumptions about the underlying arms' distributions, such as bounds on the support or their tail behaviour. Moreover, such parametric information is usually 'baked'…

Machine Learning · Computer Science 2022-03-29 Anmol Kagrecha , Jayakrishnan Nair , Krishna Jagannathan

Personalized AI-based services involve a population of individual reinforcement learning agents. However, most reinforcement learning algorithms focus on harnessing individual learning and fail to leverage the social learning capabilities…

Machine Learning · Computer Science 2026-03-13 Erfan Mirzaei , Seyed Pooya Shariatpanahi , Alireza Tavakoli , Reshad Hosseini , Majid Nili Ahmadabadi

Restless multi-armed bandits (RMABs) extend multi-armed bandits to allow for stateful arms, where the state of each arm evolves restlessly with different transitions depending on whether that arm is pulled. Solving RMABs requires…

Machine Learning · Computer Science 2023-11-21 Kai Wang , Lily Xu , Aparna Taneja , Milind Tambe

We study social learning dynamics motivated by reviews on online platforms. The agents collectively follow a simple multi-armed bandit protocol, but each agent acts myopically, without regards to exploration. We allow the greedy…

Computer Science and Game Theory · Computer Science 2025-04-11 Kiarash Banihashem , MohammadTaghi Hajiaghayi , Suho Shin , Aleksandrs Slivkins

In this paper, we investigate the impact of diverse user preference on learning under the stochastic multi-armed bandit (MAB) framework. We aim to show that when the user preferences are sufficiently diverse and each arm can be optimal for…

Machine Learning · Computer Science 2022-11-11 Chao Gan , Jing Yang , Ruida Zhou , Cong Shen

We study the problem of information sharing and cooperation in Multi-Player Multi-Armed bandits. We propose the first algorithm that achieves logarithmic regret for this problem when the collision reward is unknown. Our results are based on…

Machine Learning · Computer Science 2022-10-04 Aldo Pacchiano , Peter Bartlett , Michael I. Jordan

We consider the problem of learning in single-player and multiplayer multiarmed bandit models. Bandit problems are classes of online learning problems that capture exploration versus exploitation tradeoffs. In a multiarmed bandit model,…

Machine Learning · Statistics 2016-12-02 Naumaan Nayyar , Dileep Kalathil , Rahul Jain

Motivated by a number of real-world applications from domains like healthcare and sustainable transportation, in this paper we study a scenario of repeated principal-agent games within a multi-armed bandit (MAB) framework, where: the…

Machine Learning · Computer Science 2023-05-09 Ilgin Dogan , Zuo-Jun Max Shen , Anil Aswani

We study the repeated principal-agent bandit game, where the principal indirectly interacts with the unknown environment by proposing incentives for the agent to play arms. Most existing work assumes the agent has full knowledge of the…

Machine Learning · Computer Science 2025-06-03 Junyan Liu , Lillian J. Ratliff

The multi-armed bandit formalism has been extensively studied under various attack models, in which an adversary can modify the reward revealed to the player. Previous studies focused on scenarios where the attack value either is bounded at…

Machine Learning · Computer Science 2020-02-19 Ziwei Guan , Kaiyi Ji , Donald J Bucci , Timothy Y Hu , Joseph Palombo , Michael Liston , Yingbin Liang
‹ Prev 1 3 4 5 6 7 10 Next ›