中文
相关论文

相关论文: Online Learning for Cooperative Multi-Player Multi…

200 篇论文

A multi-user multi-armed bandit (MAB) framework is used to develop algorithms for uncoordinated spectrum access. The number of users is assumed to be unknown to each user. A stochastic setting is first considered, where the rewards on a…

机器学习 · 计算机科学 2019-01-31 Meghana Bande , Venugopal V. Veeravalli

We define a general framework for a large class of combinatorial multi-armed bandit (CMAB) problems, where subsets of base arms with unknown distributions form super arms. In each round, a super arm is played and the base arms contained in…

机器学习 · 计算机科学 2016-03-30 Wei Chen , Yajun Wang , Yang Yuan , Qinshi Wang

We consider a cooperative multiplayer bandit learning problem where the players are only allowed to agree on a strategy beforehand, but cannot communicate during the learning process. In this problem, each player simultaneously selects an…

机器学习 · 计算机科学 2023-11-13 William Chang , Yuanhao Lu

We study a variant of the classical multi-armed bandit problem (MABP) which we call as Multi-Armed Bandits with dependent arms. More specifically, multiple arms are grouped together to form a cluster, and the reward distributions of arms…

机器学习 · 计算机科学 2020-10-27 Rahul Singh , Fang Liu , Yin Sun , Ness Shroff

Multi-agent reinforcement learning (MARL) problems are challenging due to information asymmetry. To overcome this challenge, existing methods often require high level of coordination or communication between the agents. We consider…

机器学习 · 计算机科学 2021-11-02 Hsu Kao , Chen-Yu Wei , Vijay Subramanian

We formulate and study a decentralized multi-armed bandit (MAB) problem. There are M distributed players competing for N independent arms. Each arm, when played, offers i.i.d. reward according to a distribution with an unknown parameter. At…

最优化与控制 · 数学 2015-05-14 Keqin Liu , Qing Zhao

In this paper, we study the multi-objective bandits (MOB) problem, where a learner repeatedly selects one arm to play and then receives a reward vector consisting of multiple objectives. MOB has found many real-world applications as varied…

机器学习 · 计算机科学 2019-05-31 Shiyin Lu , Guanghui Wang , Yao Hu , Lijun Zhang

We study incentivized exploration for the multi-armed bandit (MAB) problem where the players receive compensation for exploring arms other than the greedy choice and may provide biased feedback on reward. We seek to understand the impact of…

机器学习 · 计算机科学 2019-12-17 Zhiyuan Liu , Huazheng Wang , Fan Shen , Kai Liu , Lijun Chen

Sequential decision-making under uncertainty often involves multiple agents learning which actions (arms) yield the highest rewards through repeated interaction with a stochastic environment. This setting is commonly modeled by cooperative…

系统与控制 · 电气工程与系统科学 2026-03-25 Evagoras Makridis , Themistoklis Charalambous

We consider the classic online learning and stochastic multi-armed bandit (MAB) problems, when at each step, the online policy can probe and find out which of a small number ($k$) of choices has better reward (or loss) before making its…

数据结构与算法 · 计算机科学 2022-11-08 Aditya Bhaskara , Sreenivas Gollapudi , Sungjin Im , Kostas Kollias , Kamesh Munagala

In this paper, we investigate a new multi-armed bandit (MAB) online learning model that considers real-world phenomena in many recommender systems: (i) the learning agent cannot pull the arms by itself and thus has to offer rewards to users…

机器学习 · 计算机科学 2021-06-01 Tianchen Zhou , Jia Liu , Chaosheng Dong , Jingyuan Deng

Motivated by distributed selection problems, we formulate a new variant of multi-player multi-armed bandit (MAB) model, which captures stochastic arrival of requests to each arm, as well as the policy of allocating requests to players. The…

人工智能 · 计算机科学 2024-08-21 Hong Xie , Jinyu Mo , Defu Lian , Jie Wang , Enhong Chen

Strategic behavior against sequential learning methods, such as "click framing" in real recommendation systems, have been widely observed. Motivated by such behavior we study the problem of combinatorial multi-armed bandits (CMAB) under…

机器学习 · 计算机科学 2021-11-22 Jing Dong , Ke Li , Shuai Li , Baoxiang Wang

In many real-world applications, multiple agents seek to learn how to perform highly related yet slightly different tasks in an online bandit learning protocol. We formulate this problem as the $\epsilon$-multi-player multi-armed bandit…

机器学习 · 计算机科学 2021-07-21 Zhi Wang , Chicheng Zhang , Manish Kumar Singh , Laurel D. Riek , Kamalika Chaudhuri

Existing multi-armed bandit (MAB) models make two implicit assumptions: an arm generates a payoff only when it is played, and the agent observes every payoff that is generated. This paper introduces synchronization bandits, a MAB variant…

机器学习 · 计算机科学 2020-08-24 Andrey Kolobov , Sébastien Bubeck , Julian Zimmert

The stochastic multi-armed bandit (MAB) problem is a common model for sequential decision problems. In the standard setup, a decision maker has to choose at every instant between several competing arms, each of them provides a scalar random…

机器学习 · 统计学 2021-10-27 Asaf Cassel , Shie Mannor , Assaf Zeevi

Standard Multi-Armed Bandit (MAB) problems assume that the arms are independent. However, in many application scenarios, the information obtained by playing an arm provides information about the remainder of the arms. Hence, in such…

机器学习 · 计算机科学 2014-10-30 Onur Atan , Cem Tekin , Mihaela van der Schaar

In a multi-armed bandit (MAB) problem a gambler needs to choose at each round of play one of K arms, each characterized by an unknown reward distribution. Reward realizations are only observed when an arm is selected, and the gambler's…

机器学习 · 计算机科学 2019-06-11 Omar Besbes , Yonatan Gur , Assaf Zeevi

We study two-sided matching markets in which one side of the market (the players) does not have a priori knowledge about its preferences for the other side (the arms) and is required to learn its preferences from experience. Also, we assume…

机器学习 · 计算机科学 2021-06-23 Lydia T. Liu , Feng Ruan , Horia Mania , Michael I. Jordan

We consider the restless multi-armed bandit (RMAB) problem with unknown dynamics in which a player chooses M out of N arms to play at each time. The reward state of each arm transits according to an unknown Markovian rule when it is played…

最优化与控制 · 数学 2011-12-30 Haoyang Liu , Keqin Liu , Qing Zhao