中文
相关论文

相关论文: Game of Thrones: Fully Distributed Learning for Mu…

200 篇论文

We consider an extension to the restless multi-armed bandit (RMAB) problem with unknown arm dynamics, where an unknown exogenous global Markov process governs the rewards distribution of each arm. Under each global state, the rewards…

机器学习 · 计算机科学 2022-10-11 Tomer Gafni , Michal Yemini , Kobi Cohen

We generalize the multiple-play multi-armed bandits (MP-MAB) problem with a shareable arm setting, in which several plays can share the same arm. Furthermore, each shareable arm has a finite reward capacity and a ''per-load'' reward…

机器学习 · 计算机科学 2022-06-20 Xuchuang Wang , Hong Xie , John C. S. Lui

In this paper, we investigate the existence of online learning algorithms with bandit feedback that simultaneously guarantee $O(1)$ regret compared to a given comparator strategy, and $\tilde{O}(\sqrt{T})$ regret compared to any fixed…

机器学习 · 计算机科学 2025-06-05 Adrian Müller , Jon Schneider , Stratis Skoulakis , Luca Viano , Volkan Cevher

Motivated by cognitive radios, stochastic Multi-Player Multi-Armed Bandits has been extensively studied in recent years. In this setting, each player pulls an arm, and receives a reward corresponding to the arm if there is no collision,…

机器学习 · 计算机科学 2022-11-16 Shivakumar Mahesh , Anshuka Rangi , Haifeng Xu , Long Tran-Thanh

Competitions for shareable and limited resources have long been studied with strategic agents. In reality, agents often have to learn and maximize the rewards of the resources at the same time. To design an individualized competing policy,…

机器学习 · 计算机科学 2023-08-07 Renzhe Xu , Haotian Wang , Xingxuan Zhang , Bo Li , Peng Cui

We investigate the problem of unconstrained combinatorial multi-armed bandits with full-bandit feedback and stochastic rewards for submodular maximization. Previous works investigate the same problem assuming a submodular and monotone…

机器学习 · 计算机科学 2023-02-03 Fares Fourati , Vaneet Aggarwal , Christopher John Quinn , Mohamed-Slim Alouini

We consider the non-stochastic version of the (cooperative) multi-player multi-armed bandit problem. The model assumes no communication at all between the players, and furthermore when two (or more) players select the same action this…

机器学习 · 计算机科学 2019-05-03 Sébastien Bubeck , Yuanzhi Li , Yuval Peres , Mark Sellke

In this paper, we study the stochastic version of the one-sided full information bandit problem, where we have $K$ arms $[K] = \{1, 2, \ldots, K\}$, and playing arm $i$ would gain reward from an unknown distribution for arm $i$ while…

机器学习 · 计算机科学 2019-06-21 Haoyu Zhao , Wei Chen

We consider a budget-constrained bandit problem where each arm pull incurs a random cost, and yields a random reward in return. The objective is to maximize the total expected reward under a budget constraint on the total cost. The model is…

机器学习 · 计算机科学 2020-03-03 Semih Cayci , Atilla Eryilmaz , R. Srikant

We study a version of the classical zero-sum matrix game with unknown payoff matrix and bandit feedback, where the players only observe each others actions and a noisy payoff. This generalizes the usual matrix game, where the payoff matrix…

机器学习 · 计算机科学 2021-06-15 Brendan O'Donoghue , Tor Lattimore , Ian Osband

Thompson Sampling (TS) is one of the most effective algorithms for solving contextual multi-armed bandit problems. In this paper, we propose a new algorithm, called Neural Thompson Sampling, which adapts deep neural networks for both…

机器学习 · 计算机科学 2022-01-03 Weitong Zhang , Dongruo Zhou , Lihong Li , Quanquan Gu

Motivated by a number of real-world applications from domains like healthcare and sustainable transportation, in this paper we study a scenario of repeated principal-agent games within a multi-armed bandit (MAB) framework, where: the…

机器学习 · 计算机科学 2023-05-09 Ilgin Dogan , Zuo-Jun Max Shen , Anil Aswani

Classical multi-armed bandit problems use the expected value of an arm as a metric to evaluate its goodness. However, the expected value is a risk-neutral metric. In many applications like finance, one is interested in balancing the…

机器学习 · 计算机科学 2019-06-04 Anmol Kagrecha , Jayakrishnan Nair , Krishna Jagannathan

We consider online no-regret learning in unknown games with bandit feedback, where each player can only observe its reward at each time -- determined by all players' current joint action -- rather than its gradient. We focus on the class of…

机器学习 · 计算机科学 2024-04-01 Wenjia Ba , Tianyi Lin , Jiawei Zhang , Zhengyuan Zhou

We consider an ad hoc network where multiple users access the same set of channels. The channel characteristics are unknown and could be different for each user (heterogeneous). No controller is available to coordinate channel selections by…

机器学习 · 计算机科学 2019-09-02 Harshvardhan Tibrewal , Sravan Patchala , Manjesh K. Hanawal , Sumit J. Darak

We study a new stochastic multi-player multi-armed bandits (MP-MAB) problem, where the reward distribution changes if a collision occurs on the arm. Existing literature always assumes a zero reward for involved players if collision happens,…

信息论 · 计算机科学 2021-09-01 Chengshuai Shi , Cong Shen

We introduce a framework for decentralized online learning for multi-armed bandits (MAB) with multiple cooperative players. The reward obtained by the players in each round depends on the actions taken by all the players. It's a team…

机器学习 · 计算机科学 2021-09-10 William Chang , Mehdi Jafarnia-Jahromi , Rahul Jain

Policy regret is a well established notion of measuring the performance of an online learning algorithm against an adaptive adversary. We study restrictions on the adversary that enable efficient minimization of the \emph{complete policy…

机器学习 · 统计学 2022-04-26 Dhruv Malik , Yuanzhi Li , Aarti Singh

We consider a decision maker allocating one unit of renewable and divisible resource in each period on a number of arms. The arms have unknown and random rewards whose means are proportional to the allocated resource and whose variances are…

机器学习 · 计算机科学 2023-11-06 Ningyuan Chen , Wenhao Li

In this paper, we consider a bandit problem in which there are a number of groups each consisting of infinitely many arms. Whenever a new arm is requested from a given group, its mean reward is drawn from an unknown reservoir distribution…

机器学习 · 统计学 2023-02-02 Ivan Lau , Yan Hao Ling , Mayank Shrivastava , Jonathan Scarlett