中文
相关论文

相关论文: Multiplayer bandits without observing collision in…

200 篇论文

Classic no-regret multi-armed bandit algorithms, including the Upper Confidence Bound (UCB), Hedge, and EXP3, are inherently unfair by design. Their unfairness stems from their objective of playing the most rewarding arm as frequently as…

机器学习 · 计算机科学 2024-05-14 Abhishek Sinha

We study a novel variant of the multi-armed bandit problem, where at each time step, the player observes an independently sampled context that determines the arms' mean rewards. However, playing an arm blocks it (across all contexts) for a…

机器学习 · 计算机科学 2020-06-18 Soumya Basu , Orestis Papadigenopoulos , Constantine Caramanis , Sanjay Shakkottai

This paper investigates the problem of combinatorial multiarmed bandits with stochastic submodular (in expectation) rewards and full-bandit delayed feedback, where the delayed feedback is assumed to be composite and anonymous. In other…

机器学习 · 计算机科学 2025-01-23 Mohammad Pedramfar , Vaneet Aggarwal

We study a multi-armed bandit problem in a dynamic environment where arm rewards evolve in a correlated fashion according to a Markov chain. Different than much of the work on related problems, in our formulation a learning algorithm does…

机器学习 · 计算机科学 2019-03-05 Tanner Fiez , Shreyas Sekar , Lillian J. Ratliff

This paper investigates stochastic multi-armed bandit algorithms that are robust to adversarial attacks, where an attacker can first observe the learner's action and {then} alter their reward observation. We study two cases of this model,…

机器学习 · 计算机科学 2024-08-19 Xuchuang Wang , Jinhang Zuo , Xutong Liu , John C. S. Lui , Mohammad Hajiesmaili

In this paper, we study the stochastic multi-armed bandit problem with graph feedback. Motivated by the clinical trials and recommendation problem, we assume that two arms are connected if and only if they are similar (i.e., their means are…

机器学习 · 计算机科学 2024-05-21 Han Qi , Guo Fei , Li Zhu

We study an important variant of the stochastic multi-armed bandit (MAB) problem, which takes penalization into consideration. Instead of directly maximizing cumulative expected reward, we need to balance between the total reward and…

机器学习 · 统计学 2022-11-16 Guanhua Fang , Ping Li , Gennady Samorodnitsky

We consider an N-player multi-armed bandit game where each player chooses one out of M arms for T turns. Each player has different expected rewards for the arms, and the instantaneous rewards are independent and identically distributed or…

计算机科学与博弈论 · 计算机科学 2021-04-06 Ilai Bistritz , Amir Leshem

No-regret self-play learning dynamics have become one of the premier ways to solve large-scale games in practice. Accelerating their convergence via improving the regret of the players over the naive $O(\sqrt{T})$ bound after $T$ rounds has…

机器学习 · 计算机科学 2025-02-26 Shinji Ito , Haipeng Luo , Taira Tsuchiya , Yue Wu

We consider a setting where multiple players sequentially choose among a common set of actions (arms). Motivated by a cognitive radio networks application, we assume that players incur a loss upon colliding, and that communication between…

机器学习 · 计算机科学 2019-02-22 Pragnya Alatur , Kfir Y. Levy , Andreas Krause

The Competing Bandits framework is a recently emerging area that integrates multi-armed bandits in online learning with stable matching in game theory. While conventional models assume that all players and arms are constantly available, in…

机器学习 · 计算机科学 2026-03-23 Shinnosuke Uba , Yutaro Yamaguchi

We investigate the adversarial bandit problem with multiple plays under semi-bandit feedback. We introduce a highly efficient algorithm that asymptotically achieves the performance of the best switching $m$-arm strategy with minimax optimal…

机器学习 · 计算机科学 2019-12-02 N. Mert Vural , Hakan Gokcesu , Kaan Gokcesu , Suleyman S. Kozat

We consider the problem of simultaneous learning in stochastic games with many players in the finite-horizon setting. While the typical target solution for a stochastic game is a Nash equilibrium, this is intractable with many players. We…

计算机科学与博弈论 · 计算机科学 2022-10-27 William Brown

Multi-armed Bandit motivates methods with provable upper bounds on regret and also the counterpart lower bounds have been extensively studied in this context. Recently, Multi-agent Multi-armed Bandit has gained significant traction in…

机器学习 · 计算机科学 2023-08-17 Mengfan Xu , Diego Klabjan

The problem of bandit with graph feedback generalizes both the multi-armed bandit (MAB) problem and the learning with expert advice problem by encoding in a directed graph how the loss vector can be observed in each round of the game. The…

机器学习 · 计算机科学 2023-08-07 Yuchen He , Chihao Zhang

We consider online no-regret learning in unknown games with bandit feedback, where each player can only observe its reward at each time -- determined by all players' current joint action -- rather than its gradient. We focus on the class of…

机器学习 · 计算机科学 2024-04-01 Wenjia Ba , Tianyi Lin , Jiawei Zhang , Zhengyuan Zhou

In the combinatorial semi-bandit (CSB) problem, a player selects an action from a combinatorial action set and observes feedback from the base arms included in the action. While CSB is widely applicable to combinatorial optimization…

机器学习 · 计算机科学 2025-09-15 Shintaro Nakamura , Yuko Kuroki , Wei Chen

We study a regret minimization problem with the existence of multiple best/near-optimal arms in the multi-armed bandit setting. We consider the case when the number of arms/actions is comparable or much larger than the time horizon, and…

机器学习 · 统计学 2020-10-23 Yinglun Zhu , Robert Nowak

The multi-armed bandit (MAB) model is one of the most classical models to study decision-making in an uncertain environment. In this model, a player chooses one of $K$ possible arms of a bandit machine to play at each time step, where the…

机器学习 · 计算机科学 2023-06-13 Bo Li , Chi Ho Yeung

This paper considers no-regret learning for repeated continuous-kernel games with lossy bandit feedback. Since it is difficult to give the explicit model of the utility functions in dynamic environments, the players' action can only be…

机器学习 · 计算机科学 2022-05-17 Wenting Liu , Jinlong Lei , Peng Yi , Yiguang Hong