中文
相关论文

相关论文: Multi-agent Multi-armed Bandit with Fully Heavy-ta…

200 篇论文

We study an important variant of the stochastic multi-armed bandit (MAB) problem, which takes penalization into consideration. Instead of directly maximizing cumulative expected reward, we need to balance between the total reward and…

机器学习 · 统计学 2022-11-16 Guanhua Fang , Ping Li , Gennady Samorodnitsky

Multi-armed bandit (MAB) is a widely adopted framework for sequential decision-making under uncertainty. Traditional bandit algorithms rely solely on online data, which tends to be scarce as it must be gathered during the online phase when…

统计理论 · 数学 2026-04-23 Wenlong Ji , Yihan Pan , Ruihao Zhu , Lihua Lei

While sequential task assignment for a single agent has been widely studied, such problems in a multi-agent setting, where the agents have heterogeneous task preferences or capabilities, remain less well-characterized. We study a…

多智能体系统 · 计算机科学 2025-10-21 Qinshuang Wei , Vaibhav Srivastava , Vijay Gupta

We study a structured multi-agent multi-armed bandit (MAMAB) problem in a dynamic environment. A graph reflects the information-sharing structure among agents, and the arms' reward distributions are piecewise-stationary with several unknown…

机器学习 · 计算机科学 2023-06-12 Xiaotong Cheng , Setareh Maghsudi

This paper introduces a decentralized multi-agent reinforcement learning framework enabling structurally heterogeneous teams of agents to jointly discover and acquire randomly located targets in environments characterized by partial…

机器人学 · 计算机科学 2026-01-14 Gabriele Calzolari , Vidya Sumathy , Christoforos Kanellakis , George Nikolakopoulos

For a wireless avionics communication system, a Multi-arm bandit game is mathematically formulated, which includes channel states, strategies, and rewards. The simple case includes only two agents sharing the spectrum which is fully studied…

信号处理 · 电气工程与系统科学 2017-11-15 Jingyang Lu , Lun Li , Dan Shen , Genshe Chen , Bin Jia , Erik Blasch , Khanh Pham

Significant work has been recently dedicated to the stochastic delayed bandit setting because of its relevance in applications. The applicability of existing algorithms is however restricted by the fact that strong assumptions are often…

机器学习 · 统计学 2020-06-19 Anne Gael Manegueu , Claire Vernade , Alexandra Carpentier , Michal Valko

This paper investigates stochastic multi-armed bandit algorithms that are robust to adversarial attacks, where an attacker can first observe the learner's action and {then} alter their reward observation. We study two cases of this model,…

机器学习 · 计算机科学 2024-08-19 Xuchuang Wang , Jinhang Zuo , Xutong Liu , John C. S. Lui , Mohammad Hajiesmaili

Multi-armed bandit problems are considered as a paradigm of the trade-off between exploring the environment to find profitable actions and exploiting what is already known. In the stationary case, the distributions of the rewards do not…

统计理论 · 数学 2008-12-18 Aurélien Garivier , Eric Moulines

We study the optimal trade-off between expectation and tail risk for regret distribution in the stochastic multi-armed bandit model. We fully characterize the interplay among three desired properties for policy design: worst-case…

机器学习 · 统计学 2025-10-27 David Simchi-Levi , Zeyu Zheng , Feng Zhu

We study the multi-player stochastic multiarmed bandit (MAB) problem in an abruptly changing environment. We consider a collision model in which a player receives reward at an arm if it is the only player to select the arm. We design two…

机器学习 · 统计学 2018-12-14 Lai Wei , Vaibhav Srivastava

We consider an ad hoc network where multiple users access the same set of channels. The channel characteristics are unknown and could be different for each user (heterogeneous). No controller is available to coordinate channel selections by…

机器学习 · 计算机科学 2019-09-02 Harshvardhan Tibrewal , Sravan Patchala , Manjesh K. Hanawal , Sumit J. Darak

We consider a multi-armed bandit framework where the rewards obtained by pulling different arms are correlated. We develop a unified approach to leverage these reward correlations and present fundamental generalizations of classic bandit…

机器学习 · 统计学 2021-09-13 Samarth Gupta , Shreyas Chaudhari , Gauri Joshi , Osman Yağan

In decentralized cooperative multi-armed bandits (MAB), each agent observes a distinct stream of rewards, and seeks to exchange information with others to select a sequence of arms so as to minimize its regret. Agents in the cooperative…

机器学习 · 计算机科学 2025-06-12 Jingxuan Zhu , Alec Koppel , Alvaro Velasquez , Ji Liu

A survey is performed of various Multi-Armed Bandit (MAB) strategies in order to examine their performance in circumstances exhibiting non-stationary stochastic reward functions in conjunction with delayed feedback. We run several MAB…

机器学习 · 计算机科学 2019-07-31 Larkin Liu , Richard Downe , Joshua Reid

We present differentially private algorithms for the stochastic Multi-Armed Bandit (MAB) problem. This is a problem for applications such as adaptive clinical trials, experiment design, and user-targeted advertising where private…

机器学习 · 统计学 2015-11-30 Aristide Tossou , Christos Dimitrakakis

We consider a fully decentralized multi-player stochastic multi-armed bandit setting where the players cannot communicate with each other and can observe only their own actions and rewards. The environment may appear differently to…

机器学习 · 计算机科学 2021-12-30 Akshayaa Magesh , Venugopal V. Veeravalli

Despite the significant interests and many progresses in decentralized multi-player multi-armed bandits (MP-MAB) problems in recent years, the regret gap to the natural centralized lower bound in the heterogeneous MP-MAB setting remains…

机器学习 · 统计学 2021-11-02 Chengshuai Shi , Wei Xiong , Cong Shen , Jing Yang

The multi-armed bandit (MAB) model is one of the most classical models to study decision-making in an uncertain environment. In this model, a player chooses one of $K$ possible arms of a bandit machine to play at each time step, where the…

机器学习 · 计算机科学 2023-06-13 Bo Li , Chi Ho Yeung

In this paper, we study the stochastic combinatorial multi-armed bandit (CMAB) framework that allows a general nonlinear reward function, whose expected value may not depend only on the means of the input random variables but possibly on…

机器学习 · 计算机科学 2018-07-23 Wei Chen , Wei Hu , Fu Li , Jian Li , Yu Liu , Pinyan Lu