中文
相关论文

相关论文: Robust Multi-Agent Bandits Over Undirected Graphs

200 篇论文

We study a collaborative multi-agent stochastic linear bandit setting, where $N$ agents that form a network communicate locally to minimize their overall regret. In this setting, each agent has its own linear bandit problem (its own reward…

机器学习 · 计算机科学 2022-05-16 Ahmadreza Moradipari , Mohammad Ghavamzadeh , Mahnoosh Alizadeh

The problem of bandit with graph feedback generalizes both the multi-armed bandit (MAB) problem and the learning with expert advice problem by encoding in a directed graph how the loss vector can be observed in each round of the game. The…

机器学习 · 计算机科学 2023-08-07 Yuchen He , Chihao Zhang

This paper investigates stochastic multi-armed bandit algorithms that are robust to adversarial attacks, where an attacker can first observe the learner's action and {then} alter their reward observation. We study two cases of this model,…

机器学习 · 计算机科学 2024-08-19 Xuchuang Wang , Jinhang Zuo , Xutong Liu , John C. S. Lui , Mohammad Hajiesmaili

Recent developments in digital platforms have highlighted the prevalence of open systems, where agents can arrive and depart over time. While bandit learning in open systems has recently received initial attention, existing work imposes…

机器学习 · 计算机科学 2026-05-08 Mengfan Xu

The multi-armed bandit(MAB) problem is a simple yet powerful framework that has been extensively studied in the context of decision-making under uncertainty. In many real-world applications, such as robotic applications, selecting an arm…

机器学习 · 计算机科学 2023-03-21 Tianpeng Zhang , Kasper Johansson , Na Li

We study multi-armed bandit problems with graph feedback, in which the decision maker is allowed to observe the neighboring actions of the chosen action, in a setting where the graph may vary over time and is never fully revealed to the…

机器学习 · 统计学 2018-05-24 Fang Liu , Zizhan Zheng , Ness Shroff

Stochastic linear bandits are a fundamental model for sequential decision making, where an agent selects a vector-valued action and receives a noisy reward with expected value given by an unknown linear function. Although well studied in…

机器学习 · 计算机科学 2025-06-23 Bruce Huang , Ruida Zhou , Lin F. Yang , Suhas Diggavi

We study the problem of regret minimization for distributed bandits learning, in which $M$ agents work collaboratively to minimize their total regret under the coordination of a central server. Our goal is to design communication protocols…

机器学习 · 计算机科学 2019-05-30 Yuanhao Wang , Jiachen Hu , Xiaoyu Chen , Liwei Wang

We define and analyze a multi-agent multi-armed bandit problem in which decision-making agents can observe the choices and rewards of their neighbors under a linear observation cost. Neighbors are defined by a network graph that encodes the…

最优化与控制 · 数学 2020-04-09 Udari Madhushani , Naomi Ehrich Leonard

We study a decentralized cooperative stochastic multi-armed bandit problem with $K$ arms on a network of $N$ agents. In our model, the reward distribution of each arm is the same for each agent and rewards are drawn independently across…

机器学习 · 计算机科学 2019-10-25 David Martínez-Rubio , Varun Kanade , Patrick Rebeschini

We consider the problem where $N$ agents collaboratively interact with an instance of a stochastic $K$ arm bandit problem for $K \gg N$. The agents aim to simultaneously minimize the cumulative regret over all the agents for a total of $T$…

机器学习 · 计算机科学 2021-02-18 Mridul Agarwal , Vaneet Aggarwal , Kamyar Azizzadenesheli

This paper tackles a multi-agent bandit setting where $M$ agents cooperate together to solve the same instance of a $K$-armed stochastic bandit problem. The agents are \textit{heterogeneous}: each agent has limited access to a local subset…

机器学习 · 计算机科学 2022-02-18 Lin Yang , Yu-zhen Janice Chen , Mohammad Hajiesmaili , John CS Lui , Don Towsley

We consider regret minimization in a general collaborative multi-agent multi-armed bandit model, in which each agent faces a finite set of arms and may communicate with other agents through a central controller. The optimal arm for each…

机器学习 · 计算机科学 2023-12-18 Amitis Shidani , Sattar Vakili

We study the problem of stochastic bandits with adversarial corruptions in the cooperative multi-agent setting, where $V$ agents interact with a common $K$-armed bandit problem, and each pair of agents can communicate with each other to…

机器学习 · 计算机科学 2021-06-09 Junyan Liu , Shuai Li , Dapeng Li

We consider a decentralized multi-agent Multi Armed Bandit (MAB) setup consisting of $N$ agents, solving the same MAB instance to minimize individual cumulative regret. In our model, agents collaborate by exchanging messages through…

机器学习 · 计算机科学 2024-07-04 Ronshee Chawla , Abishek Sankararaman , Ayalvadi Ganesh , Sanjay Shakkottai

We consider the Multi-Armed Bandit (MAB) problem, where an agent sequentially chooses actions and observes rewards for the actions it took. While the majority of algorithms try to minimize the regret, i.e., the cumulative difference between…

机器学习 · 计算机科学 2021-09-14 Nadav Merlis , Shie Mannor

We study networks of communicating learning agents that cooperate to solve a common nonstochastic bandit problem. Agents use an underlying communication network to get messages about actions selected by other agents, and drop messages that…

机器学习 · 计算机科学 2016-06-02 Nicolo' Cesa-Bianchi , Claudio Gentile , Yishay Mansour , Alberto Minora

The Competing Bandits framework is a recently emerging area that integrates multi-armed bandits in online learning with stable matching in game theory. While conventional models assume that all players and arms are constantly available, in…

机器学习 · 计算机科学 2026-03-23 Shinnosuke Uba , Yutaro Yamaguchi

We consider a novel multi-arm bandit (MAB) setup, where a learner needs to communicate the actions to distributed agents over erasure channels, while the rewards for the actions are directly available to the learner through external…

机器学习 · 统计学 2024-06-27 Osama Hanna , Merve Karakas , Lin F. Yang , Christina Fragouli

We consider the multi-armed bandit setting with a twist. Rather than having just one decision maker deciding which arm to pull in each round, we have $n$ different decision makers (agents). In the simple stochastic setting, we show that a…

机器学习 · 计算机科学 2022-02-07 Christopher Jung , Sampath Kannan , Neil Lutz