中文
相关论文

相关论文: Robust Multi-Agent Multi-Armed Bandits

200 篇论文

This paper is in the field of stochastic Multi-Armed Bandits (MABs), i.e. those sequential selection techniques able to learn online using only the feedback given by the chosen option (a.k.a. $arm$). We study a particular case of the rested…

机器学习 · 统计学 2024-11-28 Marco Fiandri , Alberto Maria Metelli , Francesco Trov`o

We consider a combinatorial multi-armed bandit problem for maximum value reward function under maximum value and index feedback. This is a new feedback structure that lies in between commonly studied semi-bandit and full-bandit feedback…

机器学习 · 计算机科学 2023-05-26 Yiliu Wang , Wei Chen , Milan Vojnović

Multi-armed bandit (MAB) problems are widely applied to online optimization tasks that require balancing exploration and exploitation. In practical scenarios, these tasks often involve multiple conflicting objectives, giving rise to…

机器学习 · 计算机科学 2025-06-17 Mansoor Davoodi , Setareh Maghsudi

This paper introduces a federated learning framework tailored for online combinatorial optimization with bandit feedback. In this setting, agents select subsets of arms, observe noisy rewards for these subsets without accessing individual…

机器学习 · 计算机科学 2024-05-10 Fares Fourati , Mohamed-Slim Alouini , Vaneet Aggarwal

Mode estimation is a classical problem in statistics with a wide range of applications in machine learning. Despite this, there is little understanding in its robustness properties under possibly adversarial data contamination. In this…

机器学习 · 计算机科学 2020-03-09 Aldo Pacchiano , Heinrich Jiang , Michael I. Jordan

We investigate the adversarial bandit problem with multiple plays under semi-bandit feedback. We introduce a highly efficient algorithm that asymptotically achieves the performance of the best switching $m$-arm strategy with minimax optimal…

机器学习 · 计算机科学 2019-12-02 N. Mert Vural , Hakan Gokcesu , Kaan Gokcesu , Suleyman S. Kozat

We study the stochastic multi-armed bandit problem when one knows the value $\mu^{(\star)}$ of an optimal arm, as a well as a positive lower bound on the smallest positive gap $\Delta$. We propose a new randomized policy that attains a…

统计理论 · 数学 2013-02-13 Sébastien Bubeck , Vianney Perchet , Philippe Rigollet

We study the combinatorial semi-bandit problem where an agent selects a subset of base arms and receives individual feedback. While this generalizes the classical multi-armed bandit and has broad applicability, its scalability is limited by…

机器学习 · 统计学 2025-10-27 Jung-hun Kim , Milan Vojnović , Min-hwan Oh

In decentralized cooperative multi-armed bandits (MAB), each agent observes a distinct stream of rewards, and seeks to exchange information with others to select a sequence of arms so as to minimize its regret. Agents in the cooperative…

机器学习 · 计算机科学 2025-06-12 Jingxuan Zhu , Alec Koppel , Alvaro Velasquez , Ji Liu

In the multi-armed bandit framework, there are two formulations that are commonly employed to handle time-varying reward distributions: adversarial bandit and nonstationary bandit. Although their oracles, algorithms, and regret analysis…

机器学习 · 计算机科学 2023-11-28 Ningyuan Chen , Shuoguang Yang , Hailun Zhang

In the strategic multi-armed bandit setting, when arms possess perfect information about the player's behavior, they can establish an equilibrium where: 1. they retain almost all of their value, 2. they leave the player with a substantial…

人工智能 · 计算机科学 2024-09-02 Ahmed Ben Yahmed , Clément Calauzènes , Vianney Perchet

When humans collaborate with each other, they often make decisions by observing others and considering the consequences that their actions may have on the entire team, instead of greedily doing what is best for just themselves. We would…

机器学习 · 计算机科学 2021-12-17 Erdem Bıyık , Anusha Lalitha , Rajarshi Saha , Andrea Goldsmith , Dorsa Sadigh

In this study, we explore a collaborative multi-agent stochastic linear bandit setting involving a network of $N$ agents that communicate locally to minimize their collective regret while keeping their expected cost under a specified…

机器学习 · 计算机科学 2024-10-24 Amirhossein Afsharrad , Parisa Oftadeh , Ahmadreza Moradipari , Sanjay Lall

We study the problem of regret minimization in a multi-armed bandit setup where the agent is allowed to play multiple arms at each round by spreading the resources usually allocated to only one arm. At each iteration the agent selects a…

机器学习 · 计算机科学 2021-06-01 Matias I. Müller , Cristian R. Rojas

We consider a novel multi-armed bandit framework where the rewards obtained by pulling the arms are functions of a common latent random variable. The correlation between arms due to the common random source can be used to design a…

机器学习 · 统计学 2019-01-31 Samarth Gupta , Gauri Joshi , Osman Yağan

We determine the minimax optimal expected regret in the classic non-stochastic multi-armed bandit with expert advice problem, by proving a lower bound that matches the upper bound of Kale (2014). The two bounds determine the minimax optimal…

机器学习 · 计算机科学 2025-11-04 Zachary Chase , Shinji Ito , Idan Mehalel

We study a general multi-dueling bandit problem, where an agent compares multiple options simultaneously and aims to minimize the regret due to selecting suboptimal arms. This setting generalizes the traditional two-dueling bandit problem…

机器学习 · 计算机科学 2022-11-21 Yihan Du , Siwei Wang , Longbo Huang

We consider the stochastic linear (multi-armed) contextual bandit problem with the possibility of hidden simple multi-armed bandit structure in which the rewards are independent of the contextual information. Algorithms that are designed…

机器学习 · 统计学 2020-10-07 Niladri S. Chatterji , Vidya Muthukumar , Peter L. Bartlett

We study the problem of regret minimization for distributed bandits learning, in which $M$ agents work collaboratively to minimize their total regret under the coordination of a central server. Our goal is to design communication protocols…

机器学习 · 计算机科学 2019-05-30 Yuanhao Wang , Jiachen Hu , Xiaoyu Chen , Liwei Wang

Learning good interventions in a causal graph can be modelled as a stochastic multi-armed bandit problem with side-information. First, we study this problem when interventions are more expensive than observations and a budget is specified.…

机器学习 · 计算机科学 2020-12-15 Vineet Nair , Vishakha Patil , Gaurav Sinha