中文
相关论文

相关论文: Multi-Agent Stochastic Bandits Robust to Adversari…

200 篇论文

We study a multiplayer stochastic multi-armed bandit problem in which players cannot communicate, and if two or more players pull the same arm, a collision occurs and the involved players receive zero reward. We consider the challenging…

机器学习 · 统计学 2020-03-23 Etienne Boursier , Emilie Kaufmann , Abbas Mehrabian , Vianney Perchet

We consider a novel multi-armed bandit framework where the rewards obtained by pulling the arms are functions of a common latent random variable. The correlation between arms due to the common random source can be used to design a…

机器学习 · 统计学 2019-01-31 Samarth Gupta , Gauri Joshi , Osman Yağan

We study meta-learning for adversarial multi-armed bandits. We consider the online-within-online setup, in which a player (learner) encounters a sequence of multi-armed bandit episodes. The player's performance is measured as regret against…

机器学习 · 计算机科学 2022-07-13 Ilya Osadchiy , Kfir Y. Levy , Ron Meir

Motivated by applications such as online labor markets we consider a variant of the stochastic multi-armed bandit problem where we have a collection of arms representing strategic agents with different performance characteristics. The…

计算机科学与博弈论 · 计算机科学 2025-03-11 Seyed A. Esmaeili , Suho Shin , Aleksandrs Slivkins

Online learning to rank sequentially recommends a small list of items to users from a large candidate set and receives the users' click feedback. In many real-world scenarios, users browse the recommended list in order and click the first…

机器学习 · 计算机科学 2025-02-13 Jize Xie , Cheng Chen , Zhiyong Wang , Shuai Li

We develop a model selection approach to tackle reinforcement learning with adversarial corruption in both transition and reward. For finite-horizon tabular MDPs, without prior knowledge on the total amount of corruption, our algorithm…

机器学习 · 计算机科学 2024-12-31 Chen-Yu Wei , Christoph Dann , Julian Zimmert

We consider a stochastic multi-armed bandit setting and study the problem of constrained regret minimization over a given time horizon. Each arm is associated with an unknown, possibly multi-dimensional distribution, and the merit of an arm…

机器学习 · 计算机科学 2023-01-05 Anmol Kagrecha , Jayakrishnan Nair , Krishna Jagannathan

We consider the problem where $N$ agents collaboratively interact with an instance of a stochastic $K$ arm bandit problem for $K \gg N$. The agents aim to simultaneously minimize the cumulative regret over all the agents for a total of $T$…

机器学习 · 计算机科学 2021-02-18 Mridul Agarwal , Vaneet Aggarwal , Kamyar Azizzadenesheli

In this paper, we formulate the multi-agent graph bandit problem as a multi-agent extension of the graph bandit problem introduced by Zhang, Johansson, and Li [CISS 57, 1-6 (2023)]. In our formulation, $N$ cooperative agents travel on a…

机器学习 · 计算机科学 2024-11-05 Phevos Paschalidis , Runyu Zhang , Na Li

We study the cooperative stochastic $k$-armed bandit problem, where a network of $m$ agents collaborate to find the optimal action. In contrast to most prior work on this problem, which focuses on extending a specific algorithm to the…

机器学习 · 计算机科学 2024-11-01 Benjamin Howson , Sarah Filippi , Ciara Pike-Burke

In the classic multi-armed bandits problem, the goal is to have a policy for dynamically operating arms that each yield stochastic rewards with unknown means. The key metric of interest is regret, defined as the gap between the expected…

最优化与控制 · 数学 2010-11-23 Yi Gai , Bhaskar Krishnamachari , Rahul Jain

We propose a novel algorithm for multi-player multi-armed bandits without collision sensing information. Our algorithm circumvents two problems shared by all state-of-the-art algorithms: it does not need as an input a lower bound on the…

机器学习 · 统计学 2022-06-07 Wei Huang , Richard Combes , Cindy Trinh

We consider a situation where an agent has $T$ ressources to be allocated to a larger number $N$ of actions. Each action can be completed at most once and results in a stochastic reward with unknown mean. The goal of the agent is to…

统计理论 · 数学 2020-11-04 Solenne Gaucher

We introduce a novel extension of the canonical multi-armed bandit problem that incorporates an additional strategic innovation: abstention. In this enhanced framework, the agent is not only tasked with selecting an arm at each time step,…

机器学习 · 计算机科学 2026-03-24 Junwen Yang , Tianyuan Jin , Vincent Y. F. Tan

A Multi-Agent Cooperative Learning (MACL) system is an artificial intelligence (AI) system where multiple learning agents work together to complete a common task. Recent empirical success of MACL systems in various domains (e.g. traffic…

机器学习 · 计算机科学 2023-10-31 Jialin Yi

We consider a multi-armed bandit problem in which a set of arms is registered by each agent, and the agent receives reward when its arm is selected. An agent might strategically submit more arms with replications, which can bring more…

机器学习 · 计算机科学 2021-10-26 Suho Shin , Seungjoon Lee , Jungseul Ok

We study the corrupted bandit problem, i.e. a stochastic multi-armed bandit problem with $k$ unknown reward distributions, which are heavy-tailed and corrupted by a history-independent adversary or Nature. To be specific, the reward…

机器学习 · 计算机科学 2023-03-22 Debabrota Basu , Odalric-Ambrym Maillard , Timothée Mathieu

We study the regret in stochastic Multi-Armed Bandits (MAB) with multiple agents that communicate over an arbitrary connected communication graph. We analyzed a variant of Cooperative Successive Elimination algorithm, COOP-SE, and show an…

机器学习 · 计算机科学 2026-02-04 Idan Barnea , Tal Lancewicki , Yishay Mansour

We study a generalization of the multi-armed bandit problem with multiple plays where there is a cost associated with pulling each arm and the agent has a budget at each time that dictates how much she can expect to spend. We derive an…

机器学习 · 统计学 2019-09-13 Alexander Luedtke , Emilie Kaufmann , Antoine Chambaz

We study an important variant of the stochastic multi-armed bandit (MAB) problem, which takes penalization into consideration. Instead of directly maximizing cumulative expected reward, we need to balance between the total reward and…

机器学习 · 统计学 2022-11-16 Guanhua Fang , Ping Li , Gennady Samorodnitsky