中文
相关论文

相关论文: Communication-Efficient Collaborative Regret Minim…

200 篇论文

Learning from prior tasks and transferring that experience to improve future performance is critical for building lifelong learning agents. Although results in supervised and reinforcement learning show that transfer may significantly…

机器学习 · 统计学 2013-07-29 Mohammad Gheshlaghi Azar , Alessandro Lazaric , Emma Brunskill

We consider a decentralized multi-agent Multi Armed Bandit (MAB) setup consisting of $N$ agents, solving the same MAB instance to minimize individual cumulative regret. In our model, agents collaborate by exchanging messages through…

机器学习 · 计算机科学 2024-07-04 Ronshee Chawla , Abishek Sankararaman , Ayalvadi Ganesh , Sanjay Shakkottai

This paper introduces a general multi-agent bandit model in which each agent is facing a finite set of arms and may communicate with other agents through a central controller in order to identify, in pure exploration, or play, in regret…

机器学习 · 计算机科学 2022-10-31 Clémence Réda , Sattar Vakili , Emilie Kaufmann

We consider a resource-aware variant of the classical multi-armed bandit problem: In each round, the learner selects an arm and determines a resource limit. It then observes a corresponding (random) reward, provided the (random) amount of…

机器学习 · 计算机科学 2022-10-18 Viktor Bengs , Eyke Hüllermeier

The Colonel Blotto game is a renowned resource allocation problem with a long-standing literature in game theory (almost 100 years). However, its scope of application is still restricted by the lack of studies on the incomplete-information…

计算机科学与博弈论 · 计算机科学 2019-09-12 Dong Quan Vu , Patrick Loiseau , Alonso Silva

Multi-armed bandit problems are the most basic examples of sequential decision problems with an exploration-exploitation trade-off. This is the balance between staying with the option that gave highest payoffs in the past and exploring new…

机器学习 · 计算机科学 2012-11-06 Sébastien Bubeck , Nicolò Cesa-Bianchi

We study the problem of stochastic bandits with adversarial corruptions in the cooperative multi-agent setting, where $V$ agents interact with a common $K$-armed bandit problem, and each pair of agents can communicate with each other to…

机器学习 · 计算机科学 2021-06-09 Junyan Liu , Shuai Li , Dapeng Li

The cooperative bandit problem is increasingly becoming relevant due to its applications in large-scale decision-making. However, most research for this problem focuses exclusively on the setting with perfect communication, whereas in most…

机器学习 · 统计学 2021-11-25 Udari Madhushani , Abhimanyu Dubey , Naomi Ehrich Leonard , Alex Pentland

We consider the cooperative multi-player version of the stochastic multi-armed bandit problem. We study the regime where the players cannot communicate but have access to shared randomness. In prior work by the first two authors, a strategy…

机器学习 · 计算机科学 2020-11-10 Sébastien Bubeck , Thomas Budzinski , Mark Sellke

Linear contextual bandit is a popular online learning problem. It has been mostly studied in centralized learning settings. With the surging demand of large-scale decentralized model learning, e.g., federated learning, how to retain regret…

机器学习 · 计算机科学 2021-10-05 Chuanhao Li , Hongning Wang

Recent works have shown that agents facing independent instances of a stochastic $K$-armed bandit can collaborate to decrease regret. However, these works assume that each agent always recommends their individual best-arm estimates to other…

机器学习 · 计算机科学 2022-03-02 Daniel Vial , Sanjay Shakkottai , R. Srikant

We study a cooperative multi-agent multi-armed bandits with M agents and K arms. The goal of the agents is to minimized the cumulative regret. We adapt a traditional Thompson Sampling algoirthm under the distributed setting. However, with…

人工智能 · 计算机科学 2021-09-10 Jing Dong , Tan Li , Shaolei Ren , Linqi Song

We study a collaborative multi-agent stochastic linear bandit setting, where $N$ agents that form a network communicate locally to minimize their overall regret. In this setting, each agent has its own linear bandit problem (its own reward…

机器学习 · 计算机科学 2022-05-16 Ahmadreza Moradipari , Mohammad Ghavamzadeh , Mahnoosh Alizadeh

In this paper, we propose a constant word (RAM model) algorithm for regret minimisation for both finite and infinite Stochastic Multi-Armed Bandit (MAB) instances. Most of the existing regret minimisation algorithms need to remember the…

机器学习 · 计算机科学 2019-01-25 Arghya Roy Chaudhuri , Shivaram Kalyanakrishnan

We consider a collaborative online learning paradigm, wherein a group of agents connected through a social network are engaged in playing a stochastic multi-armed bandit game. Each time an agent takes an action, the corresponding reward is…

机器学习 · 计算机科学 2016-07-12 Ravi Kumar Kolla , Krishna Jagannathan , Aditya Gopalan

We investigate top-$m$ arm identification, a basic problem in bandit theory, in a multi-agent learning model in which agents collaborate to learn an objective function. We are interested in designing collaborative learning algorithms that…

机器学习 · 计算机科学 2022-11-29 Nikolai Karpov , Qin Zhang

There are two variants of the classical multi-armed bandit (MAB) problem that have received considerable attention from machine learning researchers in recent years: contextual bandits and simple regret minimization. Contextual bandits are…

We consider the classical multi-armed bandit problem, but with strategic arms. In this context, each arm is characterized by a bounded support reward distribution and strategically aims to maximize its own utility by potentially retaining a…

机器学习 · 计算机科学 2025-01-28 Ahmed Ben Yahmed , Clément Calauzènes , Vianney Perchet

The multi-armed bandit (MAB) problem is an active learning framework that aims to select the best among a set of actions by sequentially observing rewards. Recently, it has become popular for a number of applications over wireless networks,…

机器学习 · 计算机科学 2021-11-12 Osama A. Hanna , Lin F. Yang , Christina Fragouli

We consider the problem where $M$ agents interact with $M$ identical and independent environments with $S$ states and $A$ actions using reinforcement learning for $T$ rounds. The agents share their data with a central server to minimize…

机器学习 · 计算机科学 2021-02-23 Mridul Agarwal , Bhargav Ganguly , Vaneet Aggarwal