English
Related papers

Related papers: Near-Optimal Collaborative Learning in Bandits

200 papers

We consider regret minimization in a general collaborative multi-agent multi-armed bandit model, in which each agent faces a finite set of arms and may communicate with other agents through a central controller. The optimal arm for each…

Machine Learning · Computer Science 2023-12-18 Amitis Shidani , Sattar Vakili

We study fair multi-agent multi-armed bandit learning under collision-only coordination. Agents cannot communicate explicitly during learning and observe only their own rewards and whether collisions occur when several agents access the…

Machine Learning · Computer Science 2026-05-05 Amir Leshem

Best arm identification (or, pure exploration) in multi-armed bandits is a fundamental problem in machine learning. In this paper we study the distributed version of this problem where we have multiple agents, and they want to learn the…

Machine Learning · Computer Science 2019-09-02 Chao Tao , Qin Zhang , Yuan Zhou

We propose the first fully-adaptive algorithm for pure exploration in linear bandits---the task to find the arm with the largest expected reward, which depends on an unknown parameter linearly. While existing methods partially or entirely…

Machine Learning · Statistics 2017-10-17 Liyuan Xu , Junya Honda , Masashi Sugiyama

Recently, there has been extensive study of cooperative multi-agent multi-armed bandits where a set of distributed agents cooperatively play the same multi-armed bandit game. The goal is to develop bandit algorithms with the optimal group…

Machine Learning · Computer Science 2023-08-09 Lin Yang , Xuchuang Wang , Mohammad Hajiesmaili , Lijun Zhang , John C. S. Lui , Don Towsley

We investigate top-$m$ arm identification, a basic problem in bandit theory, in a multi-agent learning model in which agents collaborate to learn an objective function. We are interested in designing collaborative learning algorithms that…

Machine Learning · Computer Science 2022-11-29 Nikolai Karpov , Qin Zhang

We study a multiplayer stochastic multi-armed bandit problem in which players cannot communicate, and if two or more players pull the same arm, a collision occurs and the involved players receive zero reward. We consider the challenging…

Machine Learning · Statistics 2020-03-23 Etienne Boursier , Emilie Kaufmann , Abbas Mehrabian , Vianney Perchet

Combinatorial bandits with semi-bandit feedback generalize multi-armed bandits, where the agent chooses sets of arms and observes a noisy reward for each arm contained in the chosen set. The action set satisfies a given structure such as…

Machine Learning · Statistics 2021-01-22 Marc Jourdan , Mojmír Mutný , Johannes Kirschner , Andreas Krause

We study exploration in Multi-Armed Bandits in a setting where $k$ players collaborate in order to identify an $\epsilon$-optimal arm. Our motivation comes from recent employment of bandit algorithms in computationally intensive,…

Machine Learning · Computer Science 2013-11-05 Eshcar Hillel , Zohar Karnin , Tomer Koren , Ronny Lempel , Oren Somekh

The study of collaborative multi-agent bandits has attracted significant attention recently. In light of this, we initiate the study of a new collaborative setting, consisting of $N$ agents such that each agent is learning one of $M$…

Machine Learning · Computer Science 2024-07-04 Ronshee Chawla , Daniel Vial , Sanjay Shakkottai , R. Srikant

We consider the problem of best arm identification in a variant of multi-armed bandits called linked bandits. In a single interaction with linked bandits, multiple arms are played sequentially until one of them receives a positive reward.…

Machine Learning · Computer Science 2019-01-29 Anant Gupta

In this paper, we introduce a distributed version of the classical stochastic Multi-Arm Bandit (MAB) problem. Our setting consists of a large number of agents $n$ that collaboratively and simultaneously solve the same instance of $K$ armed…

Machine Learning · Computer Science 2019-11-06 Abishek Sankararaman , Ayalvadi Ganesh , Sanjay Shakkottai

We consider the classical multi-armed bandit problem, but with strategic arms. In this context, each arm is characterized by a bounded support reward distribution and strategically aims to maximize its own utility by potentially retaining a…

Machine Learning · Computer Science 2025-01-28 Ahmed Ben Yahmed , Clément Calauzènes , Vianney Perchet

We consider the Max $K$-Armed Bandit problem, where a learning agent is faced with several sources (arms) of items (rewards), and interested in finding the best item overall. At each time step the agent chooses an arm, and obtains a random…

Machine Learning · Statistics 2015-08-25 Yahel David , Nahum Shimkin

We consider a novel multi-arm bandit (MAB) setup, where a learner needs to communicate the actions to distributed agents over erasure channels, while the rewards for the actions are directly available to the learner through external…

Machine Learning · Statistics 2024-06-27 Osama Hanna , Merve Karakas , Lin F. Yang , Christina Fragouli

We consider a K-armed bandit problem in general graphs where agents are arbitrarily connected and each of them has limited memorizing capabilities and communication bandwidth. The goal is to let each of the agents eventually learn the best…

Machine Learning · Computer Science 2023-05-09 Feng Li , Xuyang Yuan , Lina Wang , Huan Yang , Dongxiao Yu , Weifeng Lv , Xiuzhen Cheng

This paper introduces a federated learning framework tailored for online combinatorial optimization with bandit feedback. In this setting, agents select subsets of arms, observe noisy rewards for these subsets without accessing individual…

Machine Learning · Computer Science 2024-05-10 Fares Fourati , Mohamed-Slim Alouini , Vaneet Aggarwal

We study a regret minimization problem with the existence of multiple best/near-optimal arms in the multi-armed bandit setting. We consider the case when the number of arms/actions is comparable or much larger than the time horizon, and…

Machine Learning · Statistics 2020-10-23 Yinglun Zhu , Robert Nowak

We consider the cooperative multi-player version of the stochastic multi-armed bandit problem. We study the regime where the players cannot communicate but have access to shared randomness. In prior work by the first two authors, a strategy…

Machine Learning · Computer Science 2020-11-10 Sébastien Bubeck , Thomas Budzinski , Mark Sellke

Social learning is learning through the observation of or interaction with other individuals; it is critical in the understanding of the collective behaviors of humans in social physics. We study the learning process of agents in a restless…

Physics and Society · Physics 2020-12-01 Kazuaki Nakayama , Ryuzo Nakamura , Masato Hisakado , Shintaro Mori
‹ Prev 1 2 3 10 Next ›