English
Related papers

Related papers: Pure Exploration in Asynchronous Federated Bandits

200 papers

Identifying the best arm of a multi-armed bandit is a central problem in bandit optimization. We study a quantum computational version of this problem with coherent oracle access to states encoding the reward probabilities of each arm as…

Quantum Physics · Physics 2023-02-02 Daochen Wang , Xuchen You , Tongyang Li , Andrew M. Childs

In this paper, we study a linear bandit optimization problem in a federated setting where a large collection of distributed agents collaboratively learn a common linear bandit model. Standard federated learning algorithms applied to this…

Machine Learning · Computer Science 2022-04-05 Ali Jadbabaie , Haochuan Li , Jian Qian , Yi Tian

We study the stochastic Multiplayer Multi-Armed Bandit (MMAB) problem, where multiple players select arms to maximize their cumulative rewards. Collisions occur when two or more players select the same arm, resulting in no reward, and are…

Machine Learning · Computer Science 2025-10-09 Daoyuan Zhou , Xuchuang Wang , Lin Yang , Yang Gao

We study the problems of distributed online and bandit convex optimization against an adaptive adversary. We aim to minimize the average regret on $M$ machines working in parallel over $T$ rounds with $R$ intermittent communications.…

Machine Learning · Computer Science 2023-11-30 Kumar Kshitij Patel , Lingxiao Wang , Aadirupa Saha , Nati Sebro

The demand for collaborative and private bandit learning across multiple agents is surging due to the growing quantity of data generated from distributed systems. Federated bandit learning has emerged as a promising framework for private,…

Machine Learning · Computer Science 2024-03-04 Ethan Blaser , Chuanhao Li , Hongning Wang

Motivated by real-world applications such as fast fashion retailing and online advertising, the Multinomial Logit Bandit (MNL-bandit) is a popular model in online learning and operations research, and has attracted much attention in the…

Machine Learning · Computer Science 2021-08-17 Nikolai Karpov , Qin Zhang

We consider a multi-armed bandit setting with finitely many arms, in which each arm yields an $M$-dimensional vector reward upon selection. We assume that the reward of each dimension (a.k.a. {\em objective}) is generated independently of…

Machine Learning · Computer Science 2025-01-24 Zhirui Chen , P. N. Karthik , Yeow Meng Chee , Vincent Y. F. Tan

Conversational recommender systems have emerged as a potent solution for efficiently eliciting user preferences. These systems interactively present queries associated with "key terms" to users and leverage user feedback to estimate user…

Machine Learning · Computer Science 2024-08-13 Zhuohua Li , Maoli Liu , John C. S. Lui

The multi-armed bandit (MAB) problem is an active learning framework that aims to select the best among a set of actions by sequentially observing rewards. Recently, it has become popular for a number of applications over wireless networks,…

Machine Learning · Computer Science 2021-11-12 Osama A. Hanna , Lin F. Yang , Christina Fragouli

We study the real-valued combinatorial pure exploration of the multi-armed bandit in the fixed-budget setting. We first introduce the Combinatorial Successive Asign (CSA) algorithm, which is the first algorithm that can identify the best…

Machine Learning · Computer Science 2023-11-16 Shintaro Nakamura , Masashi Sugiyama

We study the problem of regret minimization for distributed bandits learning, in which $M$ agents work collaboratively to minimize their total regret under the coordination of a central server. Our goal is to design communication protocols…

Machine Learning · Computer Science 2019-05-30 Yuanhao Wang , Jiachen Hu , Xiaoyu Chen , Liwei Wang

This paper studies a cooperative multi-agent multi-armed stochastic bandit problem where agents operate asynchronously -- agent pull times and rates are unknown, irregular, and heterogeneous -- and face the same instance of a K-armed bandit…

Machine Learning · Computer Science 2023-09-01 Yu-Zhen Janice Chen , Lin Yang , Xuchuang Wang , Xutong Liu , Mohammad Hajiesmaili , John C. S. Lui , Don Towsley

Recently, bandit optimization has received significant attention in real-world safety-critical systems that involve repeated interactions with humans. While there exist various algorithms with performance guarantees in the literature,…

Machine Learning · Computer Science 2023-11-13 Amirhossein Afsharrad , Ahmadreza Moradipari , Sanjay Lall

We study a federated linear bandits model, where $M$ clients communicate with a central server to solve a linear contextual bandits problem with finite adversarial action sets that may be different across clients. To address the unique…

Machine Learning · Computer Science 2023-11-03 Li Fan , Ruida Zhou , Chao Tian , Cong Shen

We consider a scenario where an agent has multiple available strategies to explore an unknown environment. For each new interaction with the environment, the agent must select which exploration strategy to use. We provide a new…

Machine Learning · Computer Science 2018-08-24 Fabien C. Y. Benureau , Pierre-Yves Oudeyer

The multi-armed bandit(MAB) is a classical sequential decision problem. Most work requires assumptions about the reward distribution (e.g., bounded), while practitioners may have difficulty obtaining information about these distributions to…

Machine Learning · Computer Science 2023-12-14 Han Qi , Fei Guo , Li Zhu

A popular computer puzzle, the game of Minesweeper requires its human players to have a mix of both luck and strategy to succeed. Analyzing these aspects more formally, in our research we assessed the feasibility of a novel methodology…

Machine Learning · Computer Science 2021-06-21 Igor Q. Lordeiro , Diego B. Haddad , Douglas O. Cardoso

We study the problem of stochastic bandits with adversarial corruptions in the cooperative multi-agent setting, where $V$ agents interact with a common $K$-armed bandit problem, and each pair of agents can communicate with each other to…

Machine Learning · Computer Science 2021-06-09 Junyan Liu , Shuai Li , Dapeng Li

We study the cooperative stochastic $k$-armed bandit problem, where a network of $m$ agents collaborate to find the optimal action. In contrast to most prior work on this problem, which focuses on extending a specific algorithm to the…

Machine Learning · Computer Science 2024-11-01 Benjamin Howson , Sarah Filippi , Ciara Pike-Burke

This paper proposes a novel policy for a group of agents to, individually as well as collectively, solve a multi armed bandit (MAB) problem. The policy relies solely on the information that an agent has obtained through sampling of the…

Machine Learning · Computer Science 2020-02-24 Pathmanathan Pankayaraj , D. H. S. Maithripala
‹ Prev 1 4 5 6 7 8 10 Next ›