English
Related papers

Related papers: Differentially-Private Federated Linear Bandits

200 papers

In this paper, we study \emph{Federated Bandit}, a decentralized Multi-Armed Bandit problem with a set of $N$ agents, who can only communicate their local data with neighbors described by a connected graph $G$. Each agent makes a sequence…

Machine Learning · Computer Science 2021-04-08 Zhaowei Zhu , Jingxuan Zhu , Ji Liu , Yang Liu

Communication bottleneck and data privacy are two critical concerns in federated multi-armed bandit (MAB) problems, such as situations in decision-making and recommendations of connected vehicles via wireless. In this paper, we design the…

Machine Learning · Computer Science 2021-11-03 Tan Li , Linqi Song

Sequential learning in a multi-agent resource constrained matching market has received significant interest in the past few years. We study decentralized learning in two-sided matching markets where the demand side (aka players or agents)…

Machine Learning · Computer Science 2025-06-23 Satush Parikh , Soumya Basu , Avishek Ghosh , Abishek Sankararaman

This paper presents a novel federated linear contextual bandits model, where individual clients face different $K$-armed stochastic bandits coupled through common global parameters. By leveraging the geometric structure of the linear…

Machine Learning · Statistics 2021-10-28 Ruiquan Huang , Weiqiang Wu , Jing Yang , Cong Shen

Safety is a desirable property that can immensely increase the applicability of learning algorithms in real-world decision-making problems. It is much easier for a company to deploy an algorithm that is safe, i.e., guaranteed to perform at…

Machine Learning · Statistics 2017-03-07 Abbas Kazerouni , Mohammad Ghavamzadeh , Yasin Abbasi-Yadkori , Benjamin Van Roy

We present conservative distributed multi-task learning in stochastic linear contextual bandits with heterogeneous agents. This extends conservative linear bandits to a distributed setting where M agents tackle different but related tasks…

Machine Learning · Computer Science 2025-04-29 Jiabin Lin , Shana Moothedath

In this paper, we investigate the impact of context diversity on stochastic linear contextual bandits. As opposed to the previous view that contexts lead to more difficult bandit learning, we show that when the contexts are sufficiently…

Machine Learning · Computer Science 2020-03-06 Weiqiang Wu , Jing Yang , Cong Shen

We study decentralized stochastic linear bandits, where a network of $N$ agents acts cooperatively to efficiently solve a linear bandit-optimization problem over a $d$-dimensional space. For this problem, we propose DLUCB: a fully…

Machine Learning · Computer Science 2020-12-02 Sanae Amani , Christos Thrampoulidis

In this paper we propose a novel framework for decentralized, online learning by many learners. At each moment of time, an instance characterized by a certain context may arrive to each learner; based on the context, the learner can select…

Machine Learning · Computer Science 2015-03-24 Cem Tekin , Mihaela van der Schaar

We study the heavy-tailed stochastic bandit problem in the cooperative multi-agent setting, where a group of agents interact with a common bandit problem, while communicating on a network with delays. Existing algorithms for the stochastic…

Machine Learning · Computer Science 2020-08-17 Abhimanyu Dubey , Alex Pentland

We study a federated linear bandits model, where $M$ clients communicate with a central server to solve a linear contextual bandits problem with finite adversarial action sets that may be different across clients. To address the unique…

Machine Learning · Computer Science 2023-11-03 Li Fan , Ruida Zhou , Chao Tian , Cong Shen

The study of collaborative multi-agent bandits has attracted significant attention recently. In light of this, we initiate the study of a new collaborative setting, consisting of $N$ agents such that each agent is learning one of $M$…

Machine Learning · Computer Science 2024-07-04 Ronshee Chawla , Daniel Vial , Sanjay Shakkottai , R. Srikant

We consider a collection of linear stochastic bandit problems, each modeling the random response of different agents to proposed interventions, coupled together by a global safety constraint. We assume a central coordinator must choose…

Optimization and Control · Mathematics 2025-04-24 Arghavan Zibaie , Spencer Hutchinson , Ramtin Pedarsani , Mahnoosh Alizadeh

The cooperative bandit problem is a multi-agent decision problem involving a group of agents that interact simultaneously with a multi-armed bandit, while communicating over a network with delays. The central idea in this problem is to…

Machine Learning · Statistics 2022-05-31 Abhimanyu Dubey , Alex Pentland

Contextual bandit algorithms provide principled online learning solutions to balance the exploitation-exploration trade-off in various applications such as recommender systems. However, the learning speed of the traditional contextual…

Machine Learning · Computer Science 2020-01-28 Xiaoying Zhang , Hong Xie , Hang Li , John C. S. Lui

This paper studies a decentralized homogeneous multi-armed bandit problem in a multi-agent network. The problem is simultaneously solved by $N$ agents assuming they face a common set of $M$ arms and share the same arms' reward…

Machine Learning · Computer Science 2024-12-31 Jingxuan Zhu , Ethan Mulle , Christopher S. Smith , Alec Koppel , Ji Liu

In federated learning (FL), model training is distributed over clients and local models are aggregated by a central server. The performance of uploaded models in such situations can vary widely due to imbalanced data distributions,…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-14 Kang Wei , Jun Li , Chuan Ma , Ming Ding , Cailian Chen , Shi Jin , Zhu Han , H. Vincent Poor

Cooperative decentralized learning relies on direct information exchange between communicating agents, each with access to locally available datasets. The goal is to agree on model parameters that are optimal over all data. However, sharing…

Machine Learning · Computer Science 2024-10-28 Jasmine Bayrooti , Zhan Gao , Amanda Prorok

Federated learning (FL) has demonstrated great potential in revolutionizing distributed machine learning, and tremendous efforts have been made to extend it beyond the original focus on supervised learning. Among many directions, federated…

Machine Learning · Statistics 2024-09-17 Chengshuai Shi , Ruida Zhou , Kun Yang , Cong Shen

We study a collaborative multi-agent stochastic linear bandit setting, where $N$ agents that form a network communicate locally to minimize their overall regret. In this setting, each agent has its own linear bandit problem (its own reward…

Machine Learning · Computer Science 2022-05-16 Ahmadreza Moradipari , Mohammad Ghavamzadeh , Mahnoosh Alizadeh