中文
相关论文

相关论文: Differentially-Private Federated Linear Bandits

200 篇论文

In this paper, we study \emph{Federated Bandit}, a decentralized Multi-Armed Bandit problem with a set of $N$ agents, who can only communicate their local data with neighbors described by a connected graph $G$. Each agent makes a sequence…

机器学习 · 计算机科学 2021-04-08 Zhaowei Zhu , Jingxuan Zhu , Ji Liu , Yang Liu

Communication bottleneck and data privacy are two critical concerns in federated multi-armed bandit (MAB) problems, such as situations in decision-making and recommendations of connected vehicles via wireless. In this paper, we design the…

机器学习 · 计算机科学 2021-11-03 Tan Li , Linqi Song

Sequential learning in a multi-agent resource constrained matching market has received significant interest in the past few years. We study decentralized learning in two-sided matching markets where the demand side (aka players or agents)…

机器学习 · 计算机科学 2025-06-23 Satush Parikh , Soumya Basu , Avishek Ghosh , Abishek Sankararaman

This paper presents a novel federated linear contextual bandits model, where individual clients face different $K$-armed stochastic bandits coupled through common global parameters. By leveraging the geometric structure of the linear…

机器学习 · 统计学 2021-10-28 Ruiquan Huang , Weiqiang Wu , Jing Yang , Cong Shen

Safety is a desirable property that can immensely increase the applicability of learning algorithms in real-world decision-making problems. It is much easier for a company to deploy an algorithm that is safe, i.e., guaranteed to perform at…

机器学习 · 统计学 2017-03-07 Abbas Kazerouni , Mohammad Ghavamzadeh , Yasin Abbasi-Yadkori , Benjamin Van Roy

We present conservative distributed multi-task learning in stochastic linear contextual bandits with heterogeneous agents. This extends conservative linear bandits to a distributed setting where M agents tackle different but related tasks…

机器学习 · 计算机科学 2025-04-29 Jiabin Lin , Shana Moothedath

In this paper, we investigate the impact of context diversity on stochastic linear contextual bandits. As opposed to the previous view that contexts lead to more difficult bandit learning, we show that when the contexts are sufficiently…

机器学习 · 计算机科学 2020-03-06 Weiqiang Wu , Jing Yang , Cong Shen

We study decentralized stochastic linear bandits, where a network of $N$ agents acts cooperatively to efficiently solve a linear bandit-optimization problem over a $d$-dimensional space. For this problem, we propose DLUCB: a fully…

机器学习 · 计算机科学 2020-12-02 Sanae Amani , Christos Thrampoulidis

In this paper we propose a novel framework for decentralized, online learning by many learners. At each moment of time, an instance characterized by a certain context may arrive to each learner; based on the context, the learner can select…

机器学习 · 计算机科学 2015-03-24 Cem Tekin , Mihaela van der Schaar

We study the heavy-tailed stochastic bandit problem in the cooperative multi-agent setting, where a group of agents interact with a common bandit problem, while communicating on a network with delays. Existing algorithms for the stochastic…

机器学习 · 计算机科学 2020-08-17 Abhimanyu Dubey , Alex Pentland

We study a federated linear bandits model, where $M$ clients communicate with a central server to solve a linear contextual bandits problem with finite adversarial action sets that may be different across clients. To address the unique…

机器学习 · 计算机科学 2023-11-03 Li Fan , Ruida Zhou , Chao Tian , Cong Shen

The study of collaborative multi-agent bandits has attracted significant attention recently. In light of this, we initiate the study of a new collaborative setting, consisting of $N$ agents such that each agent is learning one of $M$…

机器学习 · 计算机科学 2024-07-04 Ronshee Chawla , Daniel Vial , Sanjay Shakkottai , R. Srikant

We consider a collection of linear stochastic bandit problems, each modeling the random response of different agents to proposed interventions, coupled together by a global safety constraint. We assume a central coordinator must choose…

最优化与控制 · 数学 2025-04-24 Arghavan Zibaie , Spencer Hutchinson , Ramtin Pedarsani , Mahnoosh Alizadeh

The cooperative bandit problem is a multi-agent decision problem involving a group of agents that interact simultaneously with a multi-armed bandit, while communicating over a network with delays. The central idea in this problem is to…

机器学习 · 统计学 2022-05-31 Abhimanyu Dubey , Alex Pentland

Contextual bandit algorithms provide principled online learning solutions to balance the exploitation-exploration trade-off in various applications such as recommender systems. However, the learning speed of the traditional contextual…

机器学习 · 计算机科学 2020-01-28 Xiaoying Zhang , Hong Xie , Hang Li , John C. S. Lui

This paper studies a decentralized homogeneous multi-armed bandit problem in a multi-agent network. The problem is simultaneously solved by $N$ agents assuming they face a common set of $M$ arms and share the same arms' reward…

机器学习 · 计算机科学 2024-12-31 Jingxuan Zhu , Ethan Mulle , Christopher S. Smith , Alec Koppel , Ji Liu

In federated learning (FL), model training is distributed over clients and local models are aggregated by a central server. The performance of uploaded models in such situations can vary widely due to imbalanced data distributions,…

分布式、并行与集群计算 · 计算机科学 2021-09-14 Kang Wei , Jun Li , Chuan Ma , Ming Ding , Cailian Chen , Shi Jin , Zhu Han , H. Vincent Poor

Cooperative decentralized learning relies on direct information exchange between communicating agents, each with access to locally available datasets. The goal is to agree on model parameters that are optimal over all data. However, sharing…

机器学习 · 计算机科学 2024-10-28 Jasmine Bayrooti , Zhan Gao , Amanda Prorok

Federated learning (FL) has demonstrated great potential in revolutionizing distributed machine learning, and tremendous efforts have been made to extend it beyond the original focus on supervised learning. Among many directions, federated…

机器学习 · 统计学 2024-09-17 Chengshuai Shi , Ruida Zhou , Kun Yang , Cong Shen

We study a collaborative multi-agent stochastic linear bandit setting, where $N$ agents that form a network communicate locally to minimize their overall regret. In this setting, each agent has its own linear bandit problem (its own reward…

机器学习 · 计算机科学 2022-05-16 Ahmadreza Moradipari , Mohammad Ghavamzadeh , Mahnoosh Alizadeh