中文
相关论文

相关论文: Federated Linear Bandits with Finite Adversarial A…

200 篇论文

We study federated contextual linear bandits, where $M$ agents cooperate with each other to solve a global contextual linear bandit problem with the help of a central server. We consider the asynchronous setting, where all agents work…

机器学习 · 计算机科学 2022-07-08 Jiafan He , Tianhao Wang , Yifei Min , Quanquan Gu

We study the linear contextual bandit problem with finite action sets. When the problem dimension is $d$, the time horizon is $T$, and there are $n \leq 2^{d/2}$ candidate actions per time period, we (1) show that the minimax expected…

机器学习 · 统计学 2020-08-20 Yingkai Li , Yining Wang , Yuan Zhou

Linear contextual bandit is a popular online learning problem. It has been mostly studied in centralized learning settings. With the surging demand of large-scale decentralized model learning, e.g., federated learning, how to retain regret…

机器学习 · 计算机科学 2021-10-05 Chuanhao Li , Hongning Wang

We study a constrained contextual linear bandit setting, where the goal of the agent is to produce a sequence of policies, whose expected cumulative reward over the course of $T$ rounds is maximum, and each has an expected cost below a…

机器学习 · 计算机科学 2020-06-20 Aldo Pacchiano , Mohammad Ghavamzadeh , Peter Bartlett , Heinrich Jiang

We study decentralized stochastic linear bandits, where a network of $N$ agents acts cooperatively to efficiently solve a linear bandit-optimization problem over a $d$-dimensional space. For this problem, we propose DLUCB: a fully…

机器学习 · 计算机科学 2020-12-02 Sanae Amani , Christos Thrampoulidis

Federated optimization studies the problem of collaborative function optimization among multiple clients (e.g. mobile devices or organizations) under the coordination of a central server. Since the data is collected separately by each…

机器学习 · 计算机科学 2023-11-06 Chuanhao Li , Chong Liu , Yu-Xiang Wang

We study distributed contextual linear bandits with stochastic contexts, where $N$ agents act cooperatively to solve a linear bandit-optimization problem with $d$-dimensional features over the course of $T$ rounds. For this problem, we…

机器学习 · 计算机科学 2022-12-09 Sanae Amani , Tor Lattimore , András György , Lin F. Yang

The rapid proliferation of decentralized learning systems mandates the need for differentially-private cooperative learning. In this paper, we study this in context of the contextual linear bandit: we consider a collection of agents…

机器学习 · 计算机科学 2020-10-23 Abhimanyu Dubey , Alex Pentland

In federated contextual linear bandits, high data dimensionality incurs prohibitive computation and communication costs: local agents perform $O(d^3)$-time determinant computation and upload $O(d^2)$ parameters, making existing algorithms…

机器学习 · 计算机科学 2026-05-04 Hantao Yang , Hong Xie , Xutong Liu , Defu Lian

Contextual linear dueling bandits have recently garnered significant attention due to their widespread applications in important domains such as recommender systems and large language models. Classical dueling bandit algorithms are…

机器学习 · 计算机科学 2025-06-04 Xuhan Huang , Yan Hu , Zhiyan Li , Zhiyong Wang , Benyou Wang , Zhongxiang Dai

In this paper, we investigate federated contextual linear bandit learning within a wireless system that comprises a server and multiple devices. Each device interacts with the environment, selects an action based on the received reward, and…

机器学习 · 计算机科学 2023-08-29 Jiali Wang , Yuning Jiang , Xin Liu , Ting Wang , Yuanming Shi

We study the problem of federated contextual combinatorial cascading bandits, where $|\mathcal{U}|$ agents collaborate under the coordination of a central server to provide tailored recommendations to the $|\mathcal{U}|$ corresponding…

机器学习 · 计算机科学 2024-02-27 Hantao Yang , Xutong Liu , Zhiyong Wang , Hong Xie , John C. S. Lui , Defu Lian , Enhong Chen

This work studies linear bandits under a new notion of gap-adjusted misspecification and is an extension of Liu et al. (2023). When the underlying reward function is not linear, existing linear bandits work usually relies on a uniform…

机器学习 · 计算机科学 2025-01-10 Chong Liu , Dan Qiao , Ming Yin , Ilija Bogunovic , Yu-Xiang Wang

We present an efficient algorithm for linear contextual bandits with adversarial losses and stochastic action sets. Our approach reduces this setting to misspecification-robust adversarial linear bandits with fixed action sets. Without…

机器学习 · 计算机科学 2025-12-16 Tim van Erven , Jack Mayo , Julia Olkhovskaya , Chen-Yu Wei

We consider a linear stochastic bandit problem involving $M$ agents that can collaborate via a central server to minimize regret. A fraction $\alpha$ of these agents are adversarial and can act arbitrarily, leading to the following tension:…

机器学习 · 计算机科学 2022-06-08 Aritra Mitra , Arman Adibi , George J. Pappas , Hamed Hassani

This paper studies federated linear contextual bandits under the notion of user-level differential privacy (DP). We first introduce a unified federated bandits framework that can accommodate various definitions of DP in the sequential…

机器学习 · 计算机科学 2023-06-14 Ruiquan Huang , Huanyu Zhang , Luca Melis , Milan Shen , Meisam Hajzinia , Jing Yang

The demand for collaborative and private bandit learning across multiple agents is surging due to the growing quantity of data generated from distributed systems. Federated bandit learning has emerged as a promising framework for private,…

机器学习 · 计算机科学 2024-03-04 Ethan Blaser , Chuanhao Li , Hongning Wang

We consider cross-silo federated linear contextual bandit (LCB) problem under differential privacy, where multiple silos (agents) interact with the local users and communicate via a central server to realize collaboration while without…

机器学习 · 计算机科学 2023-06-01 Xingyu Zhou , Sayak Ray Chowdhury

In this study, we explore a collaborative multi-agent stochastic linear bandit setting involving a network of $N$ agents that communicate locally to minimize their collective regret while keeping their expected cost under a specified…

机器学习 · 计算机科学 2024-10-24 Amirhossein Afsharrad , Parisa Oftadeh , Ahmadreza Moradipari , Sanjay Lall

Federated multi-armed bandits (FMAB) is a new bandit paradigm that parallels the federated learning (FL) framework in supervised learning. It is inspired by practical applications in cognitive radio and recommender systems, and enjoys…

机器学习 · 计算机科学 2021-03-04 Chengshuai Shi , Cong Shen
‹ 上一页 1 2 3 10 下一页 ›