中文
相关论文

相关论文: Collaborative Learning in Kernel-based Bandits for…

200 篇论文

In this paper we consider online distributed learning problems. Online distributed learning refers to the process of training learning models on distributed data sources. In our setting a set of agents need to cooperatively train a learning…

机器学习 · 计算机科学 2024-05-07 Nicola Bastianello , Apostolos I. Rikos , Karl H. Johansson

In this paper, we formulate a Collaborative Pure Exploration in Kernel Bandit problem (CoPE-KB), which provides a novel model for multi-agent multi-task decision making under limited communication and general reward functions, and is…

机器学习 · 计算机科学 2023-03-17 Yihan Du , Wei Chen , Yuko Kuroki , Longbo Huang

We present a generalization of the adversarial linear bandits framework, where the underlying losses are kernel functions (with an associated reproducing kernel Hilbert space) rather than linear functions. We study a version of the…

机器学习 · 统计学 2018-02-28 Aldo Pacchiano , Niladri S. Chatterji , Peter L. Bartlett

Federated optimization studies the problem of collaborative function optimization among multiple clients (e.g. mobile devices or organizations) under the coordination of a central server. Since the data is collected separately by each…

机器学习 · 计算机科学 2023-11-06 Chuanhao Li , Chong Liu , Yu-Xiang Wang

We consider Bayesian optimization using Gaussian Process models, also referred to as kernel-based bandit optimization. We study the methodology of exploring the domain using random samples drawn from a distribution. We show that this random…

机器学习 · 计算机科学 2024-02-05 Sudeep Salgia , Sattar Vakili , Qing Zhao

We consider distributed online learning for joint regret with communication constraints. In this setting, there are multiple agents that are connected in a graph. Each round, an adversary first activates one of the agents to issue a…

机器学习 · 计算机科学 2021-10-26 Dirk van der Hoeven , Hédi Hadiji , Tim van Erven

We consider a linear stochastic bandit problem involving $M$ agents that can collaborate via a central server to minimize regret. A fraction $\alpha$ of these agents are adversarial and can act arbitrarily, leading to the following tension:…

机器学习 · 计算机科学 2022-06-08 Aritra Mitra , Arman Adibi , George J. Pappas , Hamed Hassani

Recently, there has been extensive study of cooperative multi-agent multi-armed bandits where a set of distributed agents cooperatively play the same multi-armed bandit game. The goal is to develop bandit algorithms with the optimal group…

机器学习 · 计算机科学 2023-08-09 Lin Yang , Xuchuang Wang , Mohammad Hajiesmaili , Lijun Zhang , John C. S. Lui , Don Towsley

We provide two distributed confidence ball algorithms for solving linear bandit problems in peer to peer networks with limited communication capabilities. For the first, we assume that all the peers are solving the same linear bandit…

机器学习 · 计算机科学 2016-06-08 Nathan Korda , Balazs Szorenyi , Shuai Li

We tackle the problem of online reward maximisation over a large finite set of actions described by their contexts. We focus on the case when the number of actions is too big to sample all of them even once. However we assume that we have…

机器学习 · 计算机科学 2013-09-27 Michal Valko , Nathaniel Korda , Remi Munos , Ilias Flaounas , Nelo Cristianini

We consider the problem of online stochastic optimization in a distributed setting with $M$ clients connected through a central server. We develop a distributed online learning algorithm that achieves order-optimal cumulative regret with…

机器学习 · 计算机科学 2023-06-07 Sudeep Salgia , Qing Zhao , Tamir Gabay , Kobi Cohen

Gaussian processes (GP) are a well studied Bayesian approach for the optimization of black-box functions. Despite their effectiveness in simple problems, GP-based algorithms hardly scale to high-dimensional functions, as their per-iteration…

We consider the problem of multiple users targeting the arms of a single multi-armed stochastic bandit. The motivation for this problem comes from cognitive radio networks, where selfish users need to coexist without any side communication…

机器学习 · 计算机科学 2014-04-23 Orly Avner , Shie Mannor

We study a collaborative multi-agent stochastic linear bandit setting, where $N$ agents that form a network communicate locally to minimize their overall regret. In this setting, each agent has its own linear bandit problem (its own reward…

机器学习 · 计算机科学 2022-05-16 Ahmadreza Moradipari , Mohammad Ghavamzadeh , Mahnoosh Alizadeh

We study an algorithm-independent, worst-case lower bound for the Gaussian process (GP) bandit problem in the frequentist setting, where the reward function is fixed and has a bounded norm in the known reproducing kernel Hilbert space…

机器学习 · 计算机科学 2026-02-23 Shogo Iwazaki

Many applications require optimizing an unknown, noisy function that is expensive to evaluate. We formalize this task as a multi-armed bandit problem, where the payoff function is either sampled from a Gaussian process (GP) or has low RKHS…

机器学习 · 计算机科学 2015-03-13 Niranjan Srinivas , Andreas Krause , Sham M. Kakade , Matthias Seeger

By exploiting the computing power and local data of distributed clients, federated learning (FL) features ubiquitous properties such as reduction of communication overhead and preserving data privacy. In each communication round of FL, the…

信息论 · 计算机科学 2020-07-21 Wenchao Xia , Tony Q. S. Quek , Kun Guo , Wanli Wen , Howard H. Yang , Hongbo Zhu

We study the regret minimization problem in the novel setting of generalized kernelized bandits (GKBs), where we optimize an unknown function $f^*$ belonging to a reproducing kernel Hilbert space (RKHS) having access to samples generated by…

机器学习 · 计算机科学 2025-12-12 Alberto Maria Metelli , Simone Drago , Marco Mussi

Contextual bandits algorithms aim to choose the optimal arm with the highest reward out of a set of candidates based on the contextual information. Various bandit algorithms have been applied to real-world applications due to their ability…

机器学习 · 计算机科学 2023-08-22 Yunzhe Qi , Yikun Ban , Jingrui He

We consider a decentralized multiplayer game, played over $T$ rounds, with a leader-follower hierarchy described by a directed acyclic graph. For each round, the graph structure dictates the order of the players and how players observe the…

机器学习 · 计算机科学 2023-01-30 Johan Östman , Ather Gattami , Daniel Gillblad