中文
相关论文

相关论文: Near-Optimal Regret for Distributed Adversarial Ba…

200 篇论文

We study the problem of regret minimization for distributed bandits learning, in which $M$ agents work collaboratively to minimize their total regret under the coordination of a central server. Our goal is to design communication protocols…

机器学习 · 计算机科学 2019-05-30 Yuanhao Wang , Jiachen Hu , Xiaoyu Chen , Liwei Wang

We study agents communicating over an underlying network by exchanging messages, in order to optimize their individual regret in a common nonstochastic multi-armed bandit problem. We derive regret minimization algorithms that guarantee for…

机器学习 · 计算机科学 2019-11-19 Yogev Bar-On , Yishay Mansour

We consider distributed linear bandits where $M$ agents learn collaboratively to minimize the overall cumulative regret incurred by all agents. Information exchange is facilitated by a central server, and both the uplink and downlink…

机器学习 · 计算机科学 2025-11-17 Sudeep Salgia , Qing Zhao

We investigate distributed online convex optimization with compressed communication, where $n$ learners connected by a network collaboratively minimize a sequence of global loss functions using only local information and compressed data…

机器学习 · 计算机科学 2026-01-12 Sifan Yang , Wenhao Yang , Wei Jiang , Lijun Zhang

We consider a linear stochastic bandit problem involving $M$ agents that can collaborate via a central server to minimize regret. A fraction $\alpha$ of these agents are adversarial and can act arbitrarily, leading to the following tension:…

机器学习 · 计算机科学 2022-06-08 Aritra Mitra , Arman Adibi , George J. Pappas , Hamed Hassani

We present an efficient algorithm for linear contextual bandits with adversarial losses and stochastic action sets. Our approach reduces this setting to misspecification-robust adversarial linear bandits with fixed action sets. Without…

机器学习 · 计算机科学 2025-12-16 Tim van Erven , Jack Mayo , Julia Olkhovskaya , Chen-Yu Wei

We study networks of communicating learning agents that cooperate to solve a common nonstochastic bandit problem. Agents use an underlying communication network to get messages about actions selected by other agents, and drop messages that…

机器学习 · 计算机科学 2016-06-02 Nicolo' Cesa-Bianchi , Claudio Gentile , Yishay Mansour , Alberto Minora

We study the stochastic shortest path problem with adversarial costs and known transition, and show that the minimax regret is $\widetilde{O}(\sqrt{DT^\star K})$ and $\widetilde{O}(\sqrt{DT^\star SA K})$ for the full-information setting and…

机器学习 · 计算机科学 2021-06-23 Liyu Chen , Haipeng Luo , Chen-Yu Wei

It is well-known that for sparse linear bandits, when ignoring the dependency on sparsity which is much smaller than the ambient dimension, the worst-case minimax regret is $\widetilde{\Theta}\left(\sqrt{dT}\right)$ where $d$ is the ambient…

机器学习 · 计算机科学 2023-02-08 Yan Dai , Ruosong Wang , Simon S. Du

Recently, there has been extensive study of cooperative multi-agent multi-armed bandits where a set of distributed agents cooperatively play the same multi-armed bandit game. The goal is to develop bandit algorithms with the optimal group…

机器学习 · 计算机科学 2023-08-09 Lin Yang , Xuchuang Wang , Mohammad Hajiesmaili , Lijun Zhang , John C. S. Lui , Don Towsley

We investigate bandit convex optimization (BCO) with delayed feedback, where only the loss value of the action is revealed under an arbitrary delay. Let $n,T,\bar{d}$ denote the dimensionality, time horizon, and average delay, respectively.…

机器学习 · 计算机科学 2024-06-25 Yuanyu Wan , Chang Yao , Mingli Song , Lijun Zhang

We study a collaborative multi-agent stochastic linear bandit setting, where $N$ agents that form a network communicate locally to minimize their overall regret. In this setting, each agent has its own linear bandit problem (its own reward…

机器学习 · 计算机科学 2022-05-16 Ahmadreza Moradipari , Mohammad Ghavamzadeh , Mahnoosh Alizadeh

In this study, we explore a collaborative multi-agent stochastic linear bandit setting involving a network of $N$ agents that communicate locally to minimize their collective regret while keeping their expected cost under a specified…

机器学习 · 计算机科学 2024-10-24 Amirhossein Afsharrad , Parisa Oftadeh , Ahmadreza Moradipari , Sanjay Lall

We make significant progress toward the stochastic shortest path problem with adversarial costs and unknown transition. Specifically, we develop algorithms that achieve $\widetilde{O}(\sqrt{S^2ADT_\star K})$ regret for the full-information…

机器学习 · 计算机科学 2021-06-15 Liyu Chen , Haipeng Luo

We study the problem of adversarial combinatorial bandit with a switching cost $\lambda$ for a switch of each selected arm in each round, considering both the bandit feedback and semi-bandit feedback settings. In the oblivious adversarial…

机器学习 · 统计学 2024-04-03 Yanyan Dong , Vincent Y. F. Tan

We prove that the information-theoretic upper bound on the minimax regret for zeroth-order adversarial bandit convex optimisation is at most $O(d^{2.5} \sqrt{n} \log(n))$, where $d$ is the dimension and $n$ is the number of interactions.…

最优化与控制 · 数学 2020-09-28 Tor Lattimore

We study the stochastic linear bandits with parameter noise model, in which the reward of action $a$ is $a^\top \theta$ where $\theta$ is sampled i.i.d. We show a regret upper bound of $\widetilde{O} (\sqrt{d T \log (K/\delta)…

机器学习 · 计算机科学 2026-05-26 Daniel Ezer , Alon Peled-Cohen , Yishay Mansour

We consider distributed kernel bandits where $N$ agents aim to collaboratively maximize an unknown reward function that lies in a reproducing kernel Hilbert space. Each agent sequentially queries the function to obtain noisy observations at…

机器学习 · 计算机科学 2024-02-21 Nikola Pavlovic , Sudeep Salgia , Qing Zhao

We consider regret minimization in a general collaborative multi-agent multi-armed bandit model, in which each agent faces a finite set of arms and may communicate with other agents through a central controller. The optimal arm for each…

机器学习 · 计算机科学 2023-12-18 Amitis Shidani , Sattar Vakili

We revisit the study of optimal regret rates in bandit combinatorial optimization---a fundamental framework for sequential decision making under uncertainty that abstracts numerous combinatorial prediction problems. We prove that the…

机器学习 · 计算机科学 2017-02-27 Alon Cohen , Tamir Hazan , Tomer Koren
‹ 上一页 1 2 3 10 下一页 ›