English
Related papers

Related papers: Accelerating Distributed Online Meta-Learning via …

200 papers

Online multi-agent control problems, where many agents pursue competing and time-varying objectives, are widespread in domains such as autonomous robotics, economics, and energy systems. In these settings, robustness to adversarial…

Machine Learning · Computer Science 2025-09-29 Anas Barakat , John Lazarsfeld , Georgios Piliouras , Antonios Varvitsiotis

This paper addresses Online Convex Optimization (OCO) problems where the constraints have additive perturbations that (i) vary over time and (ii) are not known at the time to make a decision. Perturbations may not be i.i.d. generated and…

Optimization and Control · Mathematics 2019-06-04 Víctor Valls , George Iosifidis , Douglas J. Leith , Leandros Tassiulas

We study agents communicating over an underlying network by exchanging messages, in order to optimize their individual regret in a common nonstochastic multi-armed bandit problem. We derive regret minimization algorithms that guarantee for…

Machine Learning · Computer Science 2019-11-19 Yogev Bar-On , Yishay Mansour

We consider a generalization of the celebrated Online Convex Optimization (OCO) framework with adversarial online constraints. In this problem, an online learner interacts with an adversary sequentially over multiple rounds. At the…

Machine Learning · Computer Science 2026-01-07 Subhamon Supantha , Abhishek Sinha

We study online meta-learning with bandit feedback, with the goal of improving performance across multiple tasks if they are similar according to some natural similarity measure. As the first to target the adversarial online-within-online…

Machine Learning · Computer Science 2023-11-02 Mikhail Khodak , Ilya Osadchiy , Keegan Harris , Maria-Florina Balcan , Kfir Y. Levy , Ron Meir , Zhiwei Steven Wu

To deal with complicated constraints via locally light computations in distributed online learning, a recent study has presented a projection-free algorithm called distributed online conditional gradient (D-OCG), and achieved an…

Machine Learning · Computer Science 2022-06-15 Yuanyu Wan , Guanghui Wang , Wei-Wei Tu , Lijun Zhang

Recently, there has been extensive study of cooperative multi-agent multi-armed bandits where a set of distributed agents cooperatively play the same multi-armed bandit game. The goal is to develop bandit algorithms with the optimal group…

Machine Learning · Computer Science 2023-08-09 Lin Yang , Xuchuang Wang , Mohammad Hajiesmaili , Lijun Zhang , John C. S. Lui , Don Towsley

We consider the problem of online stochastic optimization in a distributed setting with $M$ clients connected through a central server. We develop a distributed online learning algorithm that achieves order-optimal cumulative regret with…

Machine Learning · Computer Science 2023-06-07 Sudeep Salgia , Qing Zhao , Tamir Gabay , Kobi Cohen

Modern artificial intelligence relies on networks of agents that collect data, process information, and exchange it with neighbors to collaboratively solve optimization and learning problems. This article introduces a novel distributed…

Optimization and Control · Mathematics 2026-01-15 Diego Deplano , Nicola Bastianello , Mauro Franceschelli , Karl H. Johansson

We study the problem of regret minimization for distributed bandits learning, in which $M$ agents work collaboratively to minimize their total regret under the coordination of a central server. Our goal is to design communication protocols…

Machine Learning · Computer Science 2019-05-30 Yuanhao Wang , Jiachen Hu , Xiaoyu Chen , Liwei Wang

This paper considers distributed online convex constrained optimization, in which various agents in a multi-agent system cooperate to minimize a global cost function through communicating with neighbors over a time-varying network. When the…

Optimization and Control · Mathematics 2023-02-02 Wentao Zhang , Yang Shi , Baoyong Zhang , Deming Yuan

We consider a linear stochastic bandit problem involving $M$ agents that can collaborate via a central server to minimize regret. A fraction $\alpha$ of these agents are adversarial and can act arbitrarily, leading to the following tension:…

Machine Learning · Computer Science 2022-06-08 Aritra Mitra , Arman Adibi , George J. Pappas , Hamed Hassani

This paper investigates distributed online convex optimization in the presence of an aggregative variable without any global/central coordinators over a multi-agent network, where each individual agent is only able to access partial…

Optimization and Control · Mathematics 2020-07-15 Xiuxian Li , Xinlei Yi , Lihua Xie

We consider distributed linear bandits where $M$ agents learn collaboratively to minimize the overall cumulative regret incurred by all agents. Information exchange is facilitated by a central server, and both the uplink and downlink…

Machine Learning · Computer Science 2025-11-17 Sudeep Salgia , Qing Zhao

Stochastic linear bandits are a fundamental model for sequential decision making, where an agent selects a vector-valued action and receives a noisy reward with expected value given by an unknown linear function. Although well studied in…

Machine Learning · Computer Science 2025-06-23 Bruce Huang , Ruida Zhou , Lin F. Yang , Suhas Diggavi

Recently, min-max optimization problems have received increasing attention due to their wide range of applications in machine learning (ML). However, most existing min-max solution techniques are either single-machine or distributed…

Machine Learning · Computer Science 2023-03-07 Zhuqing Liu , Xin Zhang , Songtao Lu , Jia Liu

We study online inverse linear optimization, also known as contextual recommendation, where a learner sequentially infers an agent's hidden objective vector from observed optimal actions over feasible sets that change over time. The learner…

Machine Learning · Computer Science 2026-05-13 Taihei Oki , Shinsaku Sakaue

Multi-agent systems provide a powerful way to extend large language models (LLMs) by decomposing a complex task into specialized subtasks handled by different agents. However, their performance is often hindered by error propagation,…

Machine Learning · Computer Science 2026-05-14 Zheng Wang , Yuang Liu , Yangkai Ding

Constrained Online Convex Optimization (COCO) can be seen as a generalization of the standard Online Convex Optimization (OCO) framework. At each round, a cost function and constraint function are revealed after a learner chooses an action.…

Machine Learning · Computer Science 2025-05-30 Ricardo N. Ferreira , Cláudia Soares

In this work, we propose a novel memory-based multi-agent meta-learning architecture and learning procedure that allows for learning of a shared communication policy that enables the emergence of rapid adaptation to new and unseen…