English
Related papers

Related papers: Handling Delayed Feedback in Distributed Online Op…

200 papers

We present an adaptive online gradient descent algorithm to solve online convex optimization problems with long-term constraints , which are constraints that need to be satisfied when accumulated over a finite number of rounds T , but can…

Machine Learning · Statistics 2015-12-24 Rodolphe Jenatton , Jim Huang , Cédric Archambeau

This paper studies distributed online convex optimization with time-varying coupled constraints, motivated by distributed online control in network systems. Most prior work assumes a separability condition: the global objective and coupled…

Optimization and Control · Mathematics 2026-02-18 Zhaoye Pan , Haozhe Lei , Fan Zuo , Zilin Bian , Tao Li

A well-studied generalization of the standard online convex optimization (OCO) framework is constrained online convex optimization (COCO). In COCO, on every round, a convex cost function and a convex constraint function are revealed to the…

Machine Learning · Computer Science 2024-10-29 Abhishek Sinha , Rahul Vaze

In many online learning problems the computational bottleneck for gradient-based methods is the projection operation. For this reason, in many problems the most efficient algorithms are based on the Frank-Wolfe method, which replaces…

Machine Learning · Computer Science 2020-02-17 Elad Hazan , Edgar Minasyan

We consider the online convex optimization problem. In the setting of arbitrary sequences and finite set of parameters, we establish a new fast-rate quantile regret bound. Then we investigate the optimization into the L1-ball by…

Statistics Theory · Mathematics 2018-05-24 Pierre Gaillard , Olivier Wintenberger

Regret has been widely adopted as the metric of choice for evaluating the performance of online optimization algorithms for distributed, multi-agent systems. However, data/model variations associated with agents can significantly impact…

Machine Learning · Computer Science 2022-09-22 Zhanhong Jiang , Aditya Balu , Xian Yeow Lee , Young M. Lee , Chinmay Hegde , Soumik Sarkar

We study non-convex delayed-noise online optimization problems by evaluating dynamic regret in the non-stationary setting when the loss functions are quasar-convex. In particular, we consider scenarios involving quasar-convex functions…

Optimization and Control · Mathematics 2026-01-08 Felipe Lara , Cristian Vega

This paper considers distributed online convex optimization with adversarial constraints. In this setting, a network of agents makes decisions at each round, and then only a portion of the loss function and a coordinate block of the…

Optimization and Control · Mathematics 2023-06-02 Xinlei Yi , Xiuxian Li , Tao Yang , Lihua Xie , Yiguang Hong , Tianyou Chai , Karl H. Johansson

This paper considers the problem of distributed bandit online convex optimization with time-varying coupled inequality constraints. This problem can be defined as a repeated game between a group of learners and an adversary. The learners…

Optimization and Control · Mathematics 2019-12-10 Xinlei Yi , Xiuxian Li , Tao Yang , Lihua Xie , Karl H. Johansson , Tianyou Chai

We study the problem of online convex optimization (OCO) under unknown linear constraints that are either static, or stochastically time-varying. For this problem, we introduce an algorithm that we term Optimistically Safe OCO (OSOCO) and…

Machine Learning · Computer Science 2025-07-16 Spencer Hutchinson , Tianyi Chen , Mahnoosh Alizadeh

This paper considers distributed online nonconvex optimization with time-varying inequality constraints over a network of agents, where the nonconvex local loss and convex local constraint functions can vary arbitrarily across iterations.…

Optimization and Control · Mathematics 2025-11-19 Kunpeng Zhang , Lei Xu , Xinlei Yi , Guanghui Wen , Ming Cao , Karl H. Johansson , Tianyou Chai , Tao Yang

In this paper, we investigate the framework of Online Convex Optimization (OCO) for online learning. OCO offers a very powerful online learning framework for many applications. In this context, we study a specific framework of OCO called…

Machine Learning · Computer Science 2022-11-01 Deepan Muthirayan , Jianjun Yuan , Pramod P. Khargonekar

This paper focuses on the distributed online convex optimization problem with time-varying inequality constraints over a network of agents, where each agent collaborates with its neighboring agents to minimize the cumulative network-wide…

Optimization and Control · Mathematics 2024-05-06 Kunpeng Zhang , Xinlei Yi , Yuzhe Li , Ming Cao , Tianyou Chai , Tao Yang

Online meta-learning is emerging as an enabling technique for achieving edge intelligence in the IoT ecosystem. Nevertheless, to learn a good meta-model for within-task fast adaptation, a single agent alone has to learn over many tasks, and…

Machine Learning · Computer Science 2020-12-22 Sen Lin , Mehmet Dedeoglu , Junshan Zhang

In this paper, we address a class of distributed optimization problems in the presence of inter-agent communication delays based on passivity. We first focus on unconstrained distributed optimization and provide a passivity-based…

Systems and Control · Computer Science 2016-09-16 Takeshi Hatanaka , Nikhil Chopra , Takayuki Ishizaki , Na Li

We consider the problem of online convex optimization against an arbitrary adversary with bandit feedback, known as bandit convex optimization. We give the first $\tilde{O}(\sqrt{T})$-regret algorithm for this setting based on a novel…

Machine Learning · Computer Science 2016-03-16 Elad Hazan , Yuanzhi Li

We consider distributed online learning for joint regret with communication constraints. In this setting, there are multiple agents that are connected in a graph. Each round, an adversary first activates one of the agents to issue a…

Machine Learning · Computer Science 2021-10-26 Dirk van der Hoeven , Hédi Hadiji , Tim van Erven

Motivated by the stringent safety requirements that are often present in real-world applications, we study a safe online convex optimization setting where the player needs to simultaneously achieve sublinear regret and zero constraint…

Machine Learning · Computer Science 2024-07-17 Spencer Hutchinson , Mahnoosh Alizadeh

This paper addresses two fundamental challenges in distributed online convex optimization: communication efficiency and optimization under limited feedback. We propose a unified framework named Online Compressed Gradient Tracking (OCGT),…

Optimization and Control · Mathematics 2025-12-08 Longkang Zhu , Xinli Shi , Xiangping Xu , Jinde Cao , Xiangyong Chen

We extend the regret analysis of the online distributed weighted dual averaging (DWDA) algorithm [1] to the dynamic setting and provide the tightest dynamic regret bound known to date with respect to the time horizon for a distributed…

Optimization and Control · Mathematics 2020-12-11 Antoine Lesage-Landry , Duncan S. Callaway