English
Related papers

Related papers: Learning-Augmented Decentralized Online Convex Opt…

200 papers

In this work, we study a generic network cost minimization problem, in which every node has a local decision vector to determine. Each node incurs a cost depending on its decision vector and each link also incurs a cost depending on the…

Optimization and Control · Mathematics 2017-02-27 Xuanyu Cao , K. J. Ray Liu

We consider distributed optimization as motivated by machine learning in a multi-agent system: each agent holds local data and the goal is to minimize an aggregate loss function over a common model, via an interplay of local training and…

Optimization and Control · Mathematics 2025-04-08 Dingran Yi , Fanhao Zeng , Nikolaos M. Freris

Decentralized optimization is a powerful paradigm that finds applications in engineering and learning design. This work studies decentralized composite optimization problems with non-smooth regularization terms. Most existing gradient-based…

Optimization and Control · Mathematics 2019-10-29 Sulaiman A. Alghunaim , Kun Yuan , Ali H. Sayed

We consider the decision-making framework of online convex optimization with a very large number of experts. This setting is ubiquitous in contextual and reinforcement learning problems, where the size of the policy class renders…

Machine Learning · Computer Science 2021-02-19 Elad Hazan , Karan Singh

We study the decentralized online regularized linear regression algorithm over random time-varying graphs. At each time step, every node runs an online estimation algorithm consisting of an innovation term processing its own new…

Machine Learning · Computer Science 2025-10-02 Xiwei Zhang , Tao Li , Xiaozheng Fu

We consider the online convex optimization (OCO) problem with quadratic and linear switching cost in the limited information setting, where an online algorithm can choose its action using only gradient information about the previous…

Machine Learning · Computer Science 2023-10-19 Spandan Senapati , Rahul Vaze

In this paper, we investigate an online prediction strategy named as Discounted-Normal-Predictor (Kapralov and Panigrahy, 2010) for smoothed online convex optimization (SOCO), in which the learner needs to minimize not only the hitting cost…

Machine Learning · Computer Science 2022-05-03 Lijun Zhang , Wei Jiang , Jinfeng Yi , Tianbao Yang

Unconstrained Online Linear Optimization (OLO) is a practical problem setting to study the training of machine learning models. Existing works proposed a number of potential-based algorithms, but in general the design of these potential…

Machine Learning · Computer Science 2022-06-16 Zhiyu Zhang , Ashok Cutkosky , Ioannis Paschalidis

A well-studied generalization of the standard online convex optimization (OCO) is constrained online convex optimization (COCO). In COCO, on every round, a convex cost function and a convex constraint function are revealed to the learner…

Machine Learning · Computer Science 2024-05-16 Abhishek Sinha , Rahul Vaze

We study decentralized optimization where multiple agents minimize the average of their (strongly) convex, smooth losses over a communication graph. Convergence of the existing decentralized methods generally hinges on an apriori, proper…

Optimization and Control · Mathematics 2025-08-01 Ilya Kuruzov , Xiaokai Chen , Gesualdo Scutari , Alexander Gasnikov

This paper proposes a multi-scale method to design a continuous-time distributed algorithm for constrained convex optimization problems by using multi-agents with Markov switched network dynamics and noisy inter-agent communications. Unlike…

Optimization and Control · Mathematics 2021-03-02 Wei Ni , Xiaoli Wang

In many contemporary applications such as healthcare, finance, robotics, and recommendation systems, continuous deployment of new policies for data collection and online learning is either cost ineffective or impractical. We consider a…

Machine Learning · Computer Science 2021-06-07 DiJia Su , Jason D. Lee , John M. Mulvey , H. Vincent Poor

The vulnerability of machine learning models to adversarial attacks has been attracting considerable attention in recent years. Most existing studies focus on the behavior of stand-alone single-agent learners. In comparison, this work…

Machine Learning · Computer Science 2025-05-13 Ying Cao , Elsa Rizk , Stefan Vlaski , Ali H. Sayed

We study the problem of private online learning, specifically, online prediction from experts (OPE) and online convex optimization (OCO). We propose a new transformation that transforms lazy online learning algorithms into private…

Machine Learning · Computer Science 2025-02-25 Hilal Asi , Tomer Koren , Daogao Liu , Kunal Talwar

This paper focuses on a multi-agent zeroth-order online optimization problem in a federated learning setting for target tracking. The agents only sense their current distances to their targets and aim to maintain a minimum safe distance…

Machine Learning · Computer Science 2023-06-12 Ege C. Kaya , M. Berk Sahin , Abolfazl Hashemi

We propose a decentralized penalty method for general convex constrained multi-agent optimization problems. Each auxiliary penalized problem is solved approximately with a special parallel descent splitting method. The method can be…

Optimization and Control · Mathematics 2020-08-11 Igor Konnov

Active Learning (AL) has gained prominence in integrating data-intensive machine learning (ML) models into domains with limited labeled data. However, its effectiveness diminishes significantly when the labeling budget is low. In this…

Machine Learning · Computer Science 2024-02-12 Zhuokai Zhao , Yibo Jiang , Yuxin Chen

We study Constrained Online Convex Optimization with Memory (COCO-M), where both the loss and the constraints depend on a finite window of past decisions made by the learner. This setting extends the previously studied unconstrained online…

Machine Learning · Computer Science 2026-03-24 Mohammed Abdullah , George Iosifidis , Salah Eddine Elayoubi , Tijani Chahed

We consider stochastic optimization problems in multi-agent settings, where a network of agents aims to learn parameters which are optimal in terms of a global objective, while giving preference to locally observed streaming information. To…

Multiagent Systems · Computer Science 2017-05-24 Alec Koppel , Brian M. Sadler , Alejandro Ribeiro

Limited computing resources of internet-of-things (IoT) nodes incur prohibitive latency in processing input data. This triggers new research opportunities toward task offloading systems where edge servers handle intensive computations of…

Information Theory · Computer Science 2022-07-29 Sangwon Hwang , Hoon Lee , Juseong Park , Inkyu Lee