English
Related papers

Related papers: Communication-Efficient Decentralized Optimization…

200 papers

Resource allocation is a fundamental problem in Industrial Internet of Things (IIoT) systems, in which devices work together under limited communication bandwidth to complete diverse tasks. This paper proposes a communication-efficient…

Optimization and Control · Mathematics 2026-05-26 Yuzhu Duan , Ziwen Yang , Xiaoming Duan , Shanying Zhu

This paper presents a decentralized algorithm for non-convex optimization over tree-structured networks. We assume that each node of this network can solve small-scale optimization problems and communicate approximate value functions with…

Optimization and Control · Mathematics 2020-11-02 Yuning Jiang , Dimitris Kouzoupis , Haoyu Yin , Moritz Diehl , Boris Houska

Optimal transport on a graph focuses on finding the most efficient way to transfer resources from one distribution to another while considering the graph's structure. This paper introduces a new distributed algorithm that solves the optimal…

Optimization and Control · Mathematics 2025-07-08 Yacine Mokhtari , Emmanuel Moulay , Patrick Coirault , Jérôme Le Ny

Decentralized optimization algorithms are important in different contexts, such as distributed optimal power flow or distributed model predictive control, as they avoid central coordination and enable decomposition of large-scale problems.…

Optimization and Control · Mathematics 2019-03-28 Alexander Engelmann , Yuning Jiang , Boris Houska , Timm Faulwasser

This paper investigates solving convex composite optimization on an undirected network, where each node, privately endowed with a smooth component function and a nonsmooth one, is required to minimize the sum of all the component functions…

Optimization and Control · Mathematics 2021-08-13 Xuyang Wu , Jie Lu

This paper presents a distributed optimization scheme over a network of agents in the presence of cost uncertainties and over switching communication topologies. Inspired by recent advances in distributed convex optimization, we propose a…

Optimization and Control · Mathematics 2016-11-15 Saghar Hosseini , Airlie Chapman , Mehran Mesbahi

In this paper, we design two compressed decentralized algorithms for solving nonconvex stochastic optimization under two different scenarios. Both algorithms adopt a momentum technique to achieve fast convergence and a message-compression…

Machine Learning · Computer Science 2025-08-08 Wei Liu , Anweshit Panda , Ujwal Pandey , Christopher Brissette , Yikang Shen , George M. Slota , Naigang Wang , Jie Chen , Yangyang Xu

We consider a class of distributed optimization problem where the objective function consists of a sum of strongly convex and smooth functions and a (possibly nonsmooth) convex regularizer. A multi-agent network is assumed, where each agent…

Optimization and Control · Mathematics 2021-10-01 Yichuan Li , Yonghai Gong , Nikolaos M. Freris , Petros Voulgaris , Dusan Stipanovic

Decentralized non-convex optimization is important in many problems of practical relevance. Existing decentralized methods, however, typically either lack convergence guarantees for general non-convex problems, or they suffer from a high…

Optimization and Control · Mathematics 2025-10-20 Gösta Stomberg , Alexander Engelmann , Timm Faulwasser

The recent deployment of distributed battery units in prosumer premises offer new opportunities for providing aggregated flexibility services to both distribution system operators and balance responsible parties. The optimization problem…

We consider the task of minimizing the sum of convex functions stored in a decentralized manner across the nodes of a communication network. This problem is relatively well-studied in the scenario when the objective functions are smooth, or…

Optimization and Control · Mathematics 2024-05-29 Dmitry Kovalev , Ekaterina Borodich , Alexander Gasnikov , Dmitrii Feoktistov

Alternating Direction Method of Multipliers (ADMM) is a popular algorithm for distributed learning, where a network of nodes collaboratively solve a regularized empirical risk minimization by iterative local computation associated with…

Machine Learning · Computer Science 2020-05-19 Zonghao Huang , Yanmin Gong

We consider constraint-coupled optimization problems in which agents of a network aim to cooperatively minimize the sum of local objective functions subject to individual constraints and a common linear coupling constraint. We propose a…

Optimization and Control · Mathematics 2019-07-26 Alessandro Falsone , Ivano Notarnicola , Giuseppe Notarstefano , Maria Prandini

Multi-agent planning in stochastic environments can be framed formally as a decentralized Markov decision problem. Many real-life distributed problems that arise in manufacturing, multi-robot coordination and information gathering scenarios…

Artificial Intelligence · Computer Science 2011-11-02 Claudia V. Goldman , Shlomo Zilberstein

Decentralized nonconvex optimization has received increasing attention in recent years in machine learning due to its advantages in system robustness, data privacy, and implementation simplicity. However, three fundamental challenges in…

Machine Learning · Computer Science 2021-05-20 Xin Zhang , Jia Liu , Zhengyuan Zhu , Elizabeth S. Bentley

Federated learning has shown its advances over the last few years but is facing many challenges, such as how algorithms save communication resources, how they reduce computational costs, and whether they converge. To address these issues,…

Machine Learning · Computer Science 2022-02-01 Shenglong Zhou , Geoffrey Ye Li

In a multi-agent network, we consider the problem of minimizing an objective function that is expressed as the sum of private convex and smooth functions, and a (possibly) non-differentiable convex regularizer. We propose a novel…

Optimization and Control · Mathematics 2021-09-30 Yichuan Li , Nikolaos M. Freris , Petros Voulgaris , Dusan Stipanovic

This paper proposes a novel class of distributed continuous-time coordination algorithms to solve network optimization problems whose cost function is a sum of local cost functions associated to the individual agents. We establish the…

Optimization and Control · Mathematics 2014-08-25 Solmaz S. Kia , Jorge Cortes , Sonia Martinez

Decentralized optimization is a powerful paradigm that finds applications in engineering and learning design. This work studies decentralized composite optimization problems with non-smooth regularization terms. Most existing gradient-based…

Optimization and Control · Mathematics 2019-10-29 Sulaiman A. Alghunaim , Kun Yuan , Ali H. Sayed

In this paper, we propose two novel decentralized optimization frameworks for multi-agent nonlinear optimal control problems in robotics. The aim of this work is to suggest architectures that inherit the computational efficiency and…

Systems and Control · Electrical Eng. & Systems 2022-08-09 Augustinos D. Saravanos , Yuichiro Aoyama , Hongchang Zhu , Evangelos A. Theodorou