English
Related papers

Related papers: Limited Communications Distributed Optimization vi…

200 papers

Privacy preservation is addressed for decentralized optimization, where $N$ agents cooperatively minimize the sum of $N$ convex functions private to these individual agents. In most existing decentralized optimization approaches,…

Optimization and Control · Mathematics 2018-07-03 Chunlei Zhang , Muaz Ahmad , Yongqiang Wang

We study distributed algorithms for solving global optimization problems in which the objective function is the sum of local objective functions of agents and the constraint set is given by the intersection of local constraint sets of…

Optimization and Control · Mathematics 2015-03-14 Ilan Lobel , Asuman Ozdaglar , Diego Feijer

In this work, we introduce ADAPD, $\textbf{A}$ $\textbf{D}$ecentr$\textbf{A}$lized $\textbf{P}$rimal-$\textbf{D}$ual algorithmic framework for solving non-convex and smooth consensus optimization problems over a network of distributed…

Optimization and Control · Mathematics 2023-02-07 Gabriel Mancino-Ball , Yangyang Xu , Jie Chen

Cooperative control is crucial for the effective operation of dynamical multi-agent systems. Especially for distributed control schemes, it is essential to exchange data between the agents. This becomes a privacy threat if the data is…

Systems and Control · Electrical Eng. & Systems 2024-12-19 Philipp Binfet , Janis Adamek , Nils Schlüter , Moritz Schulze Darup

We consider the distributed optimization problem, where a group of agents work together to optimize a common objective by communicating with neighboring agents and performing local computations. For a given algorithm, we use tools from…

Optimization and Control · Mathematics 2020-09-11 Bryan Van Scoy , Laurent Lessard

Decentralized federated learning (DFL) is a promising machine learning paradigm for bringing artificial intelligence (AI) capabilities to the network edge. Running DFL on top of edge networks, however, faces severe performance challenges…

Networking and Internet Architecture · Computer Science 2025-04-22 Tingyang Sun , Tuan Nguyen , Ting He

This article proposes a communication-efficient decentralized deep learning algorithm, coined layer-wise federated group ADMM (L-FGADMM). To minimize an empirical risk, every worker in L-FGADMM periodically communicates with two neighbors,…

Machine Learning · Computer Science 2020-07-07 Anis Elgabli , Jihong Park , Sabbir Ahmed , Mehdi Bennis

To address the communication burden issues associated with federated learning (FL), decentralized federated learning (DFL) discards the central server and establishes a decentralized communication network, where each client communicates…

Machine Learning · Computer Science 2023-08-17 Qinglun Li , Li Shen , Guanghao Li , Quanjun Yin , Dacheng Tao

Aiming at solving large-scale learning problems, this paper studies distributed optimization methods based on the alternating direction method of multipliers (ADMM). By formulating the learning problem as a consensus problem, the ADMM can…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-05-04 Tsung-Hui Chang , Mingyi Hong , Wei-Cheng Liao , Xiangfeng Wang

We consider a resource allocation problem over an undirected network of agents, where edges of the network define communication links. The goal is to minimize the sum of agent-specific convex objective functions, while the agents' decisions…

Optimization and Control · Mathematics 2019-11-27 Goran Banjac , Felix Rey , Paul Goulart , John Lygeros

Alternating Direction Method of Multipliers (ADMM) is a popular convex optimization algorithm, which can be employed for solving distributed consensus optimization problems. In this setting agents locally estimate the optimal solution of an…

Signal Processing · Electrical Eng. & Systems 2019-03-27 Layla Majzoobi , Farshad Lahouti , Vahid Shah-Mansouri

We address distributed learning problems, both nonconvex and convex, over undirected networks. In particular, we design a novel algorithm based on the distributed Alternating Direction Method of Multipliers (ADMM) to address the challenges…

Machine Learning · Computer Science 2026-03-23 Xiaoxing Ren , Nicola Bastianello , Karl H. Johansson , Thomas Parisini

We present the first distributed optimization algorithm with lazy communication for collaborative geometric estimation, the backbone of modern collaborative simultaneous localization and mapping (SLAM) and structure-from-motion (SfM)…

In this paper we focus on the distributed quantized average consensus problem in open multi-agent systems consisting of dynamic directed communication links among active nodes. We propose three communication-efficient distributed algorithms…

Systems and Control · Electrical Eng. & Systems 2026-03-10 Jiaqi Hu , Karl H. Johansson , Apostolos I. Rikos

With the proliferation of distributed energy resources and the volume of data stored due to advancement in metering infrastructure, energy management in power system operation needs distributed computing. In this paper, we propose a fully…

Systems and Control · Electrical Eng. & Systems 2020-05-21 Shailesh Wasti , Pablo Ubiratan , Shahab Afshar , Vahid Disfani

Distributed learning is essential to train machine learning algorithms across heterogeneous agents while maintaining data privacy. We conduct an asymptotic analysis of Unified Distributed SGD (UD-SGD), exploring a variety of communication…

Machine Learning · Computer Science 2024-10-30 Jie Hu , Yi-Ting Ma , Do Young Eun

Distributed control/optimization is a promising approach for network systems due to its advantages over centralized schemes, such as robustness, cost-effectiveness, and improved privacy. However, distributed methods can have drawbacks, such…

Systems and Control · Electrical Eng. & Systems 2024-02-15 Chin-Yao Chang

This paper presents a novel distributed robust optimization scheme for steering distributions of multi-agent systems under stochastic and deterministic uncertainty. Robust optimization is a subfield of optimization which aims to discover an…

Robotics · Computer Science 2025-01-31 Arshiya Taj Abdul , Augustinos D. Saravanos , Evangelos A. Theodorou

Despite significant advances on distributed continuous-time optimization of multi-agent networks, there is still lack of an efficient algorithm to achieve the goal of distributed optimization at a pre-specified time. Herein, we design a…

Optimization and Control · Mathematics 2021-06-23 Jialing Zhou , Yuezu Lv , Changyun Wen , Guanghui Wen

This paper studies a constrained optimization problem over networked systems with an undirected and connected communication topology. The algorithm proposed in this work utilizes singular perturbation, dynamic average consensus, and saddle…

Optimization and Control · Mathematics 2017-10-24 Phuong Huu Hoang , Hyo-Sung Ahn