English
Related papers

Related papers: On the Linear Convergence of the ADMM in Decentral…

200 papers

We consider decentralized optimization problems where one aims to minimize a sum of convex smooth objective functions distributed between nodes in the network. The links in the network can change from time to time. For the setting when the…

Optimization and Control · Mathematics 2023-01-30 Dmitriy Metelev , Alexander Rogozin , Dmitry Kovalev , Alexander Gasnikov

We consider cooperative multi-agent consensus optimization problems over an undirected network of agents, where only those agents connected by an edge can directly communicate. The objective is to minimize the sum of agent-specific…

Optimization and Control · Mathematics 2016-07-12 Necdet Serhat Aybat , Erfan Yazdandoost Hamedani

This paper develops efficient algorithms for distributed average consensus with quantized communication using the alternating direction method of multipliers (ADMM). We first study the effects of probabilistic and deterministic…

Systems and Control · Computer Science 2016-12-05 Shengyu Zhu , Biao Chen

In the fields of statistics, machine learning, image science, and related areas, there is an increasing demand for decentralized collection or storage of large-scale datasets, as well as distributed solution methods. To tackle this…

Optimization and Control · Mathematics 2024-01-17 Bowen Li , Bin Shi

In this work, we consider the distributed optimization problem in which each node has its own convex cost function and can communicate directly only with its neighbors, as determined by a directed communication topology (directed graph or…

Optimization and Control · Mathematics 2021-10-07 Wei Jiang , Themistoklis Charalambous

The alternating direction method of multipliers (ADMM) has been popular for solving many signal processing problems, convex or nonconvex. In this paper, we study an asynchronous implementation of the ADMM for solving a nonconvex nonsmooth…

Information Theory · Computer Science 2014-12-19 Mingyi Hong

We consider distributed convex optimization problems that involve a separable objective function and nontrivial functional constraints, such as Linear Matrix Inequalities (LMIs). We propose a decentralized and computationally inexpensive…

Optimization and Control · Mathematics 2018-01-22 Soomin Lee , Michael M. Zavlanos

In this paper, we consider a network of agents that jointly aim to minimise the sum of local functions subject to coupling constraints involving all local variables. To solve this problem, we propose a novel solution based on a primal-dual…

Optimization and Control · Mathematics 2025-02-11 Mohamed Abdelmouamin Messilem , Guido Carnevale , Ruggero Carli

We address distributed learning problems, both nonconvex and convex, over undirected networks. In particular, we design a novel algorithm based on the distributed Alternating Direction Method of Multipliers (ADMM) to address the challenges…

Machine Learning · Computer Science 2026-03-23 Xiaoxing Ren , Nicola Bastianello , Karl H. Johansson , Thomas Parisini

The alternating direction method of multipliers (ADMM) is widely used to solve large-scale linearly constrained optimization problems, convex or nonconvex, in many engineering fields. However there is a general lack of theoretical…

Optimization and Control · Mathematics 2015-12-01 Mingyi Hong , Zhi-Quan Luo , Meisam Razaviyayn

There has been an increasing necessity for scalable optimization methods, especially due to the explosion in the size of datasets and model complexity in modern machine learning applications. Scalable solvers often distribute the…

Optimization and Control · Mathematics 2020-09-08 Guilherme França , José Bento

We present a novel framework, namely AADMM, for acceleration of linearized alternating direction method of multipliers (ADMM). The basic idea of AADMM is to incorporate a multi-step acceleration scheme into linearized ADMM. We demonstrate…

Optimization and Control · Mathematics 2014-02-13 Yuyuan Ouyang , Yunmei Chen , Guanghui Lan , Eduardo Pasiliao

We consider a class of multi-agent cooperative consensus optimization problems with local nonlinear convex constraints where only those agents connected by an edge can directly communicate, hence, the optimal consensus decision lies in the…

Optimization and Control · Mathematics 2023-02-23 Nazanin Abolfazli , Afrooz Jalilzadeh , Erfan Yazdandoost Hamedani

We investigate the local linear convergence properties of the Alternating Direction Method of Multipliers (ADMM) when applied to Semidefinite Programming (SDP). A longstanding belief suggests that ADMM is only capable of solving SDPs to…

Optimization and Control · Mathematics 2026-05-19 Shucheng Kang , Xin Jiang , Heng Yang

This paper presents a family of algorithms for decentralized convex composite problems. We consider the setting of a network of agents that cooperatively minimize a global objective function composed of a sum of local functions plus a…

Optimization and Control · Mathematics 2023-02-14 Yichuan Li , Petros G. Voulgaris , Dusan M. Stipanovic , Nikolaos M. Freris

Douglas-Rachford splitting and the alternating direction method of multipliers (ADMM) can be used to solve convex optimization problems that consist of a sum of two functions. Convergence rate estimates for these algorithms have received…

Optimization and Control · Mathematics 2015-03-04 Pontus Giselsson

We consider the problem of achieving average consensus among multiple agents, where the inter-agent communication network is depicted by a graph. We consider the discrete-time consensus protocol where each agent updates its value as a…

Systems and Control · Electrical Eng. & Systems 2021-11-30 Kiran Rokade , Rachel Kalpana Kalaimani

This paper considers the decentralized convex optimization problem, which has a wide range of applications in large-scale machine learning, sensor networks, and control theory. We propose novel algorithms that achieve optimal computation…

Machine Learning · Computer Science 2023-10-11 Haishan Ye , Luo Luo , Ziang Zhou , Tong Zhang

This paper considers the decentralized consensus optimization problem defined over a network where each node holds a second-order differentiable local objective function. Our goal is to minimize the summation of local objective functions…

Optimization and Control · Mathematics 2020-08-25 Jiaojiao Zhang , Qing Ling , Anthony Man-Cho So

In this work, we propose a (linearized) Alternating Direction Method-of-Multipliers (ADMM) algorithm for minimizing a convex function subject to a nonconvex constraint. We focus on the special case where such constraint arises from the…

Machine Learning · Computer Science 2019-07-09 Fabian Latorre Gómez , Armin Eftekhari , Volkan Cevher