English
Related papers

Related papers: A Distributed Parallel Optimization Algorithm via …

200 papers

Due to massive amounts of data distributed across multiple locations, distributed machine learning has attracted a lot of research interests. Alternating Direction Method of Multipliers (ADMM) is a powerful method of designing distributed…

Machine Learning · Computer Science 2020-12-10 Jiahao Ding , Xiaoqi Qin , Wenjun Xu , Yanmin Gong , Chi Zhang , Miao Pan

The Alternating Direction Method of Multipliers (ADMM) has gained a lot of attention for solving large-scale and objective-separable constrained optimization. However, the two-block variable structure of the ADMM still limits the practical…

Optimization and Control · Mathematics 2020-03-24 Kresimir Mihic , Mingxi Zhu , Yinyu Ye

We study a class of structured convex optimization problems, which have a two-block separable objective and nonlinear functional constraints as well as affine constraints that couple the two block variables. Such problems naturally arise…

Optimization and Control · Mathematics 2026-02-27 Zhengjie Xiong , Yangyang Xu

Consider a set of N agents seeking to solve distributively the minimization problem $\inf_{x} \sum_{n = 1}^N f_n(x)$ where the convex functions $f_n$ are local to the agents. The popular Alternating Direction Method of Multipliers has the…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-12-30 Franck Iutzeler , Pascal Bianchi , Philippe Ciblat , Walid Hachem

Alternating direction method of multipliers (ADMM) is a popular first-order method owing to its simplicity and efficiency. However, similar to other proximal splitting methods, the performance of ADMM degrades significantly when the scale…

Optimization and Control · Mathematics 2021-08-11 Fengmiao Bian , Jingwei Liang , Xiaoqun Zhang

Optimal transport on a graph focuses on finding the most efficient way to transfer resources from one distribution to another while considering the graph's structure. This paper introduces a new distributed algorithm that solves the optimal…

Optimization and Control · Mathematics 2025-07-08 Yacine Mokhtari , Emmanuel Moulay , Patrick Coirault , Jérôme Le Ny

This paper investigates the vulnerability of the Alternating Direction Method of Multipliers (ADMM) algorithm to shared data manipulation, with a focus on solving optimal power flow (OPF) problems. Deliberate data manipulation may cause the…

Systems and Control · Electrical Eng. & Systems 2025-11-03 Mohannad Alkhraijah , Rachel Harris , Samuel Litchfield , David Huggins , Daniel K. Molzahn

Many machine learning models, including those with non-smooth regularizers, can be formulated as consensus optimization problems, which can be solved by the alternating direction method of multipliers (ADMM). Many recent efforts have been…

Machine Learning · Computer Science 2018-02-27 Rui Zhu , Di Niu , Zongpeng Li

This paper introduces a dual-regularized ADMM approach to distributed, time-varying optimization. The proposed algorithm is designed in a prediction-correction framework, in which the computing nodes predict the future local costs based on…

Optimization and Control · Mathematics 2024-05-07 Nicola Bastianello , Andrea Simonetto , Ruggero Carli

We consider a proximal operator given by a quadratic function subject to bound constraints and give an optimization algorithm using the alternating direction method of multipliers (ADMM). The algorithm is particularly efficient to solve a…

Optimization and Control · Mathematics 2014-12-31 Miguel Á. Carreira-Perpiñán

In this paper, we consider the problem of distributed optimisation of a separable convex cost function over a graph, where every edge and node in the graph could carry both linear equality and/or inequality constraints. We show how to…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-20 Richard Heusdens , Guoqiang Zhang

The recent deployment of distributed battery units in prosumer premises offer new opportunities for providing aggregated flexibility services to both distribution system operators and balance responsible parties. The optimization problem…

Latency is inherent in almost all real-world networked applications. In this paper, we propose a distributed allocation strategy over multi-agent networks with delayed communications. The state of each agent (or node) represents its share…

Systems and Control · Electrical Eng. & Systems 2022-08-31 Mohammadreza Doostmohammadian , Wei Jiang , Themistoklis Charalambous

The alternating direction method of multipliers (ADMM) is a powerful splitting algorithm for linearly constrained convex optimization problems. In view of its popularity and applicability, a growing attention is drawn towards the ADMM in…

Optimization and Control · Mathematics 2022-08-19 Sedi Bartz , Rubén Campoy , Hung M. Phan

We present a novel framework, namely AADMM, for acceleration of linearized alternating direction method of multipliers (ADMM). The basic idea of AADMM is to incorporate a multi-step acceleration scheme into linearized ADMM. We demonstrate…

Optimization and Control · Mathematics 2014-02-13 Yuyuan Ouyang , Yunmei Chen , Guanghui Lan , Eduardo Pasiliao

Due to the explosion in size and complexity of modern data sets and privacy concerns of data holders, it is increasingly important to be able to solve machine learning problems in distributed manners. The Alternating Direction Method of…

Networking and Internet Architecture · Computer Science 2021-04-27 Saeedeh Parsaeefard , Alberto Leon Garcia

This paper presents a tutorial on the Consensus Alternating Direction Method of Multipliers (Consensus ADMM) for distributed optimization, with a specific focus on applications in multi-robot systems. In this tutorial, we derive the…

Optimization and Control · Mathematics 2024-10-08 Jushan Chen

We present an Alternating Direction Method of Multipliers (ADMM) algorithm for solving optimization problems with an l_1 regularized least-squares cost function subject to recursive equality constraints. The considered optimization problem…

Systems and Control · Computer Science 2012-03-20 Mariette Annergren , Anders Hansson , Bo Wahlberg

This paper investigates solving convex composite optimization on an undirected network, where each node, privately endowed with a smooth component function and a nonsmooth one, is required to minimize the sum of all the component functions…

Optimization and Control · Mathematics 2021-08-13 Xuyang Wu , Jie Lu

This paper presents a novel accelerated distributed algorithm for unconstrained consensus optimization over static undirected networks. The proposed algorithm combines the benefits of acceleration from momentum, the robustness of the…

Optimization and Control · Mathematics 2024-05-15 Eduardo Sebastián , Mauro Franceschelli , Andrea Gasparri , Eduardo Montijano , Carlos Sagüés