English
Related papers

Related papers: An Alternating Direction Method of Multipliers for…

200 papers

Consider a set of N agents seeking to solve distributively the minimization problem $\inf_{x} \sum_{n = 1}^N f_n(x)$ where the convex functions $f_n$ are local to the agents. The popular Alternating Direction Method of Multipliers has the…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-12-30 Franck Iutzeler , Pascal Bianchi , Philippe Ciblat , Walid Hachem

The alternating direction method of multipliers (ADMM) has been popular for solving many signal processing problems, convex or nonconvex. In this paper, we study an asynchronous implementation of the ADMM for solving a nonconvex nonsmooth…

Information Theory · Computer Science 2014-12-19 Mingyi Hong

The alternating direction method of multipliers (ADMM) is widely used for solving large-scale semidefinite programs (SDPs), yet on instances with multiple primal-dual optimal solution pairs, it often enters prolonged slow-convergence…

Optimization and Control · Mathematics 2026-03-04 Shucheng Kang , Heng Yang

In this paper, we develop a symmetric accelerated stochastic Alternating Direction Method of Multipliers (SAS-ADMM) for solving separable convex optimization problems with linear constraints. The objective function is the sum of a possibly…

Optimization and Control · Mathematics 2021-12-21 Jianchao Bai , Deren Han , Hao Sun , Hongchao Zhang

We introduce Wasserstein consensus alternating direction method of multipliers (ADMM) and its entropic-regularized version: Sinkhorn consensus ADMM, to solve measure-valued optimization problems with convex additive objectives. Several…

Optimization and Control · Mathematics 2023-09-15 Iman Nodozi , Abhishek Halder

We propose a distributed version of the Alternating Direction Method of Multipliers (ADMM) with linear updates for directed networks. We show that if the objective function of the minimization problem is smooth and strongly convex, our…

Optimization and Control · Mathematics 2023-09-21 Kiran Rokade , Rachel Kalpana Kalaimani

The alternating direction method of multipliers (ADMM) has been widely adopted in low-rank approximation and low-order model identification tasks; however, the performance of nonconvex ADMM is highly reliant on the choice of penalty…

Optimization and Control · Mathematics 2023-09-11 Qingyuan Liu , Zhengchao Huang , Hao Ye , Dexian Huang , Chao Shang

We consider the problem of max-min beamforming (MMB) for cell-free massive multi-input multi-output (MIMO) systems, where the objective is to maximize the minimum achievable rate among all users. Existing MMB methods are mainly based on…

Signal Processing · Electrical Eng. & Systems 2025-07-28 Bin Wang , Jun Fang , Yue Xiao , Martin Haardt

Purpose The proposed reconstruction framework addresses the reconstruction accuracy, noise propagation and computation time for Magnetic Resonance Fingerprinting (MRF). Methods Based on a singular value decomposition (SVD) of the signal…

Alternating direction method of multiplier (ADMM) is a widely used algorithm for solving constrained optimization problems in image restoration. Among many useful features, one critical feature of the ADMM algorithm is its modular structure…

Computer Vision and Pattern Recognition · Computer Science 2016-11-14 Stanley H. Chan , Xiran Wang , Omar A. Elgendy

This paper introduces a novel approach to solving multi-block nonconvex composite optimization problems through a proximal linearized Alternating Direction Method of Multipliers (ADMM). This method incorporates an Increasing Penalization…

Optimization and Control · Mathematics 2025-04-01 Ganzhao Yuan

We present an Alternating Direction Method of Multipliers (ADMM) algorithm designed to solve the Weighted Generalized Fused LASSO Signal Approximator (wFLSA). First, we show that wFLSAs can always be reformulated as a Generalized LASSO…

Methodology · Statistics 2024-07-26 Louis Dijkstra , Moritz Hanke , Niklas Koenen , Ronja Foraita

We consider minimax (saddle-point) problems of the form max_{c \in C} min_{\beta \in S} g(c; \beta), where C and S are compact convex sets, and g is concave-convex. Applying the Alternating Direction Method of Multipliers (ADMM) requires…

Optimization and Control · Mathematics 2026-04-23 Bob Wilson

Convex quadratic programs (QPs) constitute a fundamental computational primitive across diverse domains including financial optimization, control systems, and machine learning. The alternating direction method of multipliers (ADMM) has…

Optimization and Control · Mathematics 2025-05-15 Xi Gao , Jinxin Xiong , Linxin Yang , Akang Wang , Weiwei Xu , Jiang Xue

In the context of convex optimization problems in Hilbert spaces, we induce inertial effects into the classical ADMM numerical scheme and obtain in this way so-called inertial ADMM algorithms, the convergence properties of which we…

Optimization and Control · Mathematics 2014-04-18 Radu Ioan Bot , Ernö Robert Csetnek

By coordinating terminal smart devices or microprocessors to engage in cooperative computation to achieve systemlevel targets, distributed optimization is incrementally favored by both engineering and computer science. The well-known…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-24 Yu Yang , Xiaohong Guan , Qing-Shan Jia , Liang Yu , Bolun Xu , Costas J. Spanos

The alternating direction method of multipliers (ADMM) is a powerful optimization solver in machine learning. Recently, stochastic ADMM has been integrated with variance reduction methods for stochastic gradient, leading to SAG-ADMM and…

Machine Learning · Computer Science 2016-10-18 Shuai Zheng , James T. Kwok

Semidefinite programming (SDP) is a fundamental convex optimization problem with wide-ranging applications. However, solving large-scale instances remains computationally challenging due to the high cost of solving linear systems and…

Optimization and Control · Mathematics 2025-12-22 Hantao Nie , Dong An , Zaiwen Wen

We consider a class of distributed optimization problem where the objective function consists of a sum of strongly convex and smooth functions and a (possibly nonsmooth) convex regularizer. A multi-agent network is assumed, where each agent…

Optimization and Control · Mathematics 2021-10-01 Yichuan Li , Yonghai Gong , Nikolaos M. Freris , Petros Voulgaris , Dusan Stipanovic

We investigate the local linear convergence properties of the Alternating Direction Method of Multipliers (ADMM) when applied to Semidefinite Programming (SDP). A longstanding belief suggests that ADMM is only capable of solving SDPs to…

Optimization and Control · Mathematics 2026-05-19 Shucheng Kang , Xin Jiang , Heng Yang