English
Related papers

Related papers: Linearized ADMM for Non-convex Non-smooth Optimiza…

200 papers

This paper proposes a two-level distributed algorithmic framework for solving the AC optimal power flow (OPF) problem with convergence guarantees. The presence of highly nonconvex constraints in OPF poses significant challenges to…

Optimization and Control · Mathematics 2021-06-14 Kaizhao Sun , Xu Andy Sun

We introduce a generalization of the linearized Alternating Direction Method of Multipliers to optimize a real-valued function $f$ of multiple arguments with potentially multiple constraints $g_\circ$ on each of them. The function $f$ may…

Optimization and Control · Mathematics 2019-01-28 Fred Moolekamp , Peter Melchior

This paper proposes a proximal variant of the alternating direction method of multipliers (ADMM) for distributed optimization. Although the current versions of ADMM algorithm provide promising numerical results in producing solutions that…

Optimization and Control · Mathematics 2023-09-01 Reza Mirzaeifard , Naveen K. D. Venkategowda , Alexander Jung , Stefan Werner

Multi-agent distributed consensus optimization problems arise in many signal processing applications. Recently, the alternating direction method of multipliers (ADMM) has been used for solving this family of problems. ADMM based distributed…

Systems and Control · Computer Science 2015-06-18 Tsung-Hui Chang , Mingyi Hong , Xiangfeng Wang

The alternating direction method of multipliers (ADMM) is an effective method for solving wide fields of convex problems. At each iteration, the classical ADMM solves two subproblems exactly. However, in many applications, it is expensive…

Optimization and Control · Mathematics 2019-03-07 Yan Gu , Nobuo Yamashita

As a well-known optimization framework, the Alternating Direction Method of Multipliers (ADMM) has achieved tremendous success in many classification and regression applications. Recently, it has attracted the attention of deep learning…

Machine Learning · Computer Science 2021-12-23 Junxiang Wang , Hongyi Li , Liang Zhao

We propose two new alternating direction methods to solve "fully" nonsmooth constrained convex problems. Our algorithms have the best known worst-case iteration-complexity guarantee under mild assumptions for both the objective residual and…

Optimization and Control · Mathematics 2018-01-16 Quoc Tran-Dinh , Volkan Cevher

Distributed optimization is often widely attempted and innovated as an attractive and preferred methodology to solve large-scale problems effectively in a localized and coordinated manner. Thus, it is noteworthy that the methodology of…

Optimization and Control · Mathematics 2021-08-30 Xiaoxue Zhang , Jun Ma , Zilong Cheng , Sunan Huang , Clarence W. de Silva , Tong Heng Lee

We consider three challenges in multi-block Alternating Direction Method of Multipliers (ADMM): building convergence conditions for ADMM with any block (variable) sequence, finding available block sequences to be fit for ADMM, and designing…

Systems and Control · Computer Science 2018-03-06 Jun Li , Hongfu Liu , Yue Wu , Yun Fu

In this paper, we consider solving a class of nonconvex and nonsmooth problems frequently appearing in signal processing and machine learning research. The traditional alternating direction method of multipliers encounters troubles in both…

Numerical Analysis · Computer Science 2018-10-17 Tao Sun , Hao Jiang , Lizhi Cheng , Wei Zhu

The Alternating Direction Method of Multipliers (ADMM) is widely used for linearly constrained convex problems. It is proven to have an $o(1/\sqrt{K})$ nonergodic convergence rate and a faster $O(1/K)$ ergodic rate after ergodic averaging,…

Numerical Analysis · Mathematics 2018-12-13 Huan Li , Zhouchen Lin

In this paper we propose an Alternating Direction Method of Multipliers (ADMM) algorithm for solving a Model Predictive Control (MPC) optimization problem, in which the system has state and input constraints and a nonlinear input map. The…

Optimization and Control · Mathematics 2018-07-30 Sebastian East , Mark Cannon

This paper is concerned with two-block separable convex minimization problems with linear constraints, for which it is either impossible or too expensive to obtain the exact solutions of the subproblems involved in the proximal ADMM…

Optimization and Control · Mathematics 2015-07-30 Li Shen , Shaohua Pan

We address distributed learning problems, both nonconvex and convex, over undirected networks. In particular, we design a novel algorithm based on the distributed Alternating Direction Method of Multipliers (ADMM) to address the challenges…

Machine Learning · Computer Science 2026-03-23 Xiaoxing Ren , Nicola Bastianello , Karl H. Johansson , Thomas Parisini

This work presents a new method for online selection of multiple penalty parameters for the alternating direction method of multipliers (ADMM) algorithm applied to optimization problems with multiple constraints or functionals with block…

Image and Video Processing · Electrical Eng. & Systems 2026-04-21 Luke Lozenski , Michael T. McCann , Brendt Wohlberg

In this paper, we review the parallel and distributed optimization algorithms based on alternating direction method of multipliers (ADMM) for solving "big data" optimization problem in smart grid communication networks. We first introduce…

Systems and Control · Computer Science 2015-03-03 Lanchao Liu , Zhu Han

Multi-block separable convex problems recently received considerable attention. This class of optimization problems minimizes a separable convex objective function with linear constraints. The algorithmic challenges come from the fact that…

Optimization and Control · Mathematics 2016-08-18 Qia Li , Yuesheng Xu , Na Zhang

This paper establishes the iteration-complexity of a Jacobi-type non-Euclidean proximal alternating direction method of multipliers (ADMM) for solving multi-block linearly constrained nonconvex programs. The subproblems of this ADMM variant…

Optimization and Control · Mathematics 2017-05-23 Jefferson G. Melo , Renato D. C. Monteiro

To reduce complexity and achieve scalable performance in high-dimensional black-box settings, we propose a distributed method for nonconvex derivative-free optimization of continuous variables with an additively separable objective, subject…

Optimization and Control · Mathematics 2025-11-03 Damilola Fasiku , Wentao Tang

We expand the scope of the alternating direction method of multipliers (ADMM). Specifically, we show that ADMM, when employed to solve problems with multiaffine constraints that satisfy certain verifiable assumptions, converges to the set…

Optimization and Control · Mathematics 2019-10-24 Wenbo Gao , Donald Goldfarb , Frank E. Curtis