English
Related papers

Related papers: Convergent Proximal Multiblock ADMM for Nonconvex …

200 papers

In this paper, we establish the convergence of the proximal alternating direction method of multipliers (ADMM) and block coordinate descent (BCD) for nonseparable minimization models with quadratic coupling terms. The novel convergence…

Optimization and Control · Mathematics 2017-03-16 Caihua Chen , Min Li , Xin Liu , Yinyu Ye

The convergence analysis of optimization algorithms using continuous-time dynamical systems has received much attention in recent years. In this paper, we investigate applications of these systems to analyze the convergence of linearized…

Optimization and Control · Mathematics 2023-09-14 Jiahong Guo , Xiao Wang , Xiantao Xiao

Consider the minimization of a nonconvex differentiable function over a polyhedron. A popular primal-dual first-order method for this problem is to perform a gradient projection iteration for the augmented Lagrangian function and then…

Optimization and Control · Mathematics 2020-08-05 Jiawei Zhang , Zhi-Quan Luo

This paper is concerned with two-block separable convex minimization problems with linear constraints, for which it is either impossible or too expensive to obtain the exact solutions of the subproblems involved in the proximal ADMM…

Optimization and Control · Mathematics 2015-07-30 Li Shen , Shaohua Pan

The Alternating Direction Method of Multipliers (ADMM) has now days gained tremendous attentions for solving large-scale machine learning and signal processing problems due to the relative simplicity. However, the two-block structure of the…

Optimization and Control · Mathematics 2020-03-23 Mingxi Zhu , Kresimir Mihic , Yinyu Ye

The objective of this paper is to design an efficient and convergent alternating direction method of multipliers (ADMM) for finding a solution of medium accuracy to conic programming problems whose constraints consist of linear equalities,…

Optimization and Control · Mathematics 2014-12-02 Defeng Sun , Kim-Chuan Toh , Liuqin Yang

This paper proposes a proximal variant of the alternating direction method of multipliers (ADMM) for distributed optimization. Although the current versions of ADMM algorithm provide promising numerical results in producing solutions that…

Optimization and Control · Mathematics 2023-09-01 Reza Mirzaeifard , Naveen K. D. Venkategowda , Alexander Jung , Stefan Werner

We address the problem of solving convex optimization problems with many convex constraints in a distributed setting. Our approach is based on an extension of the alternating direction method of multipliers (ADMM) that recently gained a lot…

Optimization and Control · Mathematics 2018-04-09 Joachim Giesen , Sören Laue

The matrix low-rank approximation problem with additional convex constraints can find many applications and has been extensively studied before. However, this problem is shown to be nonconvex and NP-hard; most of the existing solutions are…

Numerical Analysis · Computer Science 2015-12-08 Ying Zhang

The alternating direction method of multipliers (ADMM) were extensively investigated in the past decades for solving separable convex optimization problems. Fewer researchers focused on exploring its convergence properties for the nonconvex…

Numerical Analysis · Mathematics 2019-07-02 Jianchao Bai , Junli Liang , Ke Guo , Yang Jing

We consider a class of Riemannian optimization problems where the objective is the sum of a smooth function and a nonsmooth function, considered in the ambient space. This class of problems finds important applications in machine learning…

Optimization and Control · Mathematics 2024-11-27 Jiaxiang Li , Shiqian Ma , Tejes Srivastava

This paper studies a proximal alternating direction method of multipliers (ADMM) with variable metric indefinite proximal terms for linearly constrained convex optimization problems. The proximal ADMM plays an important role in many…

Optimization and Control · Mathematics 2019-07-01 Yan Gu , Nobuo Yamashita

An inexact accelerated stochastic Alternating Direction Method of Multipliers (AS-ADMM) scheme is developed for solving structured separable convex optimization problems with linear constraints. The objective function is the sum of a…

Optimization and Control · Mathematics 2020-10-27 Jianchao Bai , William W. Hager , Hongchao Zhang

We consider a 3-block Alternating Direction Method of Multipliers (ADMM) for solving nonconvex nonseparable problems with a linear constraint. Inspired by \cite[Sun, Toh and Yang, \textit{SIAM Journal on Optimization}, 25 (2015),…

Optimization and Control · Mathematics 2025-07-21 Zekun Liu

In this work, we propose a (linearized) Alternating Direction Method-of-Multipliers (ADMM) algorithm for minimizing a convex function subject to a nonconvex constraint. We focus on the special case where such constraint arises from the…

Machine Learning · Computer Science 2019-07-09 Fabian Latorre Gómez , Armin Eftekhari , Volkan Cevher

In this paper, we aim to accelerate a preconditioned alternating direction method of multipliers (pADMM), whose proximal terms are convex quadratic functions, for solving linearly constrained convex optimization problems. To achieve this,…

Optimization and Control · Mathematics 2024-12-10 Defeng Sun , Yancheng Yuan , Guojun Zhang , Xinyuan Zhao

We consider a class of distributed optimization problem where the objective function consists of a sum of strongly convex and smooth functions and a (possibly nonsmooth) convex regularizer. A multi-agent network is assumed, where each agent…

Optimization and Control · Mathematics 2021-10-01 Yichuan Li , Yonghai Gong , Nikolaos M. Freris , Petros Voulgaris , Dusan Stipanovic

In this paper, we consider a multi-block generalized alternating direction method of multiplier (GADMM) algorithm for minimizing a linearly constrained separable nonconvex and possibly nonsmooth optimization problem. The GADMM generalizes…

Optimization and Control · Mathematics 2021-09-02 Maryam Yashtini

In this paper we propose a corrected semi-proximal ADMM (alternating direction method of multipliers) for the general $p$-block $(p\!\ge 3)$ convex optimization problems with linear constraints, aiming to resolve the dilemma that almost all…

Optimization and Control · Mathematics 2015-02-12 Li Shen , Shaohua Pan

Alternating Direction Method of Multipliers (ADMM) has become a widely used optimization method for convex problems, particularly in the context of data mining in which large optimization problems are often encountered. ADMM has several…

Machine Learning · Statistics 2019-07-11 Andre Goncalves , Xiaoli Liu , Arindam Banerjee