English
Related papers

Related papers: A preconditioned augmented Lagrangian method for s…

200 papers

The augmented Lagrangian method (ALM) is classic for canonical convex programming problems with linear constraints, and it finds many applications in various scientific computing areas. A major advantage of the ALM is that the step for…

Optimization and Control · Mathematics 2022-12-02 Bingsheng He , Feng Ma , Shengjie Xu , Xiaoming Yuan

The semidefinite programming (SDP) relaxation has proven to be extremely strong for many hard discrete optimization problems. This is in particular true for the quadratic assignment problem (QAP), arguably one of the hardest NP-hard…

Optimization and Control · Mathematics 2015-12-18 Danilo Elias Oliveira , Henry Wolkowicz , Yangyang Xu

Symmetric cone programming covers a broad class of convex optimization problems, including linear programming, second-order cone programming, and semidefinite programming. Although the augmented Lagrangian method (ALM) is well-suited for…

Optimization and Control · Mathematics 2026-03-03 Rui-Jin Zhang , Ruoyu Diao , Xin-Wei Liu , Yu-Hong Dai

We develop two new variants of alternating direction methods of multipliers (ADMM) and two parallel primal-dual decomposition algorithms to solve a wide range class of constrained convex optimization problems. Our approach relies on a novel…

Optimization and Control · Mathematics 2018-06-15 Quoc Tran-Dinh , Yuzixuan Zhu

This work investigates the convergence behavior of augmented Lagrangian methods (ALMs) when applied to convex optimization problems that may be infeasible. ALMs are a popular class of algorithms for solving constrained optimization…

Optimization and Control · Mathematics 2026-03-17 Roland Andrews , Justin Carpentier , Adrien Taylor

In this paper, we show that for a class of linearly constrained convex composite optimization problems, an (inexact) symmetric Gauss-Seidel based majorized multi-block proximal alternating direction method of multipliers (ADMM) is…

Optimization and Control · Mathematics 2019-01-29 Liang Chen , Xudong Li , Defeng Sun , Kim-Chuan Toh

In this paper, we present a two-phase augmented Lagrangian method, called QSDPNAL, for solving convex quadratic semidefinite programming (QSDP) problems with constraints consisting of a large number of linear equality, inequality…

Optimization and Control · Mathematics 2017-01-02 Xudong Li , Defeng Sun , Kim-Chuan Toh

The augmented Lagrangiam method (ALM), widely used in quantum chemistry constrained optimization problems, is applied in the context of the nuclear Density Functional Theory (DFT) in the self-consistent constrained Skyrme…

Nuclear Theory · Physics 2014-11-21 A. Staszczak , M. Stoitsov , A. Baran , W. Nazarewicz

We present semi-decentralized and distributed algorithms, designed via a preconditioned forward-backward operator splitting, for solving large-scale, decomposable semidefinite programs (SDPs). We exploit a chordal aggregate sparsity pattern…

Optimization and Control · Mathematics 2019-11-19 Filippo Fabiani , Sergio Grammatico

Motivated by big data applications, first-order methods have been extremely popular in recent years. However, naive gradient methods generally converge slowly. Hence, much efforts have been made to accelerate various first-order methods.…

Optimization and Control · Mathematics 2016-06-30 Yangyang Xu

This work presents an adaptive superfast proximal augmented Lagrangian (AS-PAL) method for solving linearly-constrained smooth nonconvex composite optimization problems. Each iteration of AS-PAL inexactly solves a possibly nonconvex…

Optimization and Control · Mathematics 2022-10-07 Arnesh Sujanani , Renato D. C. Monteiro

By exploiting double-penalty terms for the primal subproblem, we develop a novel relaxed augmented Lagrangian method for solving a family of convex optimization problems subject to equality or inequality constraints. The method is then…

Numerical Analysis · Mathematics 2025-06-16 Jianchao Bai , Linyuan Jia , Zheng Peng

Doubly nonnegative (DNN) relaxation usually provides a tight lower bound for a mixed-binary quadratic program (MBQP). However, solving DNN problems is challenging because: (1) the problem size is $\Omega((n+l)^2)$ for an MBQP with $n$…

Optimization and Control · Mathematics 2025-07-21 Di Hou , Tianyun Tang , Kim-Chuan Toh

We are presenting a modification of the well-known Alternating Direction Method of Multipliers (ADMM) algorithm with additional preconditioning that aims at solving convex optimisation problems with nonlinear operator constraints.…

Numerical Analysis · Mathematics 2020-02-13 Martin Benning , Florian Knoll , Carola-Bibiane Schönlieb , Tuomo Valkonen

Augmented Lagrangian (AL) methods are a well known class of algorithms for solving constrained optimization problems. They have been extended to the solution of saddle-point systems of linear equations. We study an AL (SPAL) algorithm for…

Numerical Analysis · Mathematics 2024-04-24 N. Huang , Y. -H. Dai , D. Orban , M. A. Saunders

This paper presents two new techniques relating to inexact solution of subproblems in augmented Lagrangian methods for convex programming. The first involves combining a relative error criterion for solution of the subproblems with over- or…

Optimization and Control · Mathematics 2025-09-17 Jonathan Eckstein , Chang Yu

A new approach to solving a class of rankconstrained semi-definite programming (SDP) problems, which appear in many signal processing applications such as transmit beamspace design in multiple-input multiple-output (MIMO) radar, downlink…

Information Theory · Computer Science 2016-10-10 Matthew W. Morency , Sergiy A. Vorobyov

This paper introduces a novel optimization algorithm designed for nonlinear least-squares problems. The method is derived by preconditioning the gradient descent direction using the Singular Value Decomposition (SVD) of the Jacobian. This…

Numerical Analysis · Mathematics 2026-02-11 Zhipeng Chang , Wenrui Hao , Nian Liu

Augmented Lagrangian method (ALM) has been popularly used for solving constrained optimization problems. Practically, subproblems for updating primal variables in the framework of ALM usually can only be solved inexactly. The convergence…

Optimization and Control · Mathematics 2018-03-28 Yangyang Xu

In this paper, "chance optimization" problems are introduced, where one aims at maximizing the probability of a set defined by polynomial inequalities. These problems are, in general, nonconvex and computationally hard. With the objective…

Optimization and Control · Mathematics 2015-05-12 Ashkan Jasour , Necdet Serhat Aybat , Constantino Lagoa