English
Related papers

Related papers: An Inexact Augmented Lagrangian Method for Second-…

200 papers

First-order methods have been studied for nonlinear constrained optimization within the framework of the augmented Lagrangian method (ALM) or penalty method. We propose an improved inexact ALM (iALM) and conduct a unified analysis for…

Optimization and Control · Mathematics 2021-03-25 Zichong Li , Pin-Yu Chen , Sijia Liu , Songtao Lu , Yangyang Xu

Symmetric cone programming covers a broad class of convex optimization problems, including linear programming, second-order cone programming, and semidefinite programming. Although the augmented Lagrangian method (ALM) is well-suited for…

Optimization and Control · Mathematics 2026-03-03 Rui-Jin Zhang , Ruoyu Diao , Xin-Wei Liu , Yu-Hong Dai

In this paper, we present a two-phase augmented Lagrangian method, called QSDPNAL, for solving convex quadratic semidefinite programming (QSDP) problems with constraints consisting of a large number of linear equality, inequality…

Optimization and Control · Mathematics 2017-01-02 Xudong Li , Defeng Sun , Kim-Chuan Toh

Augmented Lagrangian method (ALM) has been popularly used for solving constrained optimization problems. Practically, subproblems for updating primal variables in the framework of ALM usually can only be solved inexactly. The convergence…

Optimization and Control · Mathematics 2018-03-28 Yangyang Xu

A stochastic linear quadratic (LQ) optimal control problem with a pointwise linear equality constraint on the terminal state is considered. A strong Lagrangian duality theorem is proved under a uniform convexity condition on the cost…

Optimization and Control · Mathematics 2023-01-23 Haisen Zhang , Xianfeng Zhang

We present a numerical method for the minimization of constrained optimization problems where the objective is augmented with large quadratic penalties of inconsistent equality constraints. Such objectives arise from quadratic integral…

Optimization and Control · Mathematics 2021-08-16 Martin Neuenhofen , Eric Kerrigan

We consider the convex minimization model with both linear equality and inequality constraints, and reshape the classic augmented Lagrangian method (ALM) by balancing its subproblems. As a result, one of its subproblems decouples the…

Optimization and Control · Mathematics 2021-08-20 Bingsheng He , Xiaoming Yuan

In this paper, we propose an inexact Augmented Lagrangian Method (ALM) for the optimization of convex and nonsmooth objective functions subject to linear equality constraints and box constraints where errors are due to fixed-point data. To…

Optimization and Control · Mathematics 2019-07-23 Yan Zhang , Michael M. Zavlanos

The auxiliary problem principle of augmented Lagrangian (APP-AL), proposed by Cohen and Zhu (1984), aims to find the solution of a constrained optimization problem through a sequence of auxiliary problems involving augmented Lagrangian. The…

Optimization and Control · Mathematics 2017-01-17 Lei Zhao , Daoli Zhu , Bo Jiang

The Augmented Lagrangian Method (ALM) is an iterative method for the solution of equality-constrained non-linear programming problems. In contrast to the quadratic penalty method, the ALM can satisfy equality constraints in an exact way.…

Numerical Analysis · Mathematics 2018-04-24 Martin Neuenhofen

Nonlinearly constrained nonconvex and nonsmooth optimization models play an increasingly important role in machine learning, statistics and data analytics. In this paper, based on the augmented Lagrangian function we introduce a flexible…

Optimization and Control · Mathematics 2020-07-27 Daoli Zhu , Lei Zhao , Shuzhong Zhang

The augmented Lagrangian method (ALM) is one of the most useful methods for constrained optimization. Its convergence has been well established under convexity assumptions or smoothness assumptions, or under both assumptions. ALM may…

Optimization and Control · Mathematics 2021-12-10 Jinshan Zeng , Wotao Yin , Ding-Xuan Zhou

The augmented Lagrangian (AL) method that solves convex optimization problems with linear constraints has drawn more attention recently in imaging applications due to its decomposable structure for composite cost functions and empirical…

Optimization and Control · Mathematics 2015-11-30 Hung Nien , Jeffrey A. Fessler

The augmented Lagrangian method (ALM) is classic for canonical convex programming problems with linear constraints, and it finds many applications in various scientific computing areas. A major advantage of the ALM is that the step for…

Optimization and Control · Mathematics 2022-12-02 Bingsheng He , Feng Ma , Shengjie Xu , Xiaoming Yuan

This paper proposes QPALM, a proximal augmented Lagrangian method based on quadratic approximations, for solving nonlinear programming problems with weakly convex objective and constraint functions. The algorithm is constructed by…

Optimization and Control · Mathematics 2026-05-06 Yule Zhang , Benqi Liu , Xiantao Xiao , Liwei Zhang

In this work, we propose a preconditioned augmented Lagrangian method (ALM) for solving semidefinite programming (SDP) problems. The preconditioner is implemented via a weighted penalty function in the ALM subproblem, with the weight matrix…

Optimization and Control · Mathematics 2026-05-19 Tianyun Tang , Kim-Chuan Toh

In this work we are interested in nonlinear symmetric cone problems (NSCPs), which contain as special cases nonlinear semidefinite programming, nonlinear second order cone programming and the classical nonlinear programming problems. We…

Optimization and Control · Mathematics 2025-07-14 Bruno F. Lourenço , Ellen H. Fukuda , Masao Fukushima

Second-order sufficient conditions for local optimality have been playing an important role in local convergence analysis of optimization algorithms. In this paper, we demonstrate that this condition alone suffices to justify the linear…

Optimization and Control · Mathematics 2021-05-04 Nguyen T. V. Hang , M. Ebrahim Sarabi

We introduce a twice differentiable augmented Lagrangian for nonlinear optimization with general inequality constraints and show that a strict local minimizer of the original problem is an approximate strict local solution of the augmented…

Optimization and Control · Mathematics 2021-06-30 Xin-Wei Liu , Yu-Hong Dai , Ya-Kui Huang , Jie Sun

In this paper, we show that for a class of linearly constrained convex composite optimization problems, an (inexact) symmetric Gauss-Seidel based majorized multi-block proximal alternating direction method of multipliers (ADMM) is…

Optimization and Control · Mathematics 2019-01-29 Liang Chen , Xudong Li , Defeng Sun , Kim-Chuan Toh