English
Related papers

Related papers: Iteration complexity of inexact augmented Lagrangi…

200 papers

Motivated by an inertial primal-dual dynamical system with vanishing damping, we propose a class of accelerated augmented Lagrangian methods with Nesterov extrapolation parameters for a linearly constrained convex optimization problem with…

Optimization and Control · Mathematics 2026-05-28 Xin He , Nan-Jing Huang , Yi-Bin Xiao , Ya-Ping Fang

Convergence rates are established for an inexact accelerated alternating direction method of multipliers (I-ADMM) for general separable convex optimization with a linear constraint. Both ergodic and non-ergodic iterates are analyzed.…

Numerical Analysis · Mathematics 2021-07-20 William W. Hager , Hongchao Zhang

Inexact proximal augmented Lagrangian methods (ipALMs) have been widely used for solving linearly constrained convex optimization problems, owing to their strong theoretical guarantees and excellent numerical performance. In practice,…

Optimization and Control · Mathematics 2026-05-08 Jiayi Zhu , Ling Liang , Lei Yang , Kim-Chuan Toh

This paper is devoted to the theoretical and numerical investigation of an augmented Lagrangian method for the solution of optimization problems with geometric constraints. Specifically, we study situations where parts of the constraints…

Optimization and Control · Mathematics 2022-04-20 Xiaoxi Jia , Christian Kanzow , Patrick Mehlitz , Gerd Wachsmuth

Zero-One Composite Optimization (0/1-COP) is a prototype of nonsmooth, nonconvex optimization problems and it has attracted much attention recently. The augmented Lagrangian Method (ALM) has stood out as a leading methodology for such…

Optimization and Control · Mathematics 2023-06-16 Penghe Zhang , Naihua Xiu , Hou-Duo Qi

We propose an inexact proximal augmented Lagrangian framework with explicit inner problem termination rule for composite convex optimization problems. We consider arbitrary linearly convergent inner solver including in particular stochastic…

Optimization and Control · Mathematics 2019-09-23 Fei Li , Zheng Qu

We analyze worst-case complexity of a Proximal augmented Lagrangian (Proximal AL) framework for nonconvex optimization with nonlinear equality constraints. When an approximate first-order (second-order) optimal point is obtained in the…

Optimization and Control · Mathematics 2020-09-03 Yue Xie , Stephen J. Wright

In a recent work (arXiv-DOI: 1804.08072v1) we introduced the Modified Augmented Lagrangian Method (MALM) for the efficient minimization of objective functions with large quadratic penalty terms. From MALM there results an optimality…

Numerical Analysis · Mathematics 2018-06-22 Martin Neuenhofen

We consider the problem of minimizing the sum of a smooth function and a composition of a zero-one loss function with a linear operator, namely zero-one composite optimization problem (0/1-COP). It is a versatile model including the support…

Optimization and Control · Mathematics 2021-12-02 Penghe Zhang , Naihua Xiu

Successive quadratic approximations, or second-order proximal methods, are useful for minimizing functions that are a sum of a smooth part and a convex, possibly nonsmooth part that promotes regularization. Most analyses of iteration…

Optimization and Control · Mathematics 2019-01-25 Ching-pei Lee , Stephen J. Wright

The Augmented Lagragian Method (ALM) and Alternating Direction Method of Multiplier (ADMM) have been powerful optimization methods for general convex programming subject to linear constraint. We consider the convex problem whose objective…

Optimization and Control · Mathematics 2015-11-18 Canyi Lu , Huan Li , Zhouchen Lin , Shuicheng Yan

This paper addresses a class of general nonsmooth and nonconvex composite optimization problems subject to nonlinear equality constraints. We assume that a part of the objective function and the functional constraints exhibit local…

Optimization and Control · Mathematics 2025-03-04 Lahcen El Bourkhissi , Ion Necoara , Panagiotis Patrinos , Quoc Tran-Dinh

This paper proposes a partially inexact alternating direction method of multipliers for computing approximate solution of a linearly constrained convex optimization problem. This method allows its first subproblem to be solved inexactly…

Optimization and Control · Mathematics 2018-05-21 Vando A. Adona , Max L. N. Goncalves , Jefferson G. Melo

We introduce a twice differentiable augmented Lagrangian for nonlinear optimization with general inequality constraints and show that a strict local minimizer of the original problem is an approximate strict local solution of the augmented…

Optimization and Control · Mathematics 2021-06-30 Xin-Wei Liu , Yu-Hong Dai , Ya-Kui Huang , Jie Sun

This paper is devoted to first-order algorithms for smooth convex optimization with inexact gradients. Unlike the majority of the literature on this topic, we consider the setting of relative rather than absolute inexactness. More…

Optimization and Control · Mathematics 2023-10-03 Nikita Kornilov , Eduard Gorbunov , Mohammad Alkousa , Fedor Stonyakin , Pavel Dvurechensky , Alexander Gasnikov

In this paper we study the worst-case complexity of an inexact Augmented Lagrangian method for nonconvex constrained problems. Assuming that the penalty parameters are bounded, we prove a complexity bound of $\mathcal{O}(|\log(\epsilon)|)$…

Optimization and Control · Mathematics 2021-05-25 Geovani N. Grapiglia , Ya-xiang Yuan

This work presents an adaptive superfast proximal augmented Lagrangian (AS-PAL) method for solving linearly-constrained smooth nonconvex composite optimization problems. Each iteration of AS-PAL inexactly solves a possibly nonconvex…

Optimization and Control · Mathematics 2022-10-07 Arnesh Sujanani , Renato D. C. Monteiro

In this paper, we propose a penalty dual-primal augmented lagrangian method for solving convex minimization problems under linear equality or inequality constraints. The proposed method combines a novel penalty technique with updates the…

Optimization and Control · Mathematics 2023-05-09 Jie Liu , Xiaoqing Ou , Jiawei Chen

We propose a new bundle-based augmented Lagrangian framework for solving constrained convex problems. Unlike the classical (inexact) augmented Lagrangian method (ALM) that has a nested double-loop structure, our framework features a…

Optimization and Control · Mathematics 2025-02-14 Feng-Yi Liao , Yang Zheng

In this paper we present complexity certification results for a distributed Augmented Lagrangian (AL) algorithm used to solve convex optimization problems involving globally coupled linear constraints. Our method relies on the Accelerated…

Optimization and Control · Mathematics 2018-01-16 Soomin Lee , Nikolaos Chatzipanagiotis , Michael M. Zavlanos