English
Related papers

Related papers: Iteration-complexity of an inner accelerated inexa…

200 papers

This paper proposes and establishes the iteration-complexity of an inexact proximal accelerated augmented Lagrangian (IPAAL) method for solving linearly constrained smooth nonconvex composite optimization problems. Each IPAAL iteration…

Optimization and Control · Mathematics 2020-06-16 Jefferson G. Melo , Renato D. C. Monteiro , Hairong Wang

This paper proposes and analyzes an accelerated inexact dampened augmented Lagrangian (AIDAL) method for solving linearly-constrained nonconvex composite optimization problems. Each iteration of the AIDAL method consists of: (i) inexactly…

Optimization and Control · Mathematics 2023-02-08 Weiwei Kong , Renato D. C. Monteiro

This paper proposes and analyzes a proximal augmented Lagrangian (NL-IAPIAL) method for solving smooth nonconvex composite optimization problems with nonlinear $\cal K$-convex constraints, i.e., the constraints are convex with respect to…

Optimization and Control · Mathematics 2022-07-06 Weiwei Kong , Jefferson G. Melo , Renato D. C. Monteiro

This work presents an adaptive superfast proximal augmented Lagrangian (AS-PAL) method for solving linearly-constrained smooth nonconvex composite optimization problems. Each iteration of AS-PAL inexactly solves a possibly nonconvex…

Optimization and Control · Mathematics 2022-10-07 Arnesh Sujanani , Renato D. C. Monteiro

In this paper we consider a class of convex conic programming. In particular, we first propose an inexact augmented Lagrangian (I-AL) method that resembles the classical I-AL method for solving this problem, in which the augmented…

Optimization and Control · Mathematics 2022-11-22 Zhaosong Lu , Zirui Zhou

In this paper, we establish for the first time the oracle complexity of a Riemannian inexact augmented Lagrangian (RiAL) method with the classical dual update for solving a class of Riemannian nonsmooth composite problems. By using the…

Optimization and Control · Mathematics 2024-10-03 Meng Xu , Bo Jiang , Ya-Feng Liu , Anthony Man-Cho So

We propose a practical inexact augmented Lagrangian method (iALM) for nonconvex problems with nonlinear constraints. We characterize the total computational complexity of our method subject to a verifiable geometric condition, which is…

Optimization and Control · Mathematics 2022-04-22 Mehmet Fatih Sahin , Armin Eftekhari , Ahmet Alacaoglu , Fabian Latorre , Volkan Cevher

In this paper, we consider the linearly constrained composite convex optimization problem, whose objective is a sum of a smooth function and a possibly nonsmooth function. We propose an inexact augmented Lagrangian (IAL) framework for…

Optimization and Control · Mathematics 2018-03-30 Ya-Feng Liu , Xin Liu , Shiqian Ma

Augmented Lagrangian method (ALM) has been popularly used for solving constrained optimization problems. Practically, subproblems for updating primal variables in the framework of ALM usually can only be solved inexactly. The convergence…

Optimization and Control · Mathematics 2018-03-28 Yangyang Xu

In this paper we analyze several inexact fast augmented Lagrangian methods for solving linearly constrained convex optimization problems. Mainly, our methods rely on the combination of excessive-gap-like smoothing technique developed in…

Optimization and Control · Mathematics 2015-05-14 Andrei Patrascu , Ion Necoara , Quoc Tran-Dinh

First-order methods have been studied for nonlinear constrained optimization within the framework of the augmented Lagrangian method (ALM) or penalty method. We propose an improved inexact ALM (iALM) and conduct a unified analysis for…

Optimization and Control · Mathematics 2021-03-25 Zichong Li , Pin-Yu Chen , Sijia Liu , Songtao Lu , Yangyang Xu

We study the computational complexity certification of inexact gradient augmented Lagrangian methods for solving convex optimization problems with complicated constraints. We solve the augmented Lagrangian dual problem that arises from the…

Optimization and Control · Mathematics 2013-02-19 Valentin Nedelcu , Ion Necoara , Quoc Tran Dinh

In this paper, we consider a class of convex programming problems with linear equality constraints, which finds broad applications in machine learning and signal processing. We propose a new adaptive balanced augmented Lagrangian (ABAL)…

Signal Processing · Electrical Eng. & Systems 2024-10-22 Jiageng Wu , Bo Jiang , Xinxin Li , Ya-Feng Liu , Jianhua Yuan

We propose an inexact proximal augmented Lagrangian framework with explicit inner problem termination rule for composite convex optimization problems. We consider arbitrary linearly convergent inner solver including in particular stochastic…

Optimization and Control · Mathematics 2019-09-23 Fei Li , Zheng Qu

Many real-world problems not only have complicated nonconvex functional constraints but also use a large number of data points. This motivates the design of efficient stochastic methods on finite-sum or expectation constrained problems. In…

Optimization and Control · Mathematics 2022-12-20 Zichong Li , Pin-Yu Chen , Sijia Liu , Songtao Lu , Yangyang Xu

In this paper we present complexity certification results for a distributed Augmented Lagrangian (AL) algorithm used to solve convex optimization problems involving globally coupled linear constraints. Our method relies on the Accelerated…

Optimization and Control · Mathematics 2018-01-16 Soomin Lee , Nikolaos Chatzipanagiotis , Michael M. Zavlanos

It is well-known that the lower bound of iteration complexity for solving nonconvex unconstrained optimization problems is $\Omega(1/\epsilon^2)$, which can be achieved by standard gradient descent algorithm when the objective function is…

Optimization and Control · Mathematics 2022-11-02 Jiawei Zhang , Wenqiang Pu , Zhi-Quan Luo

We give a damped proximal augmented Lagrangian method (DPALM) for solving problems with a weakly-convex objective and convex linear/nonlinear constraints. Instead of taking a full stepsize, DPALM adopts a damped dual stepsize to ensure the…

Optimization and Control · Mathematics 2025-11-20 Hari Dahal , Wei Liu , Yangyang Xu

In this paper we propose and analyze inexact and stochastic versions of the CGALP algorithm developed in the authors' previous paper, which we denote ICGALP, that allows for errors in the computation of several important quantities. In…

Optimization and Control · Mathematics 2022-10-20 Antonio Silveti-Falls , Cesare Molinari , Jalal Fadili

We propose QPALM, a nonconvex quadratic programming (QP) solver based on the proximal augmented Lagrangian method. This method solves a sequence of inner subproblems which can be enforced to be strongly convex and which therefore admit a…

Optimization and Control · Mathematics 2024-04-17 Ben Hermans , Andreas Themelis , Panagiotis Patrinos
‹ Prev 1 2 3 10 Next ›