English
Related papers

Related papers: An Augmented Lagrangian Approach to the Constraine…

200 papers

We propose an inexact proximal augmented Lagrangian framework with explicit inner problem termination rule for composite convex optimization problems. We consider arbitrary linearly convergent inner solver including in particular stochastic…

Optimization and Control · Mathematics 2019-09-23 Fei Li , Zheng Qu

In this paper, we consider the linearly constrained composite convex optimization problem, whose objective is a sum of a smooth function and a possibly nonsmooth function. We propose an inexact augmented Lagrangian (IAL) framework for…

Optimization and Control · Mathematics 2018-03-30 Ya-Feng Liu , Xin Liu , Shiqian Ma

By exploiting double-penalty terms for the primal subproblem, we develop a novel relaxed augmented Lagrangian method for solving a family of convex optimization problems subject to equality or inequality constraints. The method is then…

Numerical Analysis · Mathematics 2025-06-16 Jianchao Bai , Linyuan Jia , Zheng Peng

Models involving hybrid systems are versatile in their application but difficult to optimize efficiently due to their combinatorial nature. This work presents a method to cope with hybrid optimal control problems which, in contrast to…

Optimization and Control · Mathematics 2025-05-20 Viktoriya Nikitina , Alberto De Marchi , Matthias Gerdts

First-order methods have been studied for nonlinear constrained optimization within the framework of the augmented Lagrangian method (ALM) or penalty method. We propose an improved inexact ALM (iALM) and conduct a unified analysis for…

Optimization and Control · Mathematics 2021-03-25 Zichong Li , Pin-Yu Chen , Sijia Liu , Songtao Lu , Yangyang Xu

This paper proposes QPALM, a proximal augmented Lagrangian method based on quadratic approximations, for solving nonlinear programming problems with weakly convex objective and constraint functions. The algorithm is constructed by…

Optimization and Control · Mathematics 2026-05-06 Yule Zhang , Benqi Liu , Xiantao Xiao , Liwei Zhang

In this work we present a novel optimization strategy for image reconstruction tasks under analysis-based image regularization, which promotes sparse and/or low-rank solutions in some learned transform domain. We parameterize such…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Iaroslav Koshelev , Stamatios Lefkimmiatis

Inverse problems arise in a wide spectrum of applications in fields ranging from engineering to scientific computation. Connected with the rise of interest in inverse problems is the development and analysis of regularization methods, such…

Numerical Analysis · Mathematics 2025-05-12 Abinash Nayak

This work introduces an unconventional inexact augmented Lagrangian method where the augmenting term is a Euclidean norm raised to a power between one and two. The proposed algorithm is applicable to a broad class of constrained nonconvex…

Optimization and Control · Mathematics 2025-11-25 Alexander Bodard , Konstantinos Oikonomidis , Emanuel Laude , Panagiotis Patrinos

We contribute improvements to a Lagrangian dual solution approach applied to large-scale optimization problems whose objective functions are convex, continuously differentiable and possibly nonlinear, while the non-relaxed constraint set is…

Optimization and Control · Mathematics 2019-08-09 Brian Dandurand , Natashia Boland , Jeffrey Christiansen , Andrew Eberhard , Fabricio Oliveira

We propose a practical inexact augmented Lagrangian method (iALM) for nonconvex problems with nonlinear constraints. We characterize the total computational complexity of our method subject to a verifiable geometric condition, which is…

Optimization and Control · Mathematics 2022-04-22 Mehmet Fatih Sahin , Armin Eftekhari , Ahmet Alacaoglu , Fabian Latorre , Volkan Cevher

We propose an adaptive regularization scheme in a variational framework where a convex composite energy functional is optimized. We consider a number of imaging problems including denoising, segmentation and motion estimation, which are…

Computer Vision and Pattern Recognition · Computer Science 2017-03-01 Byung-Woo Hong , Ja-Keoung Koo , Hendrik Dirks , Martin Burger

This work investigates the convergence behavior of augmented Lagrangian methods (ALMs) when applied to convex optimization problems that may be infeasible. ALMs are a popular class of algorithms for solving constrained optimization…

Optimization and Control · Mathematics 2026-03-17 Roland Andrews , Justin Carpentier , Adrien Taylor

Motion planning for manipulators under task space constraints is difficult as it constrains the joint configurations to always lie on an implicitly defined manifold. It is possible to view task constrained motion planning as an optimization…

Robotics · Computer Science 2018-03-13 Arun Kumar Singh , Reza Ghabcheloo , Andreas Muller , Harit Pandya

Most recently, He and Yuan [arXiv:2108.08554, 2021] have proposed a balanced augmented Lagrangian method (ALM) for the canonical convex programming problem with linear constraints, which advances the original ALM by balancing its…

Optimization and Control · Mathematics 2021-12-30 Shengjie Xu

We present a data-assisted iterative regularization method for solving ill-posed inverse problems. The proposed approach, termed \texttt{IRMGL+\(\Psi\)}, integrates classical iterative techniques with a data-driven regularization term…

Numerical Analysis · Mathematics 2025-10-28 Harshit Bajpai , Gaurav Mittal , Ankik Kumar Giri

We present an adaptive regularization scheme for optimizing composite energy functionals arising in image analysis problems. The scheme automatically trades off data fidelity and regularization depending on the current data fit during the…

Computer Vision and Pattern Recognition · Computer Science 2017-05-10 Byung-Woo Hong , Ja-Keoung Koo , Martin Burger , Stefano Soatto

This paper presents an efficient algorithm to solve total variation (TV) regularizations of images contaminated by a both blur and noise. The unconstrained structure of the problem suggests that one can solve a constrained optimization…

Numerical Analysis · Computer Science 2018-02-13 A. Bentbib , M. El Guide , K. Jbilou

We study a class of optimization problems in which the objective function is given by the sum of a differentiable but possibly nonconvex component and a nondifferentiable convex regularization term. We introduce an auxiliary variable to…

Optimization and Control · Mathematics 2019-08-27 Neil K. Dhingra , Sei Zhen Khong , Mihailo R. Jovanović

This paper provides a theoretical and numerical investigation of a penalty decomposition scheme for the solution of optimization problems with geometric constraints. In particular, we consider some situations where parts of the constraints…

Optimization and Control · Mathematics 2023-03-23 Matteo Lapucci , Christian Kanzow