English
Related papers

Related papers: An Augmented Lagrangian Approach to the Constraine…

200 papers

We consider minimization of the sum of a large number of convex functions, and we propose an incremental aggregated version of the proximal algorithm, which bears similarity to the incremental aggregated gradient and subgradient methods…

Systems and Control · Computer Science 2015-11-05 Dimitri P. Bertsekas

We introduce a framework for designing primal methods under the decentralized optimization setting where local functions are smooth and strongly convex. Our approach consists of approximately solving a sequence of sub-problems induced by…

Optimization and Control · Mathematics 2020-06-15 Yossi Arjevani , Joan Bruna , Bugra Can , Mert Gürbüzbalaban , Stefanie Jegelka , Hongzhou Lin

Inverse problems lie at the heart of modern imaging science, with broad applications in areas such as medical imaging, remote sensing, and microscopy. Recent years have witnessed a paradigm shift in solving imaging inverse problems, where…

Optimization and Control · Mathematics 2025-11-20 Hong Ye Tan , Subhadip Mukherjee , Junqi Tang

We study the application of the Augmented Lagrangian Method to the solution of linear ill-posed problems. Previously, linear convergence rates with respect to the Bregman distance have been derived under the classical assumption of a…

Numerical Analysis · Mathematics 2015-06-04 Klaus Frick , Markus Grasmair

We investigate finite-dimensional constrained structured optimization problems, featuring composite objective functions and set-membership constraints. Offering an expressive yet simple language, this problem class provides a modeling…

Optimization and Control · Mathematics 2023-02-09 Alberto De Marchi , Xiaoxi Jia , Christian Kanzow , Patrick Mehlitz

This paper proposes and analyzes a proximal augmented Lagrangian (NL-IAPIAL) method for solving smooth nonconvex composite optimization problems with nonlinear $\cal K$-convex constraints, i.e., the constraints are convex with respect to…

Optimization and Control · Mathematics 2022-07-06 Weiwei Kong , Jefferson G. Melo , Renato D. C. Monteiro

In this paper, we propose an inexact Augmented Lagrangian Method (ALM) for the optimization of convex and nonsmooth objective functions subject to linear equality constraints and box constraints where errors are due to fixed-point data. To…

Optimization and Control · Mathematics 2019-07-23 Yan Zhang , Michael M. Zavlanos

This paper proposes and establishes the iteration-complexity of an inexact proximal accelerated augmented Lagrangian (IPAAL) method for solving linearly constrained smooth nonconvex composite optimization problems. Each IPAAL iteration…

Optimization and Control · Mathematics 2020-06-16 Jefferson G. Melo , Renato D. C. Monteiro , Hairong Wang

To construct a parallel approach for solving optimization problems with orthogonality constraints is usually regarded as an extremely difficult mission, due to the low scalability of the orthonormalization procedure. However, such demand is…

Optimization and Control · Mathematics 2021-11-16 Bin Gao , Xin Liu , Ya-xiang Yuan

In this paper we propose a new inexact dual decomposition algorithm for solving separable convex optimization problems. This algorithm is a combination of three techniques: dual Lagrangian decomposition, smoothing and excessive gap. The…

Optimization and Control · Mathematics 2013-02-11 Quoc Tran Dinh , Ion Necoara , Moritz Diehl

Regularization and interior point approaches offer valuable perspectives to address constrained nonlinear optimization problems in view of control applications. This paper discusses the interactions between these techniques and proposes an…

Optimization and Control · Mathematics 2022-10-31 Alberto De Marchi

Optimization problems with convex quadratic cost and polyhedral constraints are ubiquitous in signal processing, automatic control and decision-making. We consider here an enlarged problem class that allows to encode logical conditions and…

Optimization and Control · Mathematics 2026-04-09 Alberto De Marchi

This paper studies a class of double-loop (inner-outer) algorithms for convex composite optimization. For unconstrained problems, we develop a restarted accelerated composite gradient method that attains the optimal first-order complexity…

Optimization and Control · Mathematics 2026-02-23 Matthew X. Burns , Jiaming Liang

Magnetic Resonance Imaging (MRI) is one of the fields that the compressed sensing theory is well utilized to reduce the scan time significantly leading to faster imaging or higher resolution images. It has been shown that a small fraction…

Information Theory · Computer Science 2014-06-03 Cagdas Bilen , Yao Wang , Ivan Selesnick

This paper proposes and analyzes an accelerated inexact dampened augmented Lagrangian (AIDAL) method for solving linearly-constrained nonconvex composite optimization problems. Each iteration of the AIDAL method consists of: (i) inexactly…

Optimization and Control · Mathematics 2023-02-08 Weiwei Kong , Renato D. C. Monteiro

We consider solving equality-constrained nonlinear, nonconvex optimization problems. This class of problems appears widely in a variety of applications in machine learning and engineering, ranging from constrained deep neural networks, to…

Optimization and Control · Mathematics 2023-05-31 Ilgee Hong , Sen Na , Michael W. Mahoney , Mladen Kolar

We develop a decomposition method based on the augmented Lagrangian framework to solve a broad family of semidefinite programming problems, possibly with nonlinear objective functions, nonsmooth regularization, and general linear…

Optimization and Control · Mathematics 2023-03-08 Yifei Wang , Kangkang Deng , Haoyang Liu , Zaiwen Wen

In this paper we the formulation of inverse problems as constrained minimization problems and their iterative solution by gradient or Newton type. We carry out a convergence analysis in the sense of regularization methods and discuss…

Numerical Analysis · Mathematics 2021-01-15 Barbara Kaltenbacher , Kha Van Huynh

Multiplicative noise (also known as speckle noise) models are central to the study of coherent imaging systems, such as synthetic aperture radar and sonar, and ultrasound and laser imaging. These models introduce two additional layers of…

Optimization and Control · Mathematics 2015-05-14 José M. Bioucas-Dias , Mário A. T. Figueiredo

This paper proposes a novel approach to solving nonlinear programming problems using a sharp augmented Lagrangian method with a smoothing technique. Traditional sharp augmented Lagrangian methods are known for their effectiveness but are…

Optimization and Control · Mathematics 2024-10-07 José Luis Romero , Damián Fernandez , Germán Ariel Torres