English
Related papers

Related papers: A low-rank augmented Lagrangian method for doubly …

200 papers

Integer programming with block structures has received considerable attention recently and is widely used in many practical applications such as train timetabling and vehicle routing problems. It is known to be NP-hard due to the presence…

Optimization and Control · Mathematics 2024-07-01 Rui Wang , Chuwen Zhang , Shanwen Pu , Jianjun Gao , Zaiwen Wen

This paper studies a recovery task of finding a low multilinear-rank tensor that fulfills some linear constraints in the general settings, which has many applications in computer vision and graphics. This problem is named as the low…

Optimization and Control · Mathematics 2013-10-08 Lei Yang , Zheng-Hai Huang , Yufan Li

This paper introduces two decomposition-based methods for two-block mixed-integer linear programs (MILPs), which aim to take advantage of separable structures of the original problem by solving a sequence of lower-dimensional MILPs. The…

Optimization and Control · Mathematics 2024-01-03 Kaizhao Sun , Mou Sun , Wotao Yin

We design inexact proximal augmented Lagrangian based decomposition methods for convex composite programming problems with dual block-angular structures. Our methods are particularly well suited for convex quadratic programming problems…

Optimization and Control · Mathematics 2023-03-14 Kuang-Yu Ding , Xin-Yee Lam , Kim-Chuan Toh

Low rank approximation is a commonly occurring problem in many computer vision and machine learning applications. There are two common ways of optimizing the resulting models. Either the set of matrices with a given rank can be explicitly…

Computer Vision and Pattern Recognition · Computer Science 2019-07-24 Marcus Valtonen Örnhag , Carl Olsson , Anders Heyden

This paper introduces HALLaR, a new first-order method for solving large-scale semidefinite programs (SDPs) with bounded domain. HALLaR is an inexact augmented Lagrangian (AL) method where the AL subproblems are solved by a novel hybrid…

Optimization and Control · Mathematics 2024-03-19 Renato D. C. Monteiro , Arnesh Sujanani , Diego Cifuentes

The augmented Lagrangian (AL) method that solves convex optimization problems with linear constraints has drawn more attention recently in imaging applications due to its decomposable structure for composite cost functions and empirical…

Optimization and Control · Mathematics 2015-11-30 Hung Nien , Jeffrey A. Fessler

Local convergence analysis of the augmented Lagrangian method (ALM) is established for a large class of composite optimization problems with nonunique Lagrange multipliers under a second-order sufficient condition. We present a new…

Optimization and Control · Mathematics 2023-10-23 Nguyen T. V. Hang , Ebrahim Sarabi

We propose an inexact proximal augmented Lagrangian method (P-ALM) for nonconvex structured optimization problems. The proposed method features an easily implementable rule not only for updating the penalty parameters, but also for…

Optimization and Control · Mathematics 2025-09-04 Adeyemi D. Adeoye , Puya Latafat , Alberto Bemporad

In this work, we propose a preconditioned augmented Lagrangian method (ALM) for solving semidefinite programming (SDP) problems. The preconditioner is implemented via a weighted penalty function in the ALM subproblem, with the weight matrix…

Optimization and Control · Mathematics 2026-05-19 Tianyun Tang , Kim-Chuan Toh

We propose a new randomized algorithm for solving convex optimization problems that have a large number of constraints (with high probability). Existing methods like interior-point or Newton-type algorithms are hard to apply to such…

Optimization and Control · Mathematics 2020-03-25 Bo Wei , William B. Haskell , Sixiang Zhao

Low-rank matrix regression is a fundamental problem in data science with various applications in systems and control. Nuclear norm regularization has been widely applied to solve this problem due to its convexity. However, it suffers from…

Systems and Control · Electrical Eng. & Systems 2025-06-04 Mingzhou Yin , Matthias A. Müller

This paper proposes QPALM, a proximal augmented Lagrangian method based on quadratic approximations, for solving nonlinear programming problems with weakly convex objective and constraint functions. The algorithm is constructed by…

Optimization and Control · Mathematics 2026-05-06 Yule Zhang , Benqi Liu , Xiantao Xiao , Liwei Zhang

This paper proposes D-ripALM, a Decentralized relative-type inexact proximal Augmented Lagrangian Method for consensus convex optimization over multi-agent networks. D-ripALM adopts a double-loop distributed optimization framework that…

Optimization and Control · Mathematics 2026-02-09 Jiayi Zhu , Hong Wang , Ling Liang , Lei Yang

This paper presents two new techniques relating to inexact solution of subproblems in augmented Lagrangian methods for convex programming. The first involves combining a relative error criterion for solution of the subproblems with over- or…

Optimization and Control · Mathematics 2025-09-17 Jonathan Eckstein , Chang Yu

Square-root Lasso problems are proven robust regression problems. Furthermore, square-root regression problems with structured sparsity also plays an important role in statistics and machine learning. In this paper, we focus on the…

Optimization and Control · Mathematics 2021-11-30 Chengjing Wang , Peipei Tang

This paper addresses problems of second-order cone programming important in optimization theory and applications. The main attention is paid to the augmented Lagrangian method (ALM) for such problems considered in both exact and inexact…

Optimization and Control · Mathematics 2021-07-07 Nguyen T. V. Hang , Boris S. Mordukhovich , M. Ebrahim Sarabi

We consider the augmented Lagrangian method (ALM) as a solver for the fused lasso signal approximator (FLSA) problem. The ALM is a dual method in which squares of the constraint functions are added as penalties to the Lagrangian. In order…

Computation · Statistics 2010-05-28 Heng Lian

We propose a duality scheme for solving constrained nonsmooth and nonconvex optimization problems in a reflexive Banach space. We establish strong duality for a very general type of augmented Lagrangian, in which we assume a less…

Optimization and Control · Mathematics 2023-02-07 Regina S. Burachik , Xuemei Liu

Despite the non-convexity of most modern machine learning parameterizations, Lagrangian duality has become a popular tool for addressing constrained learning problems. We revisit Augmented Lagrangian methods, which aim to mitigate the…

Machine Learning · Computer Science 2025-10-30 Ignacio Boero , Ignacio Hounie , Alejandro Ribeiro