English
Related papers

Related papers: Using a Factored Dual in Augmented Lagrangian Meth…

200 papers

In this paper, we study augmented Lagrangian functions for nonlinear semidefinite programming (NSDP) problems with exactness properties. The term exact is used in the sense that the penalty parameter can be taken appropriately, so a single…

Optimization and Control · Mathematics 2018-06-27 Ellen H. Fukuda , Bruno F. Lourenço

We consider the convex minimization model with both linear equality and inequality constraints, and reshape the classic augmented Lagrangian method (ALM) by balancing its subproblems. As a result, one of its subproblems decouples the…

Optimization and Control · Mathematics 2021-08-20 Bingsheng He , Xiaoming Yuan

In this paper, we consider nonlinear optimization problems with nonlinear equality constraints and bound constraints on the variables. For the solution of such problems, many augmented Lagrangian methods have been defined in the literature.…

Optimization and Control · Mathematics 2022-01-12 Andrea Cristofari , Gianni Di Pillo , Giampaolo Liuzzi , Stefano Lucidi

Optimization problems with convex quadratic cost and polyhedral constraints are ubiquitous in signal processing, automatic control and decision-making. We consider here an enlarged problem class that allows to encode logical conditions and…

Optimization and Control · Mathematics 2026-04-09 Alberto De Marchi

Lagrangian duality in mixed integer optimization is a useful framework for problems decomposition and for producing tight lower bounds to the optimal objective, but in contrast to the convex counterpart, it is generally unable to produce…

Optimization and Control · Mathematics 2014-11-10 Robin Vujanic , Peyman Mohajerin Esfahani , Paul Goulart , Sebastien Mariethoz , Manfred Morari

Binary optimization is a central problem in mathematical optimization and its applications are abundant. To solve this problem, we propose a new class of continuous optimization techniques which is based on Mathematical Programming with…

Optimization and Control · Mathematics 2017-12-07 Ganzhao Yuan , Bernard Ghanem

We propose an efficient algorithm for sparse signal reconstruction problems. The proposed algorithm is an augmented Lagrangian method based on the dual sparse reconstruction problem. It is efficient when the number of unknown variables is…

Machine Learning · Statistics 2010-10-06 Ryota Tomioka , Masashi Sugiyama

This note establishes a limiting formula for the conic Lagrangian dual of a convex infinite optimization problem, correcting the classical version of Karney [Math. Programming 27 (1983) 75-82] for convex semi-infinite programs. A…

Optimization and Control · Mathematics 2021-06-29 Miguel A. Goberna , Michel Volle

Augmented Lagrangian dual augments the classical Lagrangian dual with a non-negative non-linear penalty function of the violation of the relaxed/dualized constraints in order to reduce the duality gap. We investigate the cases in which…

Optimization and Control · Mathematics 2025-01-20 Avinash Bhardwaj , Vishnu Narayanan , Abhishek Pathapati

In this paper, we propose a unified primal-dual algorithm framework based on the augmented Lagrangian function for composite convex problems with conic inequality constraints. The new framework is highly versatile. First, it not only covers…

Optimization and Control · Mathematics 2022-08-31 Zhenyuan Zhu , Fan Chen , Junyu Zhang , Zaiwen Wen

In contrast with many other convex optimization classes, state-of-the-art semidefinite programming solvers are yet unable to efficiently solve large scale instances. This work aims to reduce this scalability gap by proposing a novel…

Optimization and Control · Mathematics 2018-12-20 Mario Souto , Joaquim D. Garcia , Alvaro Veiga

The Augmented Lagrangian Method (ALM) is an iterative method for the solution of equality-constrained non-linear programming problems. In contrast to the quadratic penalty method, the ALM can satisfy equality constraints in an exact way.…

Numerical Analysis · Mathematics 2018-04-24 Martin Neuenhofen

Alternating direction methods of multipliers (ADMMs) are popular approaches to handle large scale semidefinite programs that gained attention during the past decade. In this paper, we focus on solving doubly nonnegative programs (DNN),…

Optimization and Control · Mathematics 2020-09-15 Martina Cerulli , Marianna De Santis , Elisabeth Gaar , Angelika Wiegele

Most recently, He and Yuan [arXiv:2108.08554, 2021] have proposed a balanced augmented Lagrangian method (ALM) for the canonical convex programming problem with linear constraints, which advances the original ALM by balancing its…

Optimization and Control · Mathematics 2021-12-30 Shengjie Xu

The continuous nonlinear resource allocation problem (CONRAP) has broad applications in economics, engineering, production and inventory management, and often serves as a subproblem in complex programming. Without relying on monotonicity…

Optimization and Control · Mathematics 2025-01-10 Kaixiang Hu , Caixia Kou , Jianhua Yuan

In a recent work (arXiv-DOI: 1804.08072v1) we introduced the Modified Augmented Lagrangian Method (MALM) for the efficient minimization of objective functions with large quadratic penalty terms. From MALM there results an optimality…

Numerical Analysis · Mathematics 2018-06-22 Martin Neuenhofen

This paper proposes two approaches for inferencing binary codes in two-step (supervised, unsupervised) hashing. We first introduce an unified formulation for both supervised and unsupervised hashing. Then, we cast the learning of one bit as…

Computer Vision and Pattern Recognition · Computer Science 2016-07-20 Thanh-Toan Do , Anh-Dzung Doan , Duc-Thanh Nguyen , Ngai-Man Cheung

We propose a semi-proximal augmented Lagrangian based decomposition method for convex composite quadratic conic programming problems with primal block angular structures. Using our algorithmic framework, we are able to naturally derive…

Optimization and Control · Mathematics 2018-12-13 Xin-Yee Lam , Defeng Sun , Kim-Chuan Toh

In this paper, we consider a nonconvex optimization problem with nonlinear equality constraints. We assume that both, the objective function and the functional constraints are locally smooth. For solving this problem, we propose a…

Optimization and Control · Mathematics 2025-05-08 Lahcen El Bourkhissi , Ion Necoara

Constrained optimization problems exist in many domains of science, such as thermodynamics, mechanics, economics, etc. These problems are classically solved with the help of the Lagrange multipliers and the Lagrangian function. However, the…

Optimization and Control · Mathematics 2021-01-12 Cyril Cayron