English
Related papers

Related papers: Using a Factored Dual in Augmented Lagrangian Meth…

200 papers

This paper presents a new exact method to calculate worst-case parameter realizations in two-stage robust optimization problems with categorical or binary-valued uncertain data. Traditional exact algorithms for these problems, notably…

Optimization and Control · Mathematics 2022-01-19 Anirudh Subramanyam

In this work, we propose a preconditioned augmented Lagrangian method (ALM) for solving semidefinite programming (SDP) problems. The preconditioner is implemented via a weighted penalty function in the ALM subproblem, with the weight matrix…

Optimization and Control · Mathematics 2026-05-19 Tianyun Tang , Kim-Chuan Toh

Seeking tighter relaxations of combinatorial optimization problems, semidefinite programming is a generalization of linear programming that offers better bounds and is still polynomially solvable. Yet, in practice, a semidefinite program is…

Optimization and Control · Mathematics 2023-11-17 Daniel Porumbel

We propose a variant of the classical augmented Lagrangian method for constrained optimization problems in Banach spaces. Our theoretical framework does not require any convexity or second-order assumptions and allows the treatment of…

Optimization and Control · Mathematics 2018-07-13 Christian Kanzow , Daniel Steck , Daniel Wachsmuth

Dual decomposition approaches in nonconvex optimization may suffer from a duality gap. This poses a challenge when applying them directly to nonconvex problems such as MAP-inference in a Markov random field (MRF) with continuous state…

Optimization and Control · Mathematics 2022-05-17 Hartmut Bauermeister , Emanuel Laude , Thomas Möllenhoff , Michael Moeller , Daniel Cremers

We propose a new bundle-based augmented Lagrangian framework for solving constrained convex problems. Unlike the classical (inexact) augmented Lagrangian method (ALM) that has a nested double-loop structure, our framework features a…

Optimization and Control · Mathematics 2025-02-14 Feng-Yi Liao , Yang Zheng

In this paper, we propose an inexact Augmented Lagrangian Method (ALM) for the optimization of convex and nonsmooth objective functions subject to linear equality constraints and box constraints where errors are due to fixed-point data. To…

Optimization and Control · Mathematics 2019-07-23 Yan Zhang , Michael M. Zavlanos

Many problems in modern robotics can be addressed by modeling them as bilevel optimization problems. In this work, we leverage augmented Lagrangian methods and recent advances in automatic differentiation to develop a general-purpose…

Robotics · Computer Science 2019-07-03 Benoit Landry , Zachary Manchester , Marco Pavone

Nonnegative Matrix Factorization consists in (approximately) factorizing a nonnegative data matrix by the product of two low-rank nonnegative matrices. It has been successfully applied as a data analysis technique in numerous domains, e.g.,…

Optimization and Control · Mathematics 2012-08-13 Nicolas Gillis , François Glineur

We examine the problem of approximating a positive, semidefinite matrix $\Sigma$ by a dyad $xx^T$, with a penalty on the cardinality of the vector $x$. This problem arises in sparse principal component analysis, where a decomposition of…

Optimization and Control · Mathematics 2007-06-13 Laurent El Ghaoui

Integer programming with block structures has received considerable attention recently and is widely used in many practical applications such as train timetabling and vehicle routing problems. It is known to be NP-hard due to the presence…

Optimization and Control · Mathematics 2024-07-01 Rui Wang , Chuwen Zhang , Shanwen Pu , Jianjun Gao , Zaiwen Wen

We design inexact proximal augmented Lagrangian based decomposition methods for convex composite programming problems with dual block-angular structures. Our methods are particularly well suited for convex quadratic programming problems…

Optimization and Control · Mathematics 2023-03-14 Kuang-Yu Ding , Xin-Yee Lam , Kim-Chuan Toh

In this paper we analyze several inexact fast augmented Lagrangian methods for solving linearly constrained convex optimization problems. Mainly, our methods rely on the combination of excessive-gap-like smoothing technique developed in…

Optimization and Control · Mathematics 2015-05-14 Andrei Patrascu , Ion Necoara , Quoc Tran-Dinh

In this paper, we propose novel algorithms for inferring the Maximum a Posteriori (MAP) solution of discrete pairwise random field models under multiple constraints. We show how this constrained discrete optimization problem can be…

Machine Learning · Computer Science 2013-08-02 Yongsub Lim , Kyomin Jung , Pushmeet Kohli

We propose two different Lagrange multiplier methods for contact problems derived from the augmented Lagrangian variational formulation. Both the obstacle problem, where a constraint on the solution is imposed in the bulk domain and the…

Numerical Analysis · Mathematics 2016-09-13 Erik Burman , Peter Hansbo , Mats Larson

We introduce a framework for designing primal methods under the decentralized optimization setting where local functions are smooth and strongly convex. Our approach consists of approximately solving a sequence of sub-problems induced by…

Optimization and Control · Mathematics 2020-06-15 Yossi Arjevani , Joan Bruna , Bugra Can , Mert Gürbüzbalaban , Stefanie Jegelka , Hongzhou Lin

Solving semidefinite programs (SDP) in a short time is the key to managing various mathematical optimization problems. The matrix-completion primal-dual interior-point method (MC-PDIPM) extracts a sparse structure of input SDP by…

Optimization and Control · Mathematics 2014-05-27 Makoto Yamashita , Kazuhide Nakata

We develop an efficient method for solving non-convex constrained optimization problems that are pervasive in economics. The optimal solution to these problems often involves randomization. We employ a Lagrangian framework and prove that…

Theoretical Economics · Economics 2026-05-07 Chengfeng Shen , Felix Kübler , Yucheng Yang , Zhennan Zhou

This paper describes the implementation of a new interior point solver for linear programming for the open-source optimization library HiGHS. The solver uses a direct factorisation to solve the Newton systems, choosing the best approach…

Optimization and Control · Mathematics 2025-08-07 Filippo Zanetti , Jacek Gondzio

Second-order sufficient conditions for local optimality have been playing an important role in local convergence analysis of optimization algorithms. In this paper, we demonstrate that this condition alone suffices to justify the linear…

Optimization and Control · Mathematics 2021-05-04 Nguyen T. V. Hang , M. Ebrahim Sarabi