English
Related papers

Related papers: Using a Factored Dual in Augmented Lagrangian Meth…

200 papers

We propose a high-order version of the augmented Lagrangian method for solving convex optimization problems with linear constraints, which achieves arbitrarily fast -- and even superlinear -- convergence rates. First, we analyze the…

Optimization and Control · Mathematics 2026-01-21 Young-Ju Lee , Jongho Park

We consider the computation of the entanglement-assisted quantum rate-distortion function, which plays a central role in quantum information theory. We propose an efficient alternating minimization algorithm based on the Lagrangian…

Information Theory · Computer Science 2025-07-29 Lingyi Chen , Deheng Yuan , Wenyi Zhang , Hao Wu , Huihui Wu

We associate with each convex optimization problem posed on some locally convex space with an infinite index set T, and a given non-empty family H formed by finite subsets of T, a suitable Lagrangian-Haar dual problem. We provide reverse…

Optimization and Control · Mathematics 2021-06-18 Nguyen Dinh , Miguel A. Goberna , Marco A. Lopez , Michel Volle

In this paper, we propose a distributed algorithm for solving large-scale separable convex problems using Lagrangian dual decomposition and the interior-point framework. By adding self-concordant barrier terms to the ordinary Lagrangian, we…

Optimization and Control · Mathematics 2013-02-14 I. Necoara , J. A. K. Suykens

In this paper we consider three minimization problems, namely quadratic, $\rho$-convex and quadratic fractional programing problems. The quadratic problem is considered with quadratic inequality constraints with bounded continuous and…

Optimization and Control · Mathematics 2018-04-09 B. Muraleetharan , S. Selvarajan , S. Srisatkunarajah , K. Thirulogasanthar

In this paper, we consider the linearly constrained composite convex optimization problem, whose objective is a sum of a smooth function and a possibly nonsmooth function. We propose an inexact augmented Lagrangian (IAL) framework for…

Optimization and Control · Mathematics 2018-03-30 Ya-Feng Liu , Xin Liu , Shiqian Ma

We study policy optimization for infinite-horizon, discounted constrained Markov decision processes (CMDPs). While existing theoretical guarantees typically hold for the mixture policy, deploying such a policy is computationally and memory…

Machine Learning · Computer Science 2026-05-13 Michael Lu , Max Qiushi Lin , Mo Chen , Sharan Vaswani

In this paper, we conduct a convergence rate analysis of the augmented Lagrangian method with a practical relative error criterion designed in Eckstein and Silva [Math. Program., 141, 319--348 (2013)] for convex nonlinear programming…

Optimization and Control · Mathematics 2019-10-16 Xin-Yuan Zhao , Liang Chen

This paper presents a canonical dual approach to the problem of minimizing the sum of a quadratic function and the ratio of nonconvex function and quadratic functions, which is a type of non-convex optimization problem subject to an…

Optimization and Control · Mathematics 2012-11-21 David Yang Gao , Ning Ruan

Recent work has shown how information theory extends conventional full-rationality game theory to allow bounded rational agents. The associated mathematical framework can be used to solve constrained optimization problems. This is done by…

Neural and Evolutionary Computing · Computer Science 2008-11-07 William Macready , David Wolpert

We study stochastic mixed integer programs with both first-stage and recourse decisions involving mixed integer variables. A new family of Lagrangian cuts, termed ``ReLU Lagrangian cuts," is introduced by reformulating the nonanticipativity…

Optimization and Control · Mathematics 2024-11-12 Haoyun Deng , Weijun Xie

We extend Robust Optimization to fractional programming, where both the objective and the constraints contain uncertain parameters. Earlier work did not consider uncertainty in both the objective and the constraints, or did not use Robust…

Optimization and Control · Mathematics 2015-08-21 Bram L. Gorissen

The primary goal of this paper is to provide an efficient solution algorithm based on the augmented Lagrangian framework for optimization problems with a stochastic objective function and deterministic constraints. Our main contribution is…

Optimization and Control · Mathematics 2023-12-29 Raghu Bollapragada , Cem Karamanli , Brendan Keith , Boyan Lazarov , Socratis Petrides , Jingyi Wang

We propose an algorithm for solving nonlinear convex programs defined in terms of a symmetric positive semidefinite matrix variable $X$. This algorithm rests on the factorization $X=Y Y^T$, where the number of columns of Y fixes the rank of…

Optimization and Control · Mathematics 2010-08-25 M. Journée , F. Bach , P. -A. Absil , R. Sepulchre

A standard quadratic program is an optimization problem that consists of minimizing a (nonconvex) quadratic form over the unit simplex. We focus on reformulating a standard quadratic program as a mixed integer linear programming problem. We…

Optimization and Control · Mathematics 2018-10-05 Jacek Gondzio , E. Alper Yildirim

Matrix Factorization has emerged as a widely adopted framework for modeling data exhibiting low-rank structures. To address challenges in manifold learning, this paper presents a subspace-constrained quadratic matrix factorization model.…

Machine Learning · Computer Science 2024-11-08 Zheng Zhai , Xiaohui Li

This paper proposes and analyzes an accelerated inexact dampened augmented Lagrangian (AIDAL) method for solving linearly-constrained nonconvex composite optimization problems. Each iteration of the AIDAL method consists of: (i) inexactly…

Optimization and Control · Mathematics 2023-02-08 Weiwei Kong , Renato D. C. Monteiro

In this paper, we aim to solve high dimensional convex quadratic programming (QP) problems with a large number of quadratic terms, linear equality and inequality constraints. In order to solve the targeted {\bf QP} problems to a desired…

Optimization and Control · Mathematics 2022-01-31 Ling Liang , Xudong Li , Defeng Sun , Kim-Chuan Toh

This paper provides the first meaningful documentation and analysis of an established technique which aims to obtain an approximate solution to linear programming problems prior to applying the primal simplex method. The underlying…

Optimization and Control · Mathematics 2018-04-25 I. L. Galabova , J. A. J. Hall

Lagrangian relaxation is a versatile mathematical technique employed to relax constraints in an optimization problem, enabling the generation of dual bounds to prove the optimality of feasible solutions and the design of efficient…

Artificial Intelligence · Computer Science 2023-12-25 Augustin Parjadis , Quentin Cappart , Bistra Dilkina , Aaron Ferber , Louis-Martin Rousseau