English
Related papers

Related papers: A low-rank augmented Lagrangian method for large-s…

200 papers

In this paper we propose a splitting scheme which hybridizes generalized conditional gradient with a proximal step which we call CGALP algorithm, for minimizing the sum of three proper convex and lower-semicontinuous functions in real…

Optimization and Control · Mathematics 2022-10-20 Antonio Silveti-Falls , Cesare Molinari , Jalal Fadili

The 'exact subgraph' approach was recently introduced as a hierarchical scheme to get increasingly tight semidefinite programming relaxations of several NP-hard graph optimization problems. Solving these relaxations is a computational…

Optimization and Control · Mathematics 2019-08-09 Elisabeth Gaar , Franz Rendl

We propose an inexact proximal augmented Lagrangian method (P-ALM) for nonconvex structured optimization problems. The proposed method features an easily implementable rule not only for updating the penalty parameters, but also for…

Optimization and Control · Mathematics 2025-09-04 Adeyemi D. Adeoye , Puya Latafat , Alberto Bemporad

Motivated by big data applications, first-order methods have been extremely popular in recent years. However, naive gradient methods generally converge slowly. Hence, much efforts have been made to accelerate various first-order methods.…

Optimization and Control · Mathematics 2016-06-30 Yangyang Xu

This paper considers a generic convex minimization template with affine constraints over a compact domain, which covers key semidefinite programming applications. The existing conditional gradient methods either do not apply to our template…

Optimization and Control · Mathematics 2019-01-16 Alp Yurtsever , Olivier Fercoq , Volkan Cevher

Most recently, He and Yuan [arXiv:2108.08554, 2021] have proposed a balanced augmented Lagrangian method (ALM) for the canonical convex programming problem with linear constraints, which advances the original ALM by balancing its…

Optimization and Control · Mathematics 2021-12-30 Shengjie Xu

We propose a semi-proximal augmented Lagrangian based decomposition method for convex composite quadratic conic programming problems with primal block angular structures. Using our algorithmic framework, we are able to naturally derive…

Optimization and Control · Mathematics 2018-12-13 Xin-Yee Lam , Defeng Sun , Kim-Chuan Toh

In this paper we present complexity certification results for a distributed Augmented Lagrangian (AL) algorithm used to solve convex optimization problems involving globally coupled linear constraints. Our method relies on the Accelerated…

Optimization and Control · Mathematics 2018-01-16 Soomin Lee , Nikolaos Chatzipanagiotis , Michael M. Zavlanos

Efficient representations and solutions for large decision problems with continuous and discrete variables are among the most important challenges faced by the designers of automated decision support systems. In this paper, we describe a…

Artificial Intelligence · Computer Science 2011-10-04 C. Guestrin , M. Hauskrecht , B. Kveton

In this paper, we propose a dynamical low-rank (DLR) approximation framework for solving the semiclassical Schrodinger equation with uncertainties. The primary numerical challenges arise from the dual nature of the oscillations: the spatial…

Numerical Analysis · Mathematics 2026-02-23 Liu Liu , Limin Xu , Zhenyi Zhu

Hierarchical least-squares programming (HLSP) is an important tool in optimization as it enables the stacking of any number of priority levels in order to reflect complex constraint relationships, for example in physical systems like…

Optimization and Control · Mathematics 2025-06-16 Kai Pfeiffer

Doubly nonnegative (DNN) relaxation usually provides a tight lower bound for a mixed-binary quadratic program (MBQP). However, solving DNN problems is challenging because: (1) the problem size is $\Omega((n+l)^2)$ for an MBQP with $n$…

Optimization and Control · Mathematics 2025-07-21 Di Hou , Tianyun Tang , Kim-Chuan Toh

In this paper, we consider a class of convex programming problems with linear equality constraints, which finds broad applications in machine learning and signal processing. We propose a new adaptive balanced augmented Lagrangian (ABAL)…

Signal Processing · Electrical Eng. & Systems 2024-10-22 Jiageng Wu , Bo Jiang , Xinxin Li , Ya-Feng Liu , Jianhua Yuan

The mathematical framework of hybrid system is a recent and general tool to treat control systems involving control action of heterogeneous nature. In this paper, we construct and test a semi-Lagrangian numerical scheme for solving the…

Numerical Analysis · Mathematics 2016-08-03 Roberto Ferretti , Achille Sassi

This paper considers smooth convex optimization problems with many functional constraints. To solve this general class of problems we propose a new stochastic perturbed augmented Lagrangian method, called SGDPA, where a perturbation is…

Optimization and Control · Mathematics 2025-04-01 Nitesh Kumar Singh , Ion Necoara

The augmented Lagrangian (AL) method that solves convex optimization problems with linear constraints has drawn more attention recently in imaging applications due to its decomposable structure for composite cost functions and empirical…

Optimization and Control · Mathematics 2015-11-30 Hung Nien , Jeffrey A. Fessler

In real-world applications, it is important for machine learning algorithms to be robust against data outliers or corruptions. In this paper, we focus on improving the robustness of a large class of learning algorithms that are formulated…

Machine Learning · Computer Science 2021-06-04 Quanming Yao , Hangsi Yang , En-Liang Hu , James Kwok

In this paper, we present a majorized semismooth Newton-CG augmented Lagrangian method, called SDPNAL$+$, for semidefinite programming (SDP) with partial or full nonnegative constraints on the matrix variable. SDPNAL$+$ is a much enhanced…

Optimization and Control · Mathematics 2014-06-05 Liuqin Yang , Defeng Sun , Kim-Chuan Toh

The Burer-Monteiro factorization has become a powerful tool for solving large-scale semidefinite programs (SDPs), enabling recently developed low-rank solvers to tackle problems previously beyond reach. However, existing methods are…

Optimization and Control · Mathematics 2025-07-29 Daniel Brosch , Jan Schwiddessen , Angelika Wiegele

This work presents PANTR, an efficient solver for nonconvex constrained optimization problems, that is well-suited as an inner solver for an augmented Lagrangian method. The proposed scheme combines forward-backward iterations with…

Optimization and Control · Mathematics 2023-06-30 Alexander Bodard , Pieter Pas , Panagiotis Patrinos