English
Related papers

Related papers: Augmented Lagrangian methods for convex optimizati…

200 papers

In this paper, we aim at unifying, simplifying and improving the convergence rate analysis of Lagrangian-based methods for convex optimization problems. We first introduce the notion of nice primal algorithmic map, which plays a central…

Optimization and Control · Mathematics 2023-06-07 Shoham Sabach , Marc Teboulle

In this paper, we propose a Robbins-Monro augmented Lagrangian method (RMALM) to solve a class of constrained stochastic convex optimization, which can be regarded as a hybrid of the Robbins-Monro type stochastic approximation method and…

Optimization and Control · Mathematics 2022-09-02 Rui Wang , Chao Ding

We develop an efficient method for solving non-convex constrained optimization problems that are pervasive in economics. The optimal solution to these problems often involves randomization. We employ a Lagrangian framework and prove that…

Theoretical Economics · Economics 2026-05-07 Chengfeng Shen , Felix Kübler , Yucheng Yang , Zhennan Zhou

Hybrid dynamical systems pose significant challenges for effective planning and control, especially when additional constraints such as obstacle avoidance, state boundaries, and actuation limits are present. In this letter, we extend the…

Systems and Control · Electrical Eng. & Systems 2025-10-24 Pietro Noah Crestaz , Gokhan Alcan , Ville Kyrki

In this paper, we revisit the augmented Lagrangian method for a class of nonsmooth convex optimization. We present the Lagrange optimality system of the augmented Lagrangian associated with the problems, and establish its connections with…

Optimization and Control · Mathematics 2020-01-14 Bangti Jin , Tomoya Takeuchi

This paper aims to develop distributed algorithms for nonconvex optimization problems with complicated constraints associated with a network. The network can be a physical one, such as an electric power network, where the constraints are…

Optimization and Control · Mathematics 2022-11-21 Kaizhao Sun , X. Andy Sun

We develop a decomposition method based on the augmented Lagrangian framework to solve a broad family of semidefinite programming problems, possibly with nonlinear objective functions, nonsmooth regularization, and general linear…

Optimization and Control · Mathematics 2023-03-08 Yifei Wang , Kangkang Deng , Haoyang Liu , Zaiwen Wen

Integer programming with block structures has received considerable attention recently and is widely used in many practical applications such as train timetabling and vehicle routing problems. It is known to be NP-hard due to the presence…

Optimization and Control · Mathematics 2024-07-01 Rui Wang , Chuwen Zhang , Shanwen Pu , Jianjun Gao , Zaiwen Wen

Inactive constraints do not contribute to the solution of an optimal control problem, but increase the problem size and burden the numerical computations. We present a novel strategy for handling inactive constraints efficiently by…

Systems and Control · Electrical Eng. & Systems 2021-12-16 Yuanbo Nie , Eric C. Kerrigan

In this paper we present complexity certification results for a distributed Augmented Lagrangian (AL) algorithm used to solve convex optimization problems involving globally coupled linear constraints. Our method relies on the Accelerated…

Optimization and Control · Mathematics 2018-01-16 Soomin Lee , Nikolaos Chatzipanagiotis , Michael M. Zavlanos

Recent advancements in data science have significantly elevated the importance of orthogonally constrained optimization problems. The Riemannian approach has become a popular technique for addressing these problems due to the advantageous…

Optimization and Control · Mathematics 2026-04-07 Linglingzhi Zhu , Wentao Ding , Shangyuan Liu , Anthony Man-Cho So

We analyze worst-case complexity of a Proximal augmented Lagrangian (Proximal AL) framework for nonconvex optimization with nonlinear equality constraints. When an approximate first-order (second-order) optimal point is obtained in the…

Optimization and Control · Mathematics 2020-09-03 Yue Xie , Stephen J. Wright

This paper addresses synthesizing receding-horizon controllers for nonlinear, control-affine dynamical systems under multiple incompatible hard and soft constraints. Handling incompatibility of constraints has mostly been addressed in…

Robotics · Computer Science 2023-10-17 Hardik Parwana , Ruiyang Wang , Dimitra Panagou

We consider minimization of the sum of a large number of convex functions, and we propose an incremental aggregated version of the proximal algorithm, which bears similarity to the incremental aggregated gradient and subgradient methods…

Systems and Control · Computer Science 2015-11-05 Dimitri P. Bertsekas

A proximal safeguarded augmented Lagrangian method for minimizing the difference of convex (DC) functions over a nonempty, closed and convex set with additional linear equality as well as convex inequality constraints is presented. Thereby,…

Optimization and Control · Mathematics 2026-04-01 Christian Kanzow , Tanja Neder

In this work, we consider optimal control problems for mechanical systems on vector spaces with fixed initial and free final state and a quadratic Lagrange term. Specifically, the dynamics is described by a second order ODE containing an…

We propose an inexact proximal augmented Lagrangian method (P-ALM) for nonconvex structured optimization problems. The proposed method features an easily implementable rule not only for updating the penalty parameters, but also for…

Optimization and Control · Mathematics 2025-09-04 Adeyemi D. Adeoye , Puya Latafat , Alberto Bemporad

Within the framework of the augmented Lagrangian (AL), we propose a novel distributed optimization method, termed Distributed Augmented Lagrangian Decomposition (DALD), and provide a rigorous convergence proof for its standard version. To…

Optimization and Control · Mathematics 2025-10-07 Wenyou Guo , Ting Qu , Hainan Huang , Yafeng Wei

We study policy optimization for infinite-horizon, discounted constrained Markov decision processes (CMDPs). While existing theoretical guarantees typically hold for the mixture policy, deploying such a policy is computationally and memory…

Machine Learning · Computer Science 2026-05-13 Michael Lu , Max Qiushi Lin , Mo Chen , Sharan Vaswani

We examine a multi-stage stochastic optimization problem characterized by stagewise-independent, decision-dependent noises with strict constraints. The problem assumes convexity in that, following a specific relaxation, it transforms into a…

Optimization and Control · Mathematics 2023-08-28 Chen Yan , Alexandre Reiffers-Masson