English
Related papers

Related papers: Complexity Certification of a Distributed Augmente…

200 papers

We analyze the convergence behaviour of a recently proposed algorithm for regularized estimation called Dual Augmented Lagrangian (DAL). Our analysis is based on a new interpretation of DAL as a proximal minimization algorithm. We…

Machine Learning · Statistics 2011-06-07 Ryota Tomioka , Taiji Suzuki , Masashi Sugiyama

The augmented Lagrangian method (ALM) is one of the most useful methods for constrained optimization. Its convergence has been well established under convexity assumptions or smoothness assumptions, or under both assumptions. ALM may…

Optimization and Control · Mathematics 2021-12-10 Jinshan Zeng , Wotao Yin , Ding-Xuan Zhou

This paper studies distributed convex optimization with both affine equality and nonlinear inequality couplings through the duality analysis. We first formulate the dual of the coupling-constraint problem and reformulate it as a consensus…

Optimization and Control · Mathematics 2025-12-05 Chenyang Qiu , Yangyang Qian , Zongli Lin , Yacov A. Shamash

We propose a new splitting and successively solving augmented Lagrangian (SSAL) method for solving an optimization problem with both semicontinuous variables and a cardinality constraint. This optimization problem arises in several contexts…

Optimization and Control · Mathematics 2015-06-16 Yanqin Bai , Renli Liang , Zhouwang Yang

We propose a distributed solution for a constrained convex optimization problem over a network of clustered agents each consisted of a set of subagents. The communication range of the clustered agents is such that they can form a connected…

Multiagent Systems · Computer Science 2021-04-06 Hossein Moradian , Solmaz S. Kia

In this paper, we consider the linearly constrained composite convex optimization problem, whose objective is a sum of a smooth function and a possibly nonsmooth function. We propose an inexact augmented Lagrangian (IAL) framework for…

Optimization and Control · Mathematics 2018-03-30 Ya-Feng Liu , Xin Liu , Shiqian Ma

This paper addresses a class of general nonsmooth and nonconvex composite optimization problems subject to nonlinear equality constraints. We assume that a part of the objective function and the functional constraints exhibit local…

Optimization and Control · Mathematics 2025-03-04 Lahcen El Bourkhissi , Ion Necoara , Panagiotis Patrinos , Quoc Tran-Dinh

This paper establishes the iteration-complexity of an inner accelerated inexact proximal augmented Lagrangian (IAIPAL) method for solving linearly-constrained smooth nonconvex composite optimization problems that is based on the classical…

Optimization and Control · Mathematics 2022-06-15 Jefferson G. Melo , Renato D. C. Monteiro , Weiwei Kong

We present a numerical method for the minimization of constrained optimization problems where the objective is augmented with large quadratic penalties of inconsistent equality constraints. Such objectives arise from quadratic integral…

Optimization and Control · Mathematics 2021-08-16 Martin Neuenhofen , Eric Kerrigan

In this paper, we propose an inexact Augmented Lagrangian Method (ALM) for the optimization of convex and nonsmooth objective functions subject to linear equality constraints and box constraints where errors are due to fixed-point data. To…

Optimization and Control · Mathematics 2019-07-23 Yan Zhang , Michael M. Zavlanos

This paper is devoted to the theoretical and numerical investigation of an augmented Lagrangian method for the solution of optimization problems with geometric constraints. Specifically, we study situations where parts of the constraints…

Optimization and Control · Mathematics 2022-04-20 Xiaoxi Jia , Christian Kanzow , Patrick Mehlitz , Gerd Wachsmuth

We propose a distributed first-order augmented Lagrangian (DFAL) algorithm to minimize the sum of composite convex functions, where each term in the sum is a private cost function belonging to a node, and only nodes connected by an edge can…

Optimization and Control · Mathematics 2015-05-12 Necdet Serhat Aybat , Garud Iyengar , Zi Wang

In this paper we consider a class of structured nonsmooth difference-of-convex (DC) constrained DC program in which the first convex component of the objective and constraints is the sum of a smooth and nonsmooth functions while their…

Optimization and Control · Mathematics 2021-11-18 Zhaosong Lu , Zhe Sun , Zirui Zhou

Algencan is a well established safeguarded Augmented Lagrangian algorithm introduced in [R. Andreani, E. G. Birgin, J. M. Mart\'{\i}nez and M. L. Schuverdt, On Augmented Lagrangian methods with general lower-level constraints, SIAM Journal…

Optimization and Control · Mathematics 2020-12-18 E. G. Birgin , J. M. Martínez

We investigate a distributed optimization problem over a cooperative multi-agent time-varying network, where each agent has its own decision variables that should be set so as to minimize its individual objective subject to local…

Optimization and Control · Mathematics 2018-05-24 Chuanye Gu , Zhiyou Wu , Jueyou Li

In this paper, we consider a class of convex programming problems with linear equality constraints, which finds broad applications in machine learning and signal processing. We propose a new adaptive balanced augmented Lagrangian (ABAL)…

Signal Processing · Electrical Eng. & Systems 2024-10-22 Jiageng Wu , Bo Jiang , Xinxin Li , Ya-Feng Liu , Jianhua Yuan

In this paper we study the worst-case complexity of an inexact Augmented Lagrangian method for nonconvex constrained problems. Assuming that the penalty parameters are bounded, we prove a complexity bound of $\mathcal{O}(|\log(\epsilon)|)$…

Optimization and Control · Mathematics 2021-05-25 Geovani N. Grapiglia , Ya-xiang Yuan

We consider the problem of minimizing the sum of a Lipschitz differentiable convex function $f$ and a proper closed convex function $h$ that admits efficient linear minimization oracles, subject to multiple smooth convex inequality…

Optimization and Control · Mathematics 2026-05-22 Xiaozhou Wang , Ting Kei Pong , Zev Woodstock

A stochastic linear quadratic (LQ) optimal control problem with a pointwise linear equality constraint on the terminal state is considered. A strong Lagrangian duality theorem is proved under a uniform convexity condition on the cost…

Optimization and Control · Mathematics 2023-01-23 Haisen Zhang , Xianfeng Zhang

In this paper, we consider a nonconvex optimization problem with nonlinear equality constraints. We assume that both, the objective function and the functional constraints are locally smooth. For solving this problem, we propose a…

Optimization and Control · Mathematics 2025-05-08 Lahcen El Bourkhissi , Ion Necoara