English
Related papers

Related papers: An Inexact Deflected Subgradient Algorithm in Infi…

200 papers

In this paper we consider a class of structured nonsmooth difference-of-convex (DC) constrained DC program in which the first convex component of the objective and constraints is the sum of a smooth and nonsmooth functions while their…

Optimization and Control · Mathematics 2021-11-18 Zhaosong Lu , Zhe Sun , Zirui Zhou

We introduce a novel approach addressing global analysis of a difficult class of nonconvex-nonsmooth optimization problems within the important framework of Lagrangian-based methods. This genuine nonlinear class captures many problems in…

Optimization and Control · Mathematics 2018-01-10 Jérôme Bolte , Shoham Sabach , Marc Teboulle

We show that the primal-dual gradient method, also known as the gradient descent ascent method, for solving convex-concave minimax problems can be viewed as an inexact gradient method applied to the primal problem. The gradient, whose exact…

Optimization and Control · Mathematics 2020-07-03 Shuo Han

A sparse linear programming (SLP) problem is a linear programming problem equipped with a sparsity (or cardinality) constraint, which is nonconvex and discontinuous theoretically and generally NP-hard computationally due to the…

Optimization and Control · Mathematics 2018-06-05 Chen Zhao , Ziyan Luo , Weiyue Li , Houduo Qi , Naihua Xiu

In this chapter we derive computational complexity certifications of first order inexact dual methods for solving general smooth constrained convex problems which can arise in real-time applications, such as model predictive control. When…

Optimization and Control · Mathematics 2015-06-18 Ion Necoara , Andrei Patrascu , Angelia Nedić

A novel augmented Lagrangian method for solving non-convex programs with nonlinear cost and constraint couplings in a distributed framework is presented. The proposed decomposition algorithm is made of two layers: The outer level is a…

Optimization and Control · Mathematics 2014-07-22 Jean-Hubert Hours , Colin N. Jones

This work investigates the convergence behavior of augmented Lagrangian methods (ALMs) when applied to convex optimization problems that may be infeasible. ALMs are a popular class of algorithms for solving constrained optimization…

Optimization and Control · Mathematics 2026-03-17 Roland Andrews , Justin Carpentier , Adrien Taylor

This paper addresses non-convex constrained optimization problems that are characterized by a scalar complicating constraint. We propose an iterative bisection method for the dual problem (DualBi Algorithm) that recovers a feasible primal…

Optimization and Control · Mathematics 2024-10-07 Lucrezia Manieri , Alessandro Falsone , Maria Prandini

We propose an efficient algorithm for sparse signal reconstruction problems. The proposed algorithm is an augmented Lagrangian method based on the dual sparse reconstruction problem. It is efficient when the number of unknown variables is…

Machine Learning · Statistics 2010-10-06 Ryota Tomioka , Masashi Sugiyama

Dual decomposition is a powerful technique for deriving decomposition schemes for convex optimization problems with separable structure. Although the Augmented Lagrangian is computationally more stable than the ordinary Lagrangian, the…

Optimization and Control · Mathematics 2013-02-14 Ion Necoara , Johan A. K. Suykens

In this paper we present a complete iteration complexity analysis of inexact first order Lagrangian and penalty methods for solving cone constrained convex problems that have or may not have optimal Lagrange multipliers that close the…

Optimization and Control · Mathematics 2017-03-24 Ion Necoara , Andrei Patrascu , Francois Glineur

In this paper we explore the role of duality principles within the problem of rotation averaging, a fundamental task in a wide range of computer vision applications. In its conventional form, rotation averaging is stated as a minimization…

Computer Vision and Pattern Recognition · Computer Science 2017-11-30 Anders Eriksson , Carl Olsson , Fredrik Kahl , Tat-Jun Chin

We consider composite linear inverse problems where the signal to recover is modeled as a sum of two functions. We study a variational framework formulated as an optimization problem over the pairs of components using two regularization…

Optimization and Control · Mathematics 2026-05-25 Adrian Jarret , Julien Fageot

Local convergence analysis of the augmented Lagrangian method (ALM) is established for a large class of composite optimization problems with nonunique Lagrange multipliers under a second-order sufficient condition. We present a new…

Optimization and Control · Mathematics 2023-10-23 Nguyen T. V. Hang , Ebrahim Sarabi

In this paper, we focus on nonlinear infinite-norm minimization problems that have many applications, especially in computer science and operations research. We set a reliable Lagrangian dual aproach for solving this kind of problems in…

Computational Complexity · Computer Science 2011-06-07 Wajeb Gharibi , Yong Xia

Augmented Lagrangian Methods (ALMs) are widely employed in solving constrained optimizations, and some efficient solvers are developed based on this framework. Under the quadratic growth assumption, it is known that the dual iterates and…

Optimization and Control · Mathematics 2024-10-31 Feng-Yi Liao , Lijun Ding , Yang Zheng

A wide range of applications arising in machine learning and signal processing can be cast as convex optimization problems. These problems are often ill-posed, i.e., the optimal solution lacks a desired property such as uniqueness or…

Optimization and Control · Mathematics 2019-07-18 Mostafa Amini , Farzad Yousefian

There are many important practical optimization problems whose feasible regions are not known to be nonempty or not, and optimizers of the objective function with the least constraint violation prefer to be found. A natural way for dealing…

Optimization and Control · Mathematics 2021-11-12 Yu-Hong Dai , Liwei Zhang

We propose a high-order version of the augmented Lagrangian method for solving convex optimization problems with linear constraints, which achieves arbitrarily fast -- and even superlinear -- convergence rates. First, we analyze the…

Optimization and Control · Mathematics 2026-01-21 Young-Ju Lee , Jongho Park

We consider a primal-dual algorithm for minimizing $f(x)+h\square l(Ax)$ with Fr\'echet differentiable $f$ and $l^*$. This primal-dual algorithm has two names in literature: Primal-Dual Fixed-Point algorithm based on the Proximity Operator…

Optimization and Control · Mathematics 2021-02-02 Zhi Li , Ming Yan