English
Related papers

Related papers: On the Exponential Stability of Primal-Dual Gradie…

200 papers

In this work, we approach the minimization of a continuously differentiable convex function under linear equality constraints by a second-order dynamical system with asymptotically vanishing damping term. The system is formulated in terms…

Optimization and Control · Mathematics 2021-06-24 Radu Ioan Bot , Dang-Khoa Nguyen

This paper studies a distributed algorithm for constrained consensus optimization that is obtained by fusing the Arrow-Hurwicz-Uzawa primal-dual gradient method for centralized constrained optimization and the Wang-Elia method for…

Optimization and Control · Mathematics 2025-03-11 Xiaoxing Ren , Michelangelo Bin , Ivano Notarnicola , Thomas Parisini

In this paper, we revisit primal-dual dynamics for convex optimization and present a generalization of the dynamics based on the concept of passivity. It is then proved that supplying a stable zero to one of the integrators in the dynamics…

Systems and Control · Computer Science 2018-11-26 Shunya Yamashita , Takeshi Hatanaka , Junya Yamauchi , Masayuki Fujita

This paper considers the analysis of continuous time gradient-based optimization algorithms through the lens of nonlinear contraction theory. It demonstrates that in the case of a time-invariant objective, most elementary results on…

Optimization and Control · Mathematics 2022-12-23 Patrick M. Wensing , Jean-Jacques E. Slotine

This paper is devoted to the study of an inertial accelerated primal-dual algorithm, which is based on a second-order differential system with time scaling, for solving a non-smooth convex optimization problem with linear equality…

Optimization and Control · Mathematics 2026-04-30 Huan Zhang , Xiangkai Sun , Shengjie Li , Kok Lay Teo

We study a class of optimization problems in which the objective function is given by the sum of a differentiable but possibly nonconvex component and a nondifferentiable convex regularization term. We introduce an auxiliary variable to…

Optimization and Control · Mathematics 2019-08-27 Neil K. Dhingra , Sei Zhen Khong , Mihailo R. Jovanović

We consider regression problems with binary weights. Such optimization problems are ubiquitous in quantized learning models and digital communication systems. A natural approach is to optimize the corresponding Lagrangian using variants of…

Machine Learning · Computer Science 2020-12-01 Nisan Chiprut , Amir Globerson , Ami Wiesel

The aim of this manuscript is to approach by means of first order differential equations/inclusions convex programming problems with two-block separable linear constraints and objectives, whereby (at least) one of the components of the…

Optimization and Control · Mathematics 2020-05-21 Sandy Bitterlich , Ernö Robert Csetnek , Gert Wanka

Using convex combination and linesearch techniques, we introduce a novel primal-dual algorithm for solving structured convex-concave saddle point problems with a generic smooth nonbilinear coupling term. Our adaptive linesearch strategy…

Optimization and Control · Mathematics 2024-01-17 Xiaokai Chang , Junfeng Yang , Hongchao Zhang

Trajectory optimization is an efficient approach for solving optimal control problems for complex robotic systems. It relies on two key components: first the transcription into a sparse nonlinear program, and second the corresponding solver…

Robotics · Computer Science 2022-10-31 Wilson Jallet , Antoine Bambade , Nicolas Mansard , Justin Carpentier

This work aims to minimize a continuously differentiable convex function with Lipschitz continuous gradient under linear equality constraints. The proposed inertial algorithm results from the discretization of the second-order primal-dual…

Optimization and Control · Mathematics 2022-08-03 Radu Ioan Bot , Ernö Robert Csetnek , Dang-Khoa Nguyen

This work investigates the distributed constrained optimization problem under inter-agent communication delays from the perspective of passivity. First, we propose a continuous-time algorithm for distributed constrained optimization with…

Optimization and Control · Mathematics 2022-05-02 Mengmou Li , Shunya Yamashita , Takeshi Hatanaka , Graziano Chesi

In this work, we show that for linearly constrained optimization problems the primal-dual hybrid gradient algorithm, analyzed by Chambolle and Pock [3], can be written as an entirely primal algorithm. This allows us to prove convergence of…

Optimization and Control · Mathematics 2019-05-27 Yura Malitsky

A transformed primal-dual (TPD) flow is developed for a class of nonlinear smooth saddle point system. The flow for the dual variable contains a Schur complement which is strongly convex. Exponential stability of the saddle point is…

Optimization and Control · Mathematics 2023-02-03 Long Chen , Jingrong Wei

This paper develops a continuous-time primal-dual accelerated method with an increasing damping coefficient for a class of convex optimization problems with affine equality constraints. This paper analyzes critical values for parameters in…

Optimization and Control · Mathematics 2022-02-16 Xianlin Zeng , Jinlong Lei , Jie Chen

In this paper we propose distributed dual gradient algorithms for linearly constrained separable convex problems and analyze their rate of convergence under different assumptions. Under the strong convexity assumption on the primal…

Optimization and Control · Mathematics 2014-02-04 Ion Necoara , Valentin Nedelcu

In this paper, we propose a class of general second-order primal-dual dynamical systems with Tikhonov regularization and Hessian-driven damping for solving convex-concave bilinear saddle point problems. The proposed dynamical system…

Optimization and Control · Mathematics 2026-05-13 Bohan Zhang , Xiaojun Zhang

This paper considers the distributed smooth optimization problem in which the objective is to minimize a global cost function formed by a sum of local smooth cost functions, by using local information exchange. The standard assumption for…

Optimization and Control · Mathematics 2019-09-10 Xinlei Yi , Shengjun Zhang , Tao Yang , Karl H. Johansson , Tianyou Chai

Randomly initialized first-order optimization algorithms are the method of choice for solving many high-dimensional nonconvex problems in machine learning, yet general theoretical guarantees cannot rule out convergence to critical points of…

Optimization and Control · Mathematics 2018-09-28 Dar Gilboa , Sam Buchanan , John Wright

In this paper, we study saddle point (SP) problems, focusing on convex-concave optimization involving functions that satisfy either two-sided quadratic functional growth (QFG) or two-sided quadratic gradient growth (QGG)--novel conditions…

Optimization and Control · Mathematics 2025-10-15 Cody Melcher , Afrooz Jalilzadeh , Erfan Yazdandoost Hamedani