English
Related papers

Related papers: A universal accelerated primal-dual method for con…

200 papers

We propose an unconstrained optimization method based on the well-known primal-dual hybrid gradient (PDHG) algorithm. We first formulate the optimality condition of the unconstrained optimization problem as a saddle point problem. We then…

Optimization and Control · Mathematics 2024-08-29 X. Zuo , S. Osher , W. Li

The forward-backward operator splitting algorithm is one of the most important methods for solving the optimization problem of the sum of two convex functions, where one is differentiable with a Lipschitz continuous gradient and the other…

Optimization and Control · Mathematics 2019-08-30 Yu-Chao Tang , Guo-Rong Wu , Chuan-Xi Zhu

Motivated by an inertial primal-dual dynamical system with vanishing damping, we propose a class of accelerated augmented Lagrangian methods with Nesterov extrapolation parameters for a linearly constrained convex optimization problem with…

Optimization and Control · Mathematics 2026-05-28 Xin He , Nan-Jing Huang , Yi-Bin Xiao , Ya-Ping Fang

This paper studies the continuous-time dynamics of primal-dual algorithms for linearly constrained convex optimization problems and provides a quantitative convergence analysis using the Lyapunov functions. With the growing prevalence of…

Optimization and Control · Mathematics 2026-05-26 Chise Ishii , Yasushi Narushima

In this paper we propose a distributed dual gradient algorithm for minimizing linearly constrained separable convex problems and analyze its rate of convergence. In particular, we prove that under the assumption of strong convexity and…

Optimization and Control · Mathematics 2014-10-01 Ion Necoara , Valentin Nedelcu

First-order methods for solving convex optimization problems have been at the forefront of mathematical optimization in the last 20 years. The rapid development of this important class of algorithms is motivated by the success stories…

Optimization and Control · Mathematics 2021-01-07 Pavel Dvurechensky , Mathias Staudigl , Shimrit Shtern

This work aims to minimize a continuously differentiable convex function with Lipschitz continuous gradient under linear equality constraints. The proposed inertial algorithm results from the discretization of the second-order primal-dual…

Optimization and Control · Mathematics 2022-08-03 Radu Ioan Bot , Ernö Robert Csetnek , Dang-Khoa Nguyen

We propose a new first-order method for minimizing nonconvex functions with Lipschitz continuous gradients and H\"older continuous Hessians. The proposed algorithm is a heavy-ball method equipped with two particular restart mechanisms. It…

Optimization and Control · Mathematics 2026-01-05 Naoki Marumo , Akiko Takeda

This paper derives a discrete dual problem for a prototypical hybrid high-order method for convex minimization problems. The discrete primal and dual problem satisfy a weak convex duality that leads to a priori error estimates with…

Numerical Analysis · Mathematics 2026-04-10 Ngoc Tien Tran

This paper deals with two kinds of the one-dimensional global optimization problems over a closed finite interval: (i) the objective function $f(x)$ satisfies the Lipschitz condition with a constant $L$; (ii) the first derivative of $f(x)$…

Optimization and Control · Mathematics 2013-07-15 Daniela Lera , Yaroslav D. Sergeyev

In this paper, we provide the universal first-order methods of Composite Optimization with new complexity analysis. It delivers some universal convergence guarantees, which are not linked directly to any parametric problem class. However,…

Optimization and Control · Mathematics 2025-09-26 Yurii Nesterov

This paper deals with a new Tikhonov regularized primal-dual dynamical system with variable mass and Hessian-driven damping for solving a convex optimization problem with linear equality constraints. The system features several…

Optimization and Control · Mathematics 2026-04-01 Xiangkai Sun , Feng Guo , Liang He , Xiaole Guo

In this paper, we propose a distributed first-order algorithm with backtracking linesearch for solving multi-agent minimisation problems, where each agent handles a local objective involving nonsmooth and smooth components. Unlike existing…

Optimization and Control · Mathematics 2025-05-14 Felipe Atenas , Minh N. Dao , Matthew K. Tam

This paper addresses a class of nonsmooth and nonconvex optimization problems defined on complete Riemannian manifolds. The objective function has a composite structure, combining convex, differentiable, and lower semicontinuous terms,…

Optimization and Control · Mathematics 2025-11-19 Vitaliano S. Amaral , Marcio Antônio de A. Bortoloti , Jurandir O. Lopes , Gilson N. Silva

By exploiting double-penalty terms for the primal subproblem, we develop a novel relaxed augmented Lagrangian method for solving a family of convex optimization problems subject to equality or inequality constraints. The method is then…

Numerical Analysis · Mathematics 2025-06-16 Jianchao Bai , Linyuan Jia , Zheng Peng

In this paper we provide a detailed analysis of the iteration complexity of dual first order methods for solving conic convex problems. When it is difficult to project on the primal feasible set described by convex constraints, we use the…

Optimization and Control · Mathematics 2015-03-16 Ion Necoara , Andrei Patrascu

This paper is devoted to the study of an inertial accelerated primal-dual algorithm, which is based on a second-order differential system with time scaling, for solving a non-smooth convex optimization problem with linear equality…

Optimization and Control · Mathematics 2026-04-30 Huan Zhang , Xiangkai Sun , Shengjie Li , Kok Lay Teo

We develop a first-order accelerated algorithm for a class of constrained bilinear saddle-point problems with applications to network systems. The algorithm is a modified time-varying primal-dual version of an accelerated mirror-descent…

Optimization and Control · Mathematics 2024-10-04 Weijian Li , Xianlin Zeng , Lacra Pavel

Entropy regularized Markov decision processes have been widely used in reinforcement learning. This paper is concerned with the primal-dual formulation of the entropy regularized problems. Standard first-order methods suffer from slow…

Optimization and Control · Mathematics 2023-06-13 Haoya Li , Hsiang-fu Yu , Lexing Ying , Inderjit Dhillon

In this paper we present a new method for solving optimization problems involving the sum of two proper, convex, lower semicontinuous functions, one of which has Lipschitz continuous gradient. The proposed method has a hybrid nature that…

Optimization and Control · Mathematics 2022-11-03 Kristian Bredies , Enis Chenchene , Alireza Hosseini