English
Related papers

Related papers: Accelerated Gradient Methods via Inertial Systems …

200 papers

We study the convergence rate of a family of inertial algorithms, which can be obtained by discretization of an inertial system combining asymptotic vanishing viscous and Hessian-driven damping. We establish a fast sublinear convergence…

Optimization and Control · Mathematics 2025-07-18 Zepeng Wang , Juan Peypouquet

This paper is devoted to the investigation of inertial dynamical systems with implicit Hessian-driven damping for strongly quasiconvex optimization which is a specific class of nonconvex optimization problems. We first establish exponential…

Optimization and Control · Mathematics 2026-02-27 Zeying Gao , Xiangkai Sun , Liang He

In this paper we propose new numerical algorithms in the setting of unconstrained optimization problems and we study the rate of convergence in the iterates of the objective function. Furthermore, our algorithms are based upon splitting and…

Optimization and Control · Mathematics 2020-02-11 Cristian Daniel Alecsa

We investigate an inertial algorithm of gradient type in connection with the minimization of a nonconvex differentiable function. The algorithm is formulated in the spirit of Nesterov's accelerated convex gradient method. We show that the…

Functional Analysis · Mathematics 2018-11-26 Szilárd Csaba László

In a Hilbert space setting, for convex optimization, we analyze the convergence rate of a class of first-order algorithms involving inertial features. They can be interpreted as discrete time versions of inertial dynamics involving both…

Optimization and Control · Mathematics 2020-11-09 Hedy Attouch , Zaki Chbani , Jalal Fadili , Hassan Riahi

We investigate an inertial algorithm of gradient type in connection with the minimization of a nonconvex differentiable function. The algorithm is formulated in the spirit of Nesterov's accelerated convex gradient method. We prove some…

Functional Analysis · Mathematics 2020-02-11 Szilárd Csaba László

In this work, we investigate a second-order dynamical system with Hessian-driven damping tailored for a class of nonconvex functions called strongly quasiconvex. Buil\-ding upon this continuous-time model, we derive two discrete-time…

Optimization and Control · Mathematics 2025-06-19 N. Hadjisavvas , F. Lara , R. T. Marcavillaca , P. T. Vuong

This paper deals with a Tikhonov regularized second-order inertial dynamical system that incorporates time scaling, asymptotically vanishing damping and Hessian-driven damping for solving convex optimization problems. Under appropriate…

Optimization and Control · Mathematics 2026-04-30 Xiangkai Sun , Guoxiang Tian , Huan Zhang

In this article a family of second order ODEs associated to inertial gradient descend is studied. These ODEs are widely used to build trajectories converging to a minimizer $x^*$ of a function $F$, possibly convex. This family includes the…

Optimization and Control · Mathematics 2019-07-08 Othmane Sebbouh , Charles Dossal , Aude Rondepierre

In a Hilbert setting, we develop fast methods for convex unconstrained optimization. We rely on the asymptotic behavior of an inertial system combining geometric damping with temporal scaling. The convex function to minimize enters the…

Optimization and Control · Mathematics 2020-09-17 Hedy Attouch , Aicha Balhag , Zaki Chbani , Hassan Riahi

In this paper we deal with a general second order continuous dynamical system associated to a convex minimization problem with a Fr\`echet differentiable objective function. We show that inertial algorithms, such as Nesterov's algorithm,…

Optimization and Control · Mathematics 2019-08-08 Cristian Daniel Alecsa , Szilárd Csaba László , Titus Pinţa

In this paper, we study a speed restart scheme for an inertial system with Hessian-driven damping. We establish a linear convergence rate for the function values along the restarted trajectories without assuming the strong convexity of the…

Optimization and Control · Mathematics 2024-12-10 Huiyuan Guo , Juan José Maulén , Juan Peypouquet

In a Hilbert space setting, for convex optimization, we show the convergence of the iterates to optimal solutions for a class of accelerated first-order algorithms. They can be interpreted as discrete temporal versions of an inertial…

Optimization and Control · Mathematics 2021-07-14 Hedy Attouch , Zaki Chbani , Jalal Fadili , Hassan Riahi

By time discretization of a second-order primal-dual dynamical system with damping $\alpha/t$ where an inertial construction in the sense of Nesterov is needed only for the primal variable, we propose a fast primal-dual algorithm for a…

Optimization and Control · Mathematics 2022-06-06 Xin He , Rong Hu , Ya-Ping Fang

In order to solve the minimization of a nonsmooth convex function, we design an inertial second-order dynamic algorithm, which is obtained by approximating the nonsmooth function by a class of smooth functions. By studying the asymptotic…

Optimization and Control · Mathematics 2021-12-20 Xin Qu , Wei Bian

This work aims to minimize a continuously differentiable convex function with Lipschitz continuous gradient under linear equality constraints. The proposed inertial algorithm results from the discretization of the second-order primal-dual…

Optimization and Control · Mathematics 2022-08-03 Radu Ioan Bot , Ernö Robert Csetnek , Dang-Khoa Nguyen

We formulate two classes of first-order algorithms more general than previously studied for minimizing smooth and strongly convex or, respectively, smooth and convex functions. We establish sufficient conditions, via new discrete Lyapunov…

Optimization and Control · Mathematics 2023-04-21 Penghui Fu , Zhiqiang Tan

We derive efficient algorithms to compute weakly Pareto optimal solutions for smooth, convex and unconstrained multiobjective optimization problems in general Hilbert spaces. To this end, we define a novel inertial gradient-like dynamical…

Optimization and Control · Mathematics 2022-07-27 Konstantin Sonntag , Sebastian Peitz

In a real Hilbert space setting, we study the convergence properties of an inexact gradient algorithm featuring both viscous and Hessian driven damping for convex differentiable optimization. In this algorithm, the gradient evaluation can…

Optimization and Control · Mathematics 2025-09-25 Harsh Choudhary , Jalal Fadili , Vyachelav Kungurtsev

We present a coupled system of ODEs which, when discretized with a constant time step/learning rate, recovers Nesterov's accelerated gradient descent algorithm. The same ODEs, when discretized with a decreasing learning rate, leads to novel…

Optimization and Control · Mathematics 2020-09-02 Maxime Laborde , Adam M. Oberman
‹ Prev 1 2 3 10 Next ›