English
Related papers

Related papers: Fast inertial dynamics and FISTA algorithms in con…

200 papers

In a Hilbert space setting H, for convex optimization, we analyze the fast convergence properties as t tends to infinity of the trajectories generated by a third-order in time evolution system. The function f to minimize is supposed to be…

Optimization and Control · Mathematics 2020-07-08 Hedy Attouch , Zaki Chbani , Hassan Riahi

In a Hilbert space setting, for convex optimization, we show the convergence of the iterates to optimal solutions for a class of accelerated first-order algorithms. They can be interpreted as discrete temporal versions of an inertial…

Optimization and Control · Mathematics 2021-07-14 Hedy Attouch , Zaki Chbani , Jalal Fadili , Hassan Riahi

A Tikhonov regularized inertial primal\mbox{-}dual dynamical system with time scaling and vanishing damping is proposed for solving a linearly constrained convex optimization problem in Hilbert spaces. The system under consideration…

Optimization and Control · Mathematics 2024-04-24 Ting-Ting Zhu , Rong Hu , Ya-Ping Fang

In this paper, we introduce, in a Hilbert space setting, a second order dynamical system with asymptotically vanishing damping and vanishing Tikhonov regularization that approaches a multiobjective optimization problem with convex and…

Optimization and Control · Mathematics 2025-06-30 Radu Ioan Bot , Konstantin Sonntag

In a Hilbert setting, for convex differentiable optimization, we develop a general framework for adaptive accelerated gradient methods. They are based on damped inertial dynamics where the coefficients are designed in a closed-loop way.…

Optimization and Control · Mathematics 2025-01-28 Hedy Attouch , Radu Ioan Bot , Dang-Khoa Nguyen

We introduce and investigate the asymptotic behaviour of the trajectories of a second order dynamical system with Tikhonov regularization for solving a monotone equation with single valued, monotone and continuous operator acting on a real…

Optimization and Control · Mathematics 2024-11-27 Ernö Robert Csetnek , Szilárd Csaba László

Our work is part of the close link between continuous-time dissipative dynamical systems and optimization algorithms, and more precisely here, in the stochastic setting. We aim to study stochastic convex minimization problems through the…

Optimization and Control · Mathematics 2025-02-21 Rodrigo Maulen-Soto , Jalal Fadili , Hedy Attouch , Peter Ochs

Second-order continuous-time dissipative dynamical systems with viscous and Hessian driven damping have inspired effective first-order algorithms for solving convex optimization problems. While preserving the fast convergence properties of…

Optimization and Control · Mathematics 2022-03-18 Hedy Attouch , Jalal Fadili , Vyacheslav Kungurtsev

In this paper, we analyze a speed restarting scheme for the dynamical system given by $$ \ddot{x}(t) + \dfrac{\alpha}{t}\dot{x}(t) + \nabla \phi(x(t)) + \beta \nabla^2 \phi(x(t))\dot{x}(t)=0, $$ where $\alpha$ and $\beta$ are positive…

Optimization and Control · Mathematics 2023-01-31 Juan Jose Maulen , Juan Peypouquet

In this paper we carry out an asymptotic analysis of the proximal-gradient dynamical system \begin{equation*}\left\{ \begin{array}{ll} \dot x(t) +x(t) = \prox_{\gamma f}\big[x(t)-\gamma\nabla\Phi(x(t))-ax(t)-by(t)\big],\\ \dot…

Optimization and Control · Mathematics 2016-10-05 Radu Ioan Bot , Ernö Robert Csetnek

We consider the Nesterov accelerated primal-dual dynamical system \[ \begin{cases} \ddot{x}(t)+\dfrac{\alpha}{t}\dot{x}(t) +\nabla f(x(t)) +A^\top\bigl(\lambda(t)+\theta t\dot{\lambda}(t)\bigr)+\beta A^\top(Ax(t)-b)=0,\\[0.6em]…

Optimization and Control · Mathematics 2026-05-28 Xin He , Nan-Jing Huang , Yi-Bin Xiao , Ya-Ping Fang

We study the convergence rate of a family of inertial algorithms, which can be obtained by discretization of an inertial system combining asymptotic vanishing viscous and Hessian-driven damping. We establish a fast sublinear convergence…

Optimization and Control · Mathematics 2025-07-18 Zepeng Wang , Juan Peypouquet

In order to minimize a differentiable geodesically convex function, we study a second-order dynamical system on Riemannian manifolds with an asymptotically vanishing damping term of the form $\alpha/t$. For positive values of $\alpha$,…

Optimization and Control · Mathematics 2023-12-12 Tejas Natu , Camille Castera , Jalal Fadili , Peter Ochs

We study the behavior of the trajectories of a second-order differential equation with vanishing damping, governed by the Yosida regularization of a maximally monotone operator with time-varying index, along with a new {\em Regularized…

Optimization and Control · Mathematics 2017-11-10 Hedy Attouch , Juan Peypouquet

In a Hilbert setting we study the convergence properties of a second order in time dynamical system combining viscous and Hessian-driven damping with time scaling in relation with the minimization of a nonsmooth and convex function. The…

Optimization and Control · Mathematics 2022-03-03 Radu Ioan Bot , Mikhail A. Karapetyants

In order to solve the minimization of a nonsmooth convex function, we design an inertial second-order dynamic algorithm, which is obtained by approximating the nonsmooth function by a class of smooth functions. By studying the asymptotic…

Optimization and Control · Mathematics 2021-12-20 Xin Qu , Wei Bian

Many problems in science and engineering involve, as part of their solution process, the consideration of a separable function which is the sum of two convex functions, one of them possibly non-smooth. Recently a few works have discussed…

Optimization and Control · Mathematics 2017-03-06 Daniel Reem , Alvaro De Pierro

This paper deals with a second order dynamical system with a Tikhonov regularization term in connection to the minimization problem of a convex Fr\'echet differentiable function. The fact that beside the asymptotically vanishing damping we…

Optimization and Control · Mathematics 2024-01-08 Szilárd Csaba László

Our approach is part of the close link between continuous dissipative dynamical systems and optimization algorithms. We aim to solve convex minimization problems by means of stochastic inertial differential equations which are driven by the…

Optimization and Control · Mathematics 2025-06-06 Rodrigo Maulen-Soto , Jalal Fadili , Hedy Attouch , Peter Ochs

In this paper, we propose in a Hilbertian setting a second-order time-continuous dynamic system with fast convergence guarantees to solve structured convex minimization problems with an affine constraint. The system is associated with the…

Optimization and Control · Mathematics 2021-03-24 Hedy Attouch , Zaki Chbani , Jalal Fadili , Hassan Riahi