English
Related papers

Related papers: Fast convex optimization via inertial dynamics wit…

200 papers

In this paper we carry out an asymptotic analysis of the proximal-gradient dynamical system \begin{equation*}\left\{ \begin{array}{ll} \dot x(t) +x(t) = \prox_{\gamma f}\big[x(t)-\gamma\nabla\Phi(x(t))-ax(t)-by(t)\big],\\ \dot…

Optimization and Control · Mathematics 2016-10-05 Radu Ioan Bot , Ernö Robert Csetnek

In this short note, we recover by a different method the new result due to Attouch, Peyrouqet and Redont concerning the weak convergence as $t\rightarrow+\infty$ of solutions $x(t)$ to the second order differential equation \[…

Optimization and Control · Mathematics 2016-09-02 Ramzi May

In a Hilbert setting, for convex differentiable optimization, we consider accelerated gradient dynamics combining Tikhonov regularization with Hessian-driven damping. The Tikhonov regularization parameter is assumed to tend to zero as time…

Optimization and Control · Mathematics 2022-04-01 Hedy Attouch , Aicha Balhag , Zaki Chbani , Hassan Riahi

In a real Hilbert space setting, we study the convergence properties of an inexact gradient algorithm featuring both viscous and Hessian driven damping for convex differentiable optimization. In this algorithm, the gradient evaluation can…

Optimization and Control · Mathematics 2025-09-25 Harsh Choudhary , Jalal Fadili , Vyachelav Kungurtsev

In a Hilbert setting we study the convergence properties of a second order in time dynamical system combining viscous and Hessian-driven damping with time scaling in relation with the minimization of a nonsmooth and convex function. The…

Optimization and Control · Mathematics 2022-03-03 Radu Ioan Bot , Mikhail A. Karapetyants

We consider the minimization of a convex objective function subject to the set of minima of another convex function, under the assumption that both functions are twice continuously differentiable. We approach this optimization problem from…

Optimization and Control · Mathematics 2016-08-16 Radu Ioan Bot , Ernö Robert Csetnek

Second-order continuous-time dissipative dynamical systems with viscous and Hessian driven damping have inspired effective first-order algorithms for solving convex optimization problems. While preserving the fast convergence properties of…

Optimization and Control · Mathematics 2022-03-18 Hedy Attouch , Jalal Fadili , Vyacheslav Kungurtsev

In a Hilbert setting, we develop a gradient-based dynamic approach for fast solving convex optimization problems. By applying time scaling, averaging, and perturbation techniques to the continuous steepest descent (SD), we obtain…

Optimization and Control · Mathematics 2023-05-05 Hedy Attouch , Radu Ioan Bot , Dang-Khoa Nguyen

A Tikhonov regularized inertial primal\mbox{-}dual dynamical system with time scaling and vanishing damping is proposed for solving a linearly constrained convex optimization problem in Hilbert spaces. The system under consideration…

Optimization and Control · Mathematics 2024-04-24 Ting-Ting Zhu , Rong Hu , Ya-Ping Fang

In order to solve the minimization of a nonsmooth convex function, we design an inertial second-order dynamic algorithm, which is obtained by approximating the nonsmooth function by a class of smooth functions. By studying the asymptotic…

Optimization and Control · Mathematics 2021-12-20 Xin Qu , Wei Bian

In order to minimize a differentiable geodesically convex function, we study a second-order dynamical system on Riemannian manifolds with an asymptotically vanishing damping term of the form $\alpha/t$. For positive values of $\alpha$,…

Optimization and Control · Mathematics 2023-12-12 Tejas Natu , Camille Castera , Jalal Fadili , Peter Ochs

This paper is devoted to the investigation of inertial dynamical systems with implicit Hessian-driven damping for strongly quasiconvex optimization which is a specific class of nonconvex optimization problems. We first establish exponential…

Optimization and Control · Mathematics 2026-02-27 Zeying Gao , Xiangkai Sun , Liang He

We analyze the convergence rate of a family of inertial algorithms, which can be obtained by discretization of an inertial system with Hessian-driven damping. We recover a convergence rate, up to a factor of 2 speedup upon Nesterov's…

Optimization and Control · Mathematics 2025-02-25 Zepeng Wang , Juan Peypouquet

Our approach is part of the close link between continuous dissipative dynamical systems and optimization algorithms. We aim to solve convex minimization problems by means of stochastic inertial differential equations which are driven by the…

Optimization and Control · Mathematics 2025-06-06 Rodrigo Maulen-Soto , Jalal Fadili , Hedy Attouch , Peter Ochs

In this paper, we introduce, in a Hilbert space setting, a second order dynamical system with asymptotically vanishing damping and vanishing Tikhonov regularization that approaches a multiobjective optimization problem with convex and…

Optimization and Control · Mathematics 2025-06-30 Radu Ioan Bot , Konstantin Sonntag

In a Hilbert space $\mathcal H$, we study the asymptotic behaviour, as time variable $t$ goes to $+\infty$, of nonautonomous gradient-like dynamical systems involving inertia and multiscale features. Given $\mathcal H$ a general Hilbert…

Optimization and Control · Mathematics 2016-02-02 Hedy Attouch , Marc-Olivier Czarnecki

By time discretization of a second-order primal-dual dynamical system with damping $\alpha/t$ where an inertial construction in the sense of Nesterov is needed only for the primal variable, we propose a fast primal-dual algorithm for a…

Optimization and Control · Mathematics 2022-06-06 Xin He , Rong Hu , Ya-Ping Fang

We introduce and investigate the asymptotic behaviour of the trajectories of a second order dynamical system with Tikhonov regularization for solving a monotone equation with single valued, monotone and continuous operator acting on a real…

Optimization and Control · Mathematics 2024-11-27 Ernö Robert Csetnek , Szilárd Csaba László

This paper proposes novel primal-dual dynamical systems for solving linear equality constrained convex optimization. First, we introduce a primal-dual dynamical system with implicit Hessian damping, which can neutralize the transversal…

Optimization and Control · Mathematics 2025-08-26 Hong-lu Li , Xin He , Yi-bin Xiao

In this work, we approach the problem of finding the zeros of a continuous and monotone operator through a second-order dynamical system with a damping term of the form $1/t^{r}$, where $r\in [0, 1]$. The system features the time derivative…

Optimization and Control · Mathematics 2024-07-23 Radu Ioan Bot , David Alexander Hulett , Dang-Khoa Nguyen