English

Fast convergence of inertial dynamics with Hessian-driven damping under geometry assumptions

Optimization and Control 2022-06-22 v3

Abstract

First-order optimization algorithms can be considered as a discretization of ordinary differential equations (ODEs) \cite{su2014differential}. In this perspective, studying the properties of the corresponding trajectories may lead to convergence results which can be transfered to the numerical scheme. In this paper we analyse the following ODE introduced by Attouch et al. in \cite{attouch2016fast}: \begin{equation*} \forall t\geqslant t_0,~\ddot{x}(t)+\frac{\alpha}{t}\dot{x}(t)+\beta H_F(x(t))\dot{x}(t)+\nabla F(x(t))=0,\end{equation*} where α>0\alpha>0, β>0\beta>0 and HFH_F denotes the Hessian of FF. This ODE can be derived to build numerical schemes which do not require FF to be twice differentiable as shown in \cite{attouch2020first,attouch2021convergence}. We provide strong convergence results on the error F(x(t))FF(x(t))-F^* and integrability properties on F(x(t))\|\nabla F(x(t))\| under some geometry assumptions on FF such as quadratic growth around the set of minimizers. In particular, we show that the decay rate of the error for a strongly convex function is O(tαε)O(t^{-\alpha-\varepsilon}) for any ε>0\varepsilon>0. These results are briefly illustrated at the end of the paper.

Keywords

Cite

@article{arxiv.2206.06853,
  title  = {Fast convergence of inertial dynamics with Hessian-driven damping under geometry assumptions},
  author = {Jean-François Aujol and Charles Dossal and Văn Hào Hoàng and Hippolyte Labarrière and Aude Rondepierre},
  journal= {arXiv preprint arXiv:2206.06853},
  year   = {2022}
}