English

Fast Convergence of an Inertial Gradient-like System with Vanishing Viscosity

Optimization and Control 2015-07-20 v1

Abstract

In a real Hilbert space H\mathcal H, we study the fast convergence properties as t+t \to + \infty of the trajectories of the second-order evolution equation x¨(t)+αtx˙(t)+Φ(x(t))=0, \ddot{x}(t) + \frac{\alpha}{t} \dot{x}(t) + \nabla \Phi (x(t)) = 0, where Φ\nabla \Phi is the gradient of a convex continuously differentiable function Φ:HR\Phi : \mathcal H \rightarrow \mathbb R, and α\alpha is a positive parameter. In this inertial system, the viscous damping coefficient αt\frac{\alpha}{t} vanishes asymptotically in a moderate way. For α>3\alpha > 3, we show that any trajectory converges weakly to a minimizer of Φ\Phi, just assuming that the set of minimizers is nonempty. The strong convergence is established in various practical situations. These results complement the O(t2)\mathcal O(t^{-2}) rate of convergence for the values obtained by Su, Boyd and Cand\`es. Time discretization of this system, and some of its variants, provides new fast converging algorithms, expanding the field of rapid methods for structured convex minimization introduced by Nesterov, and further developed by Beck and Teboulle. This study also complements recent advances due to Chambolle and Dossal.

Keywords

Cite

@article{arxiv.1507.04782,
  title  = {Fast Convergence of an Inertial Gradient-like System with Vanishing Viscosity},
  author = {Hedy Attouch and Juan Peypouquet and Patrick Redont},
  journal= {arXiv preprint arXiv:1507.04782},
  year   = {2015}
}