English

Fast inertial dynamics and FISTA algorithms in convex optimization. Perturbation aspects

Optimization and Control 2015-07-07 v1

Abstract

In a Hilbert space setting H\mathcal H, we study the fast convergence properties as t+t \to + \infty of the trajectories of the second-order differential equation x¨(t)+αtx˙(t)+Φ(x(t))=g(t) \ddot{x}(t) + \frac{\alpha}{t} \dot{x}(t) + \nabla \Phi (x(t)) = g(t), where Φ\nabla\Phi is the gradient of a convex continuously differentiable function Φ:HR\Phi: \mathcal H \to \mathbb R, α\alpha is a positive parameter, and g:[t0,+[Hg: [t_0, + \infty[ \rightarrow \mathcal H is a "small" perturbation term. In this damped inertial system, the viscous damping coefficient αt\frac{\alpha}{t} vanishes asymptotically, but not too rapidly. For α3\alpha \geq 3, and t0+tg(t)dt<+\int_{t_0}^{+\infty} t \|g(t)\| dt < + \infty, just assuming that the solution set is non empty, we show that any trajectory of the above system satisfies the fast convergence property Φ(x(t))minHΦCt2\Phi(x(t))- \min_{\mathcal H}\Phi \leq \frac{C}{t^2}. For α>3\alpha > 3, we show that any trajectory converges weakly to a minimizer of Φ\Phi, and we show the strong convergence property in various practical situations. This complements the results obtained by Su-Boyd- Cand\`es, and Attouch-Peypouquet-Redont, in the unperturbed case g=0g=0. The parallel study of the time discretized version of this system provides new insight on the effect of errors, or perturbations on Nesterov's type algorithms. We obtain fast convergence of the values, and convergence of the trajectories for a perturbed version of the variant of FISTA recently considered by Chambolle-Dossal, and Su-Boyd-Cand\`es.

Keywords

Cite

@article{arxiv.1507.01367,
  title  = {Fast inertial dynamics and FISTA algorithms in convex optimization. Perturbation aspects},
  author = {H. Attouch and Z. Chbani},
  journal= {arXiv preprint arXiv:1507.01367},
  year   = {2015}
}

Comments

21 pages

R2 v1 2026-06-22T10:06:17.580Z