Restart FISTA with Global Linear Convergence
Abstract
Fast Iterative Shrinking-Threshold Algorithm (FISTA) is a popular fast gradient descent method (FGM) in the field of large scale convex optimization problems. However, it can exhibit undesirable periodic oscillatory behaviour in some applications that slows its convergence. Restart schemes seek to improve the convergence of FGM algorithms by suppressing the oscillatory behaviour. Recently, a restart scheme for FGM has been proposed that provides linear convergence for non strongly convex optimization problems that satisfy a quadratic functional growth condition. However, the proposed algorithm requires prior knowledge of the optimal value of the objective function or of the quadratic functional growth parameter. In this paper we present a restart scheme for FISTA algorithm, with global linear convergence, for non strongly convex optimization problems that satisfy the quadratic growth condition without requiring the aforementioned values. We present some numerical simulations that suggest that the proposed approach outperforms other restart FISTA schemes.
Cite
@article{arxiv.1906.09126,
title = {Restart FISTA with Global Linear Convergence},
author = {Teodoro Alamo and Pablo Krupa and Daniel Limon},
journal= {arXiv preprint arXiv:1906.09126},
year = {2019}
}
Comments
This paper constitutes an extended and revised version of "Restart FISTA with Global Linear Convergence" by Teodoro Alamo et. al. presented at the European Control Conference (ECC), 2019. v2: typos corrected and includes the proof of Prop. 1(ii) of "Gradient Based Restart FISTA" by Teodoro Alamo et. al. presented at the Conference on Decision and Control (CDC), 2019. (12 pages, 4 figures)