Fast gradient descent method for convex optimization problems with an oracle that generates a $(\delta,L)$-model of a function in a requested point
Optimization and Control
2019-06-26 v5
Abstract
In this article we propose a new concept of a -model of a function which generalizes the concept of the -oracle (Devolder-Glineur-Nesterov). Using this concept we describe the gradient descent method and the fast gradient descent method and we show that many popular methods (composite optimization methods, level methods, conjugate gradient methods, proximal methods) are special cases of proposed methods in this article.
Cite
@article{arxiv.1711.02747,
title = {Fast gradient descent method for convex optimization problems with an oracle that generates a $(\delta,L)$-model of a function in a requested point},
author = {Alexander Tyurin and Alexander Gasnikov},
journal= {arXiv preprint arXiv:1711.02747},
year = {2019}
}
Comments
in Russian