Accelerated Directional Search with non-Euclidean prox-structure
Optimization and Control
2020-03-27 v4
Abstract
In the paper we propose an accelerated directional search method with non-euclidian prox-structure. We consider convex unconstraint optimization problem in . For simplicity we start from the zero point. We expect in advance that 1-norm of the solution is close enough to its 2-norm. In this case the standard accelerated Nesterov's directional search method can be improved. In the paper we show how to make Nesterov's method -times faster (up to a -factor) in this case. The basic idea is to use linear coupling, proposed by Allen-Zhu & Orecchia in 2014, and to make Grad-step in 2-norm, but Mirr-step in 1-norm. We show that for constrained optimization problems this approach stable upon an obstacle.
Cite
@article{arxiv.1710.00162,
title = {Accelerated Directional Search with non-Euclidean prox-structure},
author = {Evgeniya Vorontsova and Alexander Gasnikov and Eduard Gorbunov},
journal= {arXiv preprint arXiv:1710.00162},
year = {2020}
}
Comments
in Russian, 13 pages, 3 figures