English

Accelerated Directional Search with non-Euclidean prox-structure

Optimization and Control 2020-03-27 v4

Abstract

In the paper we propose an accelerated directional search method with non-euclidian prox-structure. We consider convex unconstraint optimization problem in Rn\mathbb{R}^n. For simplicity we start from the zero point. We expect in advance that 1-norm of the solution is close enough to its 2-norm. In this case the standard accelerated Nesterov's directional search method can be improved. In the paper we show how to make Nesterov's method nn-times faster (up to a logn\log n-factor) in this case. The basic idea is to use linear coupling, proposed by Allen-Zhu & Orecchia in 2014, and to make Grad-step in 2-norm, but Mirr-step in 1-norm. We show that for constrained optimization problems this approach stable upon an obstacle.

Keywords

Cite

@article{arxiv.1710.00162,
  title  = {Accelerated Directional Search with non-Euclidean prox-structure},
  author = {Evgeniya Vorontsova and Alexander Gasnikov and Eduard Gorbunov},
  journal= {arXiv preprint arXiv:1710.00162},
  year   = {2020}
}

Comments

in Russian, 13 pages, 3 figures

R2 v1 2026-06-22T21:59:38.409Z