English

Complexity of finding near-stationary points of convex functions stochastically

Optimization and Control 2018-02-26 v1

Abstract

In a recent paper, we showed that the stochastic subgradient method applied to a weakly convex problem, drives the gradient of the Moreau envelope to zero at the rate O(k1/4)O(k^{-1/4}). In this supplementary note, we present a stochastic subgradient method for minimizing a convex function, with the improved rate O~(k1/2)\widetilde O(k^{-1/2}).

Keywords

Cite

@article{arxiv.1802.08556,
  title  = {Complexity of finding near-stationary points of convex functions stochastically},
  author = {Damek Davis and Dmitriy Drusvyatskiy},
  journal= {arXiv preprint arXiv:1802.08556},
  year   = {2018}
}

Comments

9 pages