Global Stability and Step Size Robustness of RMSProp
Optimization and Control
2026-05-19 v2
Abstract
In this paper, an input-to-state Lyapunov function for the RMSProp optimization algorithm is introduced. Global asymptotic stability of the RMSProp algorithm for constant step sizes and robustness properties with respect to arbitrary bounded time-varying step size rules are established.
Keywords
Cite
@article{arxiv.2603.15823,
title = {Global Stability and Step Size Robustness of RMSProp},
author = {Naum Dimitrieski and Maria Christine Honecker and Carsten Scherer and Christian Ebenbauer},
journal= {arXiv preprint arXiv:2603.15823},
year = {2026}
}