English

Optimal local linear convergence of Nesterov's accelerated gradient method for $C^2$ functions under the Polyak--{\L}ojasiewicz inequality

Optimization and Control 2026-03-24 v1 Numerical Analysis Numerical Analysis

Abstract

In this work, we establish that Nesterov's accelerated gradient method, applied to C2C^2 functions satisfying the Polyak--{\L}ojasiewicz inequality around local minimizers, achieves the optimal local linear convergence rate ρ=3L+μ2μ3L+μ+ε\rho=\frac{\sqrt{3L+\mu}-2\sqrt{\mu}}{\sqrt{3L+\mu}}+\varepsilon, where ε\varepsilon is an arbitrarily small constant. Our analysis requires neither higher-order smoothness beyond C2C^2 of the objective function nor any additional geometric regularity of the submanifold of local minimizers. The key novelty lies in a two-stage argument: we first establish a coarse yet valid local linear convergence rate and then, building upon this a priori convergence guarantee, obtain a refined characterization of the linearized iteration operator, which yields the optimal rate. As a result, we only need to slightly strengthen the standard C1,1C^{1,1} assumption, which is commonly required in theoretical analyses of linear convergence for first-order methods, to C2C^2 smoothness. Moreover, the same analytical framework allows us to recover, under identical conditions, the optimal local exponential convergence rate μ\sqrt{\mu} for the continuous-time Heavy Ball dynamics. Finally, a representative numerical experiment corroborates our theoretical findings.

Keywords

Cite

@article{arxiv.2603.21516,
  title  = {Optimal local linear convergence of Nesterov's accelerated gradient method for $C^2$ functions under the Polyak--{\L}ojasiewicz inequality},
  author = {Zixu Feng and Hao Yuan},
  journal= {arXiv preprint arXiv:2603.21516},
  year   = {2026}
}

Comments

23 pages, 4 figures