English

Sharp First-Order Lower Bounds under Sublevel $α$-Polyak-Lojasiewicz Conditions

Optimization and Control 2026-06-26 v1

Abstract

We study the optimal complexity of first-order methods under the α\alpha-Polyak-Lojasiewicz condition with α[1,2)\alpha\in[1,2). This condition bounds the suboptimality gap by a power α\alpha of the gradient norm; α=2\alpha=2 recovers the classical Polyak-Lojasiewicz condition, α=1\alpha=1 corresponds to a Holder error-bound regime, and intermediate exponents arise near degenerate minima in local Kurdyka-Lojasiewicz geometry. We first prove a structural obstruction: if global smoothness and a global α\alpha-Polyak-Lojasiewicz inequality are imposed on Rd\mathbb{R}^d, then every such function is constant for α<2\alpha<2. This motivates the globally smooth, sublevel-α\alpha-Polyak-Lojasiewicz class, where the inequality is required only on the initial sublevel set. On this class, we prove sharp minimax lower bounds for first-order methods. In the deterministic oracle model, any first-order method requires Ω(Lτ2/αϵ(2α)/α)\Omega(L\tau^{2/\alpha}\epsilon^{-(2-\alpha)/\alpha}) queries to reach accuracy ϵ\epsilon, matching gradient descent. In the bounded-variance stochastic-gradient oracle model, any stochastic first-order method requires Ω(Lσ2τ4/αϵ(4α)/α)\Omega(L\sigma^2\tau^{4/\alpha}\epsilon^{-(4-\alpha)/\alpha}) queries in the noise-dominated regime, matching known SGD upper rates under trajectory-containment assumptions.

Cite

@article{arxiv.2606.28278,
  title  = {Sharp First-Order Lower Bounds under Sublevel $α$-Polyak-Lojasiewicz Conditions},
  author = {Saeed Masiha and Negar Kiyavash and Patrick Thiran},
  journal= {arXiv preprint arXiv:2606.28278},
  year   = {2026}
}