English

Sharp Lower Bounds for Linearized ReLU^k Approximation on the Sphere

Numerical Analysis 2025-11-04 v2 Machine Learning Numerical Analysis

Abstract

We prove a saturation theorem for linearized shallow ReLUk^k neural networks on the unit sphere Sd\mathbb S^d. For any antipodally quasi-uniform set of centers, if the target function has smoothness r>d+2k+12r>\tfrac{d+2k+1}{2}, then the best L2(Sd)\mathcal{L}^2(\mathbb S^d) approximation cannot converge faster than order nd+2k+12dn^{-\frac{d+2k+1}{2d}}. This lower bound matches existing upper bounds, thereby establishing the exact saturation order d+2k+12d\tfrac{d+2k+1}{2d} for such networks. Our results place linearized neural-network approximation firmly within the classical saturation framework and show that, although ReLUk^k networks outperform finite elements under equal degrees kk, this advantage is intrinsically limited.

Keywords

Cite

@article{arxiv.2510.04060,
  title  = {Sharp Lower Bounds for Linearized ReLU^k Approximation on the Sphere},
  author = {Tong Mao and Jinchao Xu},
  journal= {arXiv preprint arXiv:2510.04060},
  year   = {2025}
}
R2 v1 2026-07-01T06:17:40.614Z