Sharp Lower Bounds for Linearized ReLU^k Approximation on the Sphere
Numerical Analysis
2025-11-04 v2 Machine Learning
Numerical Analysis
Abstract
We prove a saturation theorem for linearized shallow ReLU neural networks on the unit sphere . For any antipodally quasi-uniform set of centers, if the target function has smoothness , then the best approximation cannot converge faster than order . This lower bound matches existing upper bounds, thereby establishing the exact saturation order for such networks. Our results place linearized neural-network approximation firmly within the classical saturation framework and show that, although ReLU networks outperform finite elements under equal degrees , this advantage is intrinsically limited.
Cite
@article{arxiv.2510.04060,
title = {Sharp Lower Bounds for Linearized ReLU^k Approximation on the Sphere},
author = {Tong Mao and Jinchao Xu},
journal= {arXiv preprint arXiv:2510.04060},
year = {2025}
}