English

Scale-Sensitive Shattering: Learnability and Evaluability at Optimal Scale

Machine Learning 2026-05-14 v1 Information Theory math.IT

Abstract

We study the optimal scale at which real-valued function classes exhibit uniform convergence and learnability. Our main result establishes a scale-sensitive generalization of the fundamental theorem of PAC learning: for every bounded real-valued class and every γ>0\gamma>0, uniform convergence at scale γ\gamma, agnostic learnability at scale γ/2\gamma/2, and finiteness of the fat-shattering dimension at every scale γ>γ\gamma'>\gamma are equivalent. This resolves a question by Anthony and Bartlett (Cambridge Univ. Press 1999) on the precise scales governing learnability, refuting a conjecture attributed there to Phil Long that a multiplicative 2-factor gap is unavoidable, and improves the upper bounds of Bartlett and Long (JCSS 1998), which incur such a loss. The key technical ingredient is a direct bound on empirical \ell_\infty covering numbers, avoiding the standard detour through packing numbers. As a consequence, we obtain sharp asymptotic metric-entropy bounds in terms of the fat-shattering scale γ\gamma: an O(log2n)O(\log^2 n) bound holds already at scale γ/2\gamma/2, while an O(logn)O(\log n) bound holds at scale 2γ2\gamma. We further show that the O(log2n)O(\log^2 n) bound is sometimes tight. These results resolve open questions by Alon et al. (JACM 1997) and Rudelson and Vershynin (Ann. of Math. 2006). As an application, we establish a sharp dichotomy for bounded integral probability metrics: every such IPM is either estimable or cannot be weakly evaluated within any multiplicative factor c<3c<3, while 33-weak evaluability always holds, resolving an open question from Aiyer et al. (ICML 2026). We also highlight several open questions on quantitative sample complexity and evaluability.

Keywords

Cite

@article{arxiv.2605.13684,
  title  = {Scale-Sensitive Shattering: Learnability and Evaluability at Optimal Scale},
  author = {Shashaank Aiyer and Yishay Mansour and Shay Moran and Han Shao and Tom Waknine},
  journal= {arXiv preprint arXiv:2605.13684},
  year   = {2026}
}

Comments

32 pages, 1 figure