English

Singularity of Data Analytic Operations

Statistics Theory 2026-03-17 v8 Statistics Theory

Abstract

Statistical data by their very nature are indeterminate in the sense that if one repeats the process of collecting the data the new data set will be different from the original. But two data sets generated in the same way should ``tell the same story''. Therefore, a statistical method, a map Φ\Phi taking a data set xx to a point in some space F\mathsf{F}, should be stable at xx: Small perturbations in xx should result in a small change in Φ(x)\Phi(x). Otherwise, Φ\Phi is useless at xx or -- and this is important -- near xx. So one doesn't want Φ\Phi to have "singularities," data sets xx such that the the limit of Φ(y)\Phi(y) as yy approaches xx doesn't exist. (The same issue arises elsewhere in applied math.) We prove that broad classes of statistical methods have topological obstructions to continuity: They must have singularities. We derive broadly applicable lower bounds on the Hausdorff dimension, even Hausdorff measure, of the set of singularities of data maps. General results concerning severity of singularities are proved. For illustration, we show our results apply to plane fitting, measuring location of data on spheres, and to linear classification. This is not a "final" version, merely another attempt.

Keywords

Cite

@article{arxiv.1307.7624,
  title  = {Singularity of Data Analytic Operations},
  author = {Steven P. Ellis},
  journal= {arXiv preprint arXiv:1307.7624},
  year   = {2026}
}

Comments

495 pages, 11 figures

R2 v1 2026-06-22T00:59:39.715Z