English

Concentration of the missing mass in metric spaces

Statistics Theory 2022-11-23 v4 Probability Statistics Theory

Abstract

We study the estimation and concentration on its expectation of the probability to observe data further than a specified distance from a given iid sample in a metric space. The problem extends the classical problem of estimation of the missing mass in discrete spaces. We give some estimators for the conditional missing mass and show that estimation of the expected missing mass is difficult in general. Conditions on the distribution, under which the Good-Turing estimator and the conditional missing mass concentrate on their expectations are identified. Applications to anomaly detection, coding, the Wasserstein distance between true and empirical measure and simple learning bounds are sketched.

Keywords

Cite

@article{arxiv.2206.02012,
  title  = {Concentration of the missing mass in metric spaces},
  author = {Andreas Maurer},
  journal= {arXiv preprint arXiv:2206.02012},
  year   = {2022}
}

Comments

25 pages. The application to the Wasserstein metric has been added