English

Topological Quality of Subsets via Persistence Matching Diagrams

Algebraic Topology 2024-10-01 v3 Artificial Intelligence Machine Learning

Abstract

Data quality is crucial for the successful training, generalization and performance of machine learning models. We propose to measure the quality of a subset concerning the dataset it represents, using topological data analysis techniques. Specifically, we define the persistence matching diagram, a topological invariant derived from combining embeddings with persistent homology. We provide an algorithm to compute it using minimum spanning trees. Also, the invariant allows us to understand whether the subset ``represents well" the clusters from the larger dataset or not, and we also use it to estimate bounds for the Hausdorff distance between the subset and the complete dataset. In particular, this approach enables us to explain why the chosen subset is likely to result in poor performance of a supervised learning model.

Keywords

Cite

@article{arxiv.2306.02411,
  title  = {Topological Quality of Subsets via Persistence Matching Diagrams},
  author = {Álvaro Torras-Casas and Eduardo Paluzo-Hidalgo and Rocio Gonzalez-Diaz},
  journal= {arXiv preprint arXiv:2306.02411},
  year   = {2024}
}