English

Information Distance in Multiples

Computer Vision and Pattern Recognition 2009-05-21 v1 Machine Learning

Abstract

Information distance is a parameter-free similarity measure based on compression, used in pattern recognition, data mining, phylogeny, clustering, and classification. The notion of information distance is extended from pairs to multiples (finite lists). We study maximal overlap, metricity, universality, minimal overlap, additivity, and normalized information distance in multiples. We use the theoretical notion of Kolmogorov complexity which for practical purposes is approximated by the length of the compressed version of the file involved, using a real-world compression program. {\em Index Terms}-- Information distance, multiples, pattern recognition, data mining, similarity, Kolmogorov complexity

Keywords

Cite

@article{arxiv.0905.3347,
  title  = {Information Distance in Multiples},
  author = {Paul M. B. Vitanyi},
  journal= {arXiv preprint arXiv:0905.3347},
  year   = {2009}
}

Comments

LateX 14 pages, Submitted to a technical journal

R2 v1 2026-06-21T13:04:21.217Z