English

Compression-based Similarity

Information Theory 2011-10-21 v1 math.IT

Abstract

First we consider pair-wise distances for literal objects consisting of finite binary files. These files are taken to contain all of their meaning, like genomes or books. The distances are based on compression of the objects concerned, normalized, and can be viewed as similarity distances. Second, we consider pair-wise distances between names of objects, like "red" or "christianity." In this case the distances are based on searches of the Internet. Such a search can be performed by any search engine that returns aggregate page counts. We can extract a code length from the numbers returned, use the same formula as before, and derive a similarity or relative semantics between names for objects. The theory is based on Kolmogorov complexity. We test both similarities extensively experimentally.

Keywords

Cite

@article{arxiv.1110.4544,
  title  = {Compression-based Similarity},
  author = {Paul M. B. Vitanyi},
  journal= {arXiv preprint arXiv:1110.4544},
  year   = {2011}
}

Comments

Latex, 8 pages, 2 fgures, in Proc. IEEE 1st Int. Conf. Data Compression, Communication and Processing, Palurno, Italy, June 21-24, 2011, 111--118

R2 v1 2026-06-21T19:23:19.027Z