English

CoveringLSH: Locality-sensitive Hashing without False Negatives

Data Structures and Algorithms 2016-01-08 v3

Abstract

We consider a new construction of locality-sensitive hash functions for Hamming space that is \emph{covering} in the sense that is it guaranteed to produce a collision for every pair of vectors within a given radius rr. The construction is \emph{efficient} in the sense that the expected number of hash collisions between vectors at distance~crcr, for a given c>1c>1, comes close to that of the best possible data independent LSH without the covering guarantee, namely, the seminal LSH construction of Indyk and Motwani (STOC '98). The efficiency of the new construction essentially \emph{matches} their bound when the search radius is not too large --- e.g., when cr=o(log(n)/loglogn)cr = o(\log(n)/\log\log n), where nn is the number of points in the data set, and when cr=log(n)/kcr = \log(n)/k where kk is an integer constant. In general, it differs by at most a factor ln(4)\ln(4) in the exponent of the time bounds. As a consequence, LSH-based similarity search in Hamming space can avoid the problem of false negatives at little or no cost in efficiency.

Keywords

Cite

@article{arxiv.1507.03225,
  title  = {CoveringLSH: Locality-sensitive Hashing without False Negatives},
  author = {Rasmus Pagh},
  journal= {arXiv preprint arXiv:1507.03225},
  year   = {2016}
}

Comments

Short version appears in Proceedings of SODA 2016

R2 v1 2026-06-22T10:10:15.884Z