English
Related papers

Related papers: Fast Locality Sensitive Hashing with Theoretical G…

200 papers

The existing work on densification of one permutation hashing reduces the query processing cost of the $(K,L)$-parameterized Locality Sensitive Hashing (LSH) algorithm with minwise hashing, from $O(dKL)$ to merely $O(d + KL)$, where $d$ is…

Methodology · Statistics 2014-06-19 Anshumali Shrivastava , Ping Li

A Locality-Sensitive Hash (LSH) function is called $(r,cr,p_1,p_2)$-sensitive, if two data-points with a distance less than $r$ collide with probability at least $p_1$ while data points with a distance greater than $cr$ collide with…

Data Structures and Algorithms · Computer Science 2020-05-26 Thomas Dybdahl Ahle

We consider a new construction of locality-sensitive hash functions for Hamming space that is \emph{covering} in the sense that is it guaranteed to produce a collision for every pair of vectors within a given radius $r$. The construction is…

Data Structures and Algorithms · Computer Science 2016-01-08 Rasmus Pagh

MinHash and SimHash are the two widely adopted Locality Sensitive Hashing (LSH) algorithms for large-scale data processing applications. Deciding which LSH to use for a particular problem at hand is an important question, which has no clear…

Computation · Statistics 2014-07-17 Anshumali Shrivastava , Ping Li

We provide a variant of cross-polytope locality sensitive hashing with respect to angular distance which is provably optimal in asymptotic sensitivity and enjoys $\mathcal{O}(d \ln d )$ hash computation time. Building on a recent result (by…

Data Structures and Algorithms · Computer Science 2016-09-22 Christopher Kennedy , Rachel Ward

Locality-sensitive hashing (LSH), introduced by Indyk and Motwani in STOC '98, has been an extremely influential framework for nearest neighbor search in high-dimensional data sets. While theoretical work has focused on the approximate…

Data Structures and Algorithms · Computer Science 2018-12-07 Tobias Christiani , Rasmus Pagh , Mikkel Thorup

Existing methods for retrieving k-nearest neighbours suffer from the curse of dimensionality. We argue this is caused in part by inherent deficiencies of space partitioning, which is the underlying strategy used by most existing methods. We…

Data Structures and Algorithms · Computer Science 2017-04-07 Ke Li , Jitendra Malik

We present a new locality sensitive hashing (LSH) algorithm for $c$-approximate nearest neighbor search in $\ell_p$ with $1<p<2$. For a database of $n$ points in $\ell_p$, we achieve $O(dn^{\rho})$ query time and $O(dn+n^{1+\rho})$ space,…

Data Structures and Algorithms · Computer Science 2013-06-18 Huy L. Nguyen

Similarity search (nearest neighbor search) is a problem of pursuing the data items whose distances to a query item are the smallest from a large database. Various methods have been developed to address this problem, and recently a lot of…

Data Structures and Algorithms · Computer Science 2014-08-14 Jingdong Wang , Heng Tao Shen , Jingkuan Song , Jianqiu Ji

In this work, we report on a novel application of Locality Sensitive Hashing (LSH) to seismic data at scale. Based on the high waveform similarity between reoccurring earthquakes, our application identifies potential earthquakes by…

Locality-sensitive hashing (LSH) is a popular data-independent indexing method for approximate similarity search, where random projections followed by quantization hash the points from the database so as to ensure that the probability of…

Computer Vision and Pattern Recognition · Computer Science 2015-06-04 Saehoon Kim , Seungjin Choi

Similarity joins are important operations with a broad range of applications. In this paper, we study the problem of vector similarity join size estimation (VSJ). It is a generalization of the previously studied set similarity join size…

Databases · Computer Science 2011-04-19 Hongrae Lee , Raymond T. Ng , Kyuseok Shim

Due to the compelling efficiency in retrieval and storage, similarity-preserving hashing has been widely applied to approximate nearest neighbor search in large-scale image retrieval. However, existing methods have poor performance in…

Multimedia · Computer Science 2020-04-27 Xingbo Liu , Xiushan Nie , Qi Dai , Yupan Huang , Yilong Yin

We present SLASH (Sketched LocAlity Sensitive Hashing), an MPI (Message Passing Interface) based distributed system for approximate similarity search over terabyte scale datasets. SLASH provides a multi-node implementation of the popular…

Databases · Computer Science 2020-08-19 Nicholas Meisburger , Anshumali Shrivastava

This work suggests faster and space-efficient index construction algorithms for LSH for Euclidean distance (\textit{a.k.a.}~\ELSH) and cosine similarity (\textit{a.k.a.}~\SRP). The index construction step of these LSHs relies on grouping…

Data Structures and Algorithms · Computer Science 2025-07-18 Bhisham Dev Verma , Rameshwar Pratap

Can we sense our location in an unfamiliar environment by taking a sublinear-size sample of our surroundings? Can we efficiently encrypt a message that only someone physically close to us can decrypt? To solve this kind of problems, we…

Data Structures and Algorithms · Computer Science 2022-01-11 Elette Boyle , Itai Dinur , Niv Gilboa , Yuval Ishai , Nathan Keller , Ohad Klein

We show an optimal data-dependent hashing scheme for the approximate near neighbor problem. For an $n$-point data set in a $d$-dimensional space our data structure achieves query time $O(d n^{\rho+o(1)})$ and space $O(n^{1+\rho+o(1)} +…

Data Structures and Algorithms · Computer Science 2015-07-17 Alexandr Andoni , Ilya Razenshteyn

Locality-sensitive hashing (LSH) has found widespread use as a fundamental primitive, particularly to accelerate nearest neighbor search. An LSH scheme for a similarity function $S:\mathcal{X} \times \mathcal{X} \to [0,1]$ is a distribution…

Data Structures and Algorithms · Computer Science 2026-05-13 Flavio Chierichetti , Mirko Giacchini , Ravi Kumar , Erasmo Tani

Video anomaly detection (VAD) mainly refers to identifying anomalous events that have not occurred in the training set where only normal samples are available. Existing works usually formulate VAD as a reconstruction or prediction problem.…

Computer Vision and Pattern Recognition · Computer Science 2021-11-17 Yue Lu , Congqi Cao , Yanning Zhang

Large scale agglomerative clustering is hindered by computational burdens. We propose a novel scheme where exact inter-instance distance calculation is replaced by the Hamming distance between Kernelized Locality-Sensitive Hashing (KLSH)…

Machine Learning · Computer Science 2013-01-17 Boyi Xie , Shuheng Zheng