English
Related papers

Related papers: Scalability and Total Recall with Fast CoveringLSH

200 papers

Distributed frameworks are gaining increasingly widespread use in applications that process large amounts of data. One important example application is large scale similarity search, for which Locality Sensitive Hashing (LSH) has emerged as…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-10-29 Bahman Bahmani , Ashish Goel , Rajendra Shinde

Locality-sensitive hashing~[Indyk,Motwani'98] is a classical data structure for approximate nearest neighbor search. It allows, after a close to linear time preprocessing of the input dataset, to find an approximately nearest neighbor of…

Data Structures and Algorithms · Computer Science 2024-06-18 Michael Kapralov , Mikhail Makarov , Christian Sohler

We present a GPU-based Locality Sensitive Hashing (LSH) algorithm to speed up beam search for sequence models. We utilize the winner-take-all (WTA) hash, which is based on relative ranking order of hidden dimensions and thus resilient to…

Computation and Language · Computer Science 2018-06-05 Xing Shi , Shizhen Xu , Kevin Knight

Given a collection of objects and an associated similarity measure, the all-pairs similarity search problem asks us to find all pairs of objects with similarity greater than a certain user-specified threshold. Locality-sensitive hashing…

Databases · Computer Science 2012-03-29 Venu Satuluri , Srinivasan Parthasarathy

Many large multimedia applications require efficient processing of nearest neighbor queries. Often, multimedia data are represented as a collection of important high-dimensional feature vectors. Existing Locality Sensitive Hashing (LSH)…

Databases · Computer Science 2020-10-16 Omid Jafari , Parth Nagarkar , Jonathan Montaño

Can we sense our location in an unfamiliar environment by taking a sublinear-size sample of our surroundings? Can we efficiently encrypt a message that only someone physically close to us can decrypt? To solve this kind of problems, we…

Data Structures and Algorithms · Computer Science 2022-01-11 Elette Boyle , Itai Dinur , Niv Gilboa , Yuval Ishai , Nathan Keller , Ohad Klein

Locality-sensitive hashing (LSH), introduced by Indyk and Motwani in STOC '98, has been an extremely influential framework for nearest neighbor search in high-dimensional data sets. While theoretical work has focused on the approximate…

Data Structures and Algorithms · Computer Science 2018-12-07 Tobias Christiani , Rasmus Pagh , Mikkel Thorup

The explosive growth in big data has attracted much attention in designing efficient indexing and search methods recently. In many critical applications such as large-scale search and pattern matching, finding the nearest neighbors to a…

Machine Learning · Computer Science 2015-09-21 Jun Wang , Wei Liu , Sanjiv Kumar , Shih-Fu Chang

In this paper, we propose a method for density-based clustering in high-dimensional spaces that combines Locality-Sensitive Hashing (LSH) with the Quick Shift algorithm. The Quick Shift algorithm, known for its hierarchical clustering…

Machine Learning · Computer Science 2025-12-01 Sajjad Hashemian

Near neighbor problems are fundamental in algorithms for high-dimensional Euclidean spaces. While classical approaches suffer from the curse of dimensionality, locality sensitive hashing (LSH) can effectively solve a-approximate r-near…

Data Structures and Algorithms · Computer Science 2016-12-15 Wenlong Mou , Liwei Wang

We study the Approximate Nearest Neighbor (ANN) problem under a powerful adaptive adversary that controls both the dataset and a sequence of $Q$ queries. Primarily, for the high-dimensional regime of $d = \omega(\sqrt{Q})$, we introduce a…

Data Structures and Algorithms · Computer Science 2026-01-05 Alexandr Andoni , Themistoklis Haris , Esty Kelman , Krzysztof Onak

As data volumes continue to grow, clustering and outlier detection algorithms are becoming increasingly time-consuming. Classical index structures for neighbor search are no longer sustainable due to the "curse of dimensionality". Instead,…

Databases · Computer Science 2021-05-12 Li Wang

Approximate Nearest Neighbor Search (ANNS) is a fundamental problem in many areas of machine learning and data mining. During the past decade, numerous hashing algorithms are proposed to solve this problem. Every proposed algorithm claims…

Computer Vision and Pattern Recognition · Computer Science 2019-06-20 Deng Cai

Locality-sensitive hashing (LSH) is a fundamental algorithmic technique widely employed in large-scale data processing applications, such as nearest-neighbor search, entity resolution, and clustering. However, its applicability in some…

Information Retrieval · Computer Science 2024-02-01 Runhui Wang , Luyang Kong , Yefan Tao , Andrew Borthwick , Davor Golac , Henrik Johnson , Shadie Hijazi , Dong Deng , Yongfeng Zhang

We present NearBucket-LSH, an effective algorithm for similarity search in large-scale distributed online social networks organized as peer-to-peer overlays. As communication is a dominant consideration in distributed systems, we focus on…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-11-24 Naama Kraus , David Carmel , Idit Keidar , Meni Orenbach

Matrix factorization (MF) can extract the low-rank features and integrate the information of the data manifold distribution from high-dimensional data, which can consider the nonlinear neighbourhood information. Thus, MF has drawn wide…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-24 Zixuan Li , Hao Li , Kenli Li , Fan Wu , Lydia Chen , Keqin Li

In this paper, we show a construction of locality-sensitive hash functions without false negatives, i.e., which ensure collision for every pair of points within a given radius $R$ in $d$ dimensional space equipped with $l_p$ norm when $p…

Data Structures and Algorithms · Computer Science 2016-11-29 Andrzej Pacuk , Piotr Sankowski , Karol Wegrzycki , Piotr Wygocki

Similarity search is a fundamental algorithmic primitive, widely used in many computer science disciplines. Given a set of points $S$ and a radius parameter $r>0$, the $r$-near neighbor ($r$-NN) problem asks for a data structure that, given…

Data Structures and Algorithms · Computer Science 2021-01-27 Martin Aumüller , Sariel Har-Peled , Sepideh Mahabadi , Rasmus Pagh , Francesco Silvestri

We show the existence of a Locality-Sensitive Hashing (LSH) family for the angular distance that yields an approximate Near Neighbor Search algorithm with the asymptotically optimal running time exponent. Unlike earlier algorithms with this…

Data Structures and Algorithms · Computer Science 2015-09-10 Alexandr Andoni , Piotr Indyk , Thijs Laarhoven , Ilya Razenshteyn , Ludwig Schmidt

Large scale agglomerative clustering is hindered by computational burdens. We propose a novel scheme where exact inter-instance distance calculation is replaced by the Hamming distance between Kernelized Locality-Sensitive Hashing (KLSH)…

Machine Learning · Computer Science 2013-01-17 Boyi Xie , Shuheng Zheng