English
Related papers

Related papers: Implementing and Evaluating E2LSH on Storage

200 papers

We show the existence of a Locality-Sensitive Hashing (LSH) family for the angular distance that yields an approximate Near Neighbor Search algorithm with the asymptotically optimal running time exponent. Unlike earlier algorithms with this…

Data Structures and Algorithms · Computer Science 2015-09-10 Alexandr Andoni , Piotr Indyk , Thijs Laarhoven , Ilya Razenshteyn , Ludwig Schmidt

Locality-Sensitive Hashing (LSH) is one of the most popular methods for $c$-Approximate Nearest Neighbor Search ($c$-ANNS) in high-dimensional spaces. In this paper, we propose a novel LSH scheme based on the Longest Circular Co-Substring…

Databases · Computer Science 2020-04-14 Yifan Lei , Qiang Huang , Mohan Kankanhalli , Anthony K. H. Tung

Locality-sensitive hashing (LSH) has emerged as the dominant algorithmic technique for similarity search with strong performance guarantees in high-dimensional spaces. A drawback of traditional LSH schemes is that they may have \emph{false…

Databases · Computer Science 2016-08-22 Ninh Pham , Rasmus Pagh

Similarity search methods are widely used as kernels in various machine learning applications. Nearest neighbor search (NNS) algorithms are often used to retrieve similar entries, given a query. While there exist efficient techniques for…

Databases · Computer Science 2010-06-18 Rajendra Shinde , Ashish Goel , Pankaj Gupta , Debojyoti Dutta

Locality sensitive hashing (LSH) is a fundamental algorithmic toolkit used by data scientists for approximate nearest neighbour search problems that have been used extensively in many large scale data processing applications such as near…

Machine Learning · Statistics 2025-03-04 Bhisham Dev Verma , Rameshwar Pratap

Locality-sensitive hashing (LSH) based frameworks have been used efficiently to select weight vectors in a dense hidden layer with high cosine similarity to an input, enabling dynamic pruning. While this type of scheme has been shown to…

Machine Learning · Computer Science 2023-06-06 Tahseen Rabbani , Marco Bornstein , Furong Huang

Near neighbor problems are fundamental in algorithms for high-dimensional Euclidean spaces. While classical approaches suffer from the curse of dimensionality, locality sensitive hashing (LSH) can effectively solve a-approximate r-near…

Data Structures and Algorithms · Computer Science 2016-12-15 Wenlong Mou , Liwei Wang

Approximate Nearest Neighbor Search (ANNS) is a fundamental algorithmic problem, with numerous applications in many areas of computer science. Locality-sensitive hashing (LSH) is one of the most popular solution approaches for ANNS. A…

Databases · Computer Science 2021-03-11 Huayi Wang , Jingfan Meng , Long Gong , Jun Xu , Mitsunori Ogihara

Learning from set-structured data is an essential problem with many applications in machine learning and computer vision. This paper focuses on non-parametric and data-independent learning from set-structured data using approximate nearest…

Machine Learning · Computer Science 2022-02-10 Yuzhe Lu , Xinran Liu , Andrea Soltoggio , Soheil Kolouri

The in-memory algorithms for approximate nearest neighbor search (ANNS) have achieved great success for fast high-recall search, but are extremely expensive when handling very large scale database. Thus, there is an increasing request for…

Databases · Computer Science 2021-11-17 Qi Chen , Bing Zhao , Haidong Wang , Mingqin Li , Chuanjie Liu , Zengzhong Li , Mao Yang , Jingdong Wang

Many large multimedia applications require efficient processing of nearest neighbor queries. Often, multimedia data are represented as a collection of important high-dimensional feature vectors. Existing Locality Sensitive Hashing (LSH)…

Databases · Computer Science 2020-10-16 Omid Jafari , Parth Nagarkar , Jonathan Montaño

Approximate nearest neighbour (ANN) search is an essential component of search engines, recommendation systems, etc. Many recent works focus on learning-based data-distribution-dependent hashing and achieve good retrieval performance.…

Information Retrieval · Computer Science 2023-04-07 Kim Yong Tan , Yueming Lyu , Yew Soon Ong , Ivor W. Tsang

We present a new locality sensitive hashing (LSH) algorithm for $c$-approximate nearest neighbor search in $\ell_p$ with $1<p<2$. For a database of $n$ points in $\ell_p$, we achieve $O(dn^{\rho})$ query time and $O(dn+n^{1+\rho})$ space,…

Data Structures and Algorithms · Computer Science 2013-06-18 Huy L. Nguyen

We present SLASH (Sketched LocAlity Sensitive Hashing), an MPI (Message Passing Interface) based distributed system for approximate similarity search over terabyte scale datasets. SLASH provides a multi-node implementation of the popular…

Databases · Computer Science 2020-08-19 Nicholas Meisburger , Anshumali Shrivastava

We present an I/O-efficient algorithm for computing similarity joins based on locality-sensitive hashing (LSH). In contrast to the filtering methods commonly suggested our method has provable sub-quadratic dependency on the data size.…

Data Structures and Algorithms · Computer Science 2017-03-29 Rasmus Pagh , Ninh Pham , Francesco Silvestri , Morten Stöckel

Distributed frameworks are gaining increasingly widespread use in applications that process large amounts of data. One important example application is large scale similarity search, for which Locality Sensitive Hashing (LSH) has emerged as…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-10-29 Bahman Bahmani , Ashish Goel , Rajendra Shinde

Locality Sensitive Hashing (LSH) is an effective method to index a set of points such that we can efficiently find the nearest neighbors of a query point. We extend this method to our novel Set-query LSH (SLSH), such that it can find the…

Data Structures and Algorithms · Computer Science 2020-04-23 Haim Kaplan , Jay Tenenbaum

The indexing algorithms for the high-dimensional nearest neighbor search (NNS) with the best worst-case guarantees are based on the randomized Locality Sensitive Hashing (LSH), and its derivatives. In practice, many heuristic approaches…

Data Structures and Algorithms · Computer Science 2022-07-08 Alexandr Andoni , Daniel Beaglehole

Approximate nearest neighbor search under universal L_p metrics (ANNS-U-L_p) is an important and challenging research problem, as it requires answering queries under all possible p (0<p <= 2) values simultaneously without building an index…

Databases · Computer Science 2026-05-08 Huayi Wang , Jingfan Meng , Jun Xu

Approximate Nearest Neighbor Search (ANNS) is a fundamental operation in vector databases, enabling efficient similarity search in high-dimensional spaces. While dense ANNS has been optimized using specialized hardware accelerators, sparse…

Databases · Computer Science 2026-01-07 Tianqi Zhang , Flavio Ponzina , Tajana Rosing