English
Related papers

Related papers: Locality Sensitive Hashing for Efficient Similar P…

200 papers

Similarity search is a fundamental algorithmic primitive, widely used in many computer science disciplines. There are several variants of the similarity search problem, and one of the most relevant is the $r$-near neighbor ($r$-NN) problem:…

Data Structures and Algorithms · Computer Science 2020-06-16 Martin Aumüller , Rasmus Pagh , Francesco Silvestri

In this work, we report on a novel application of Locality Sensitive Hashing (LSH) to seismic data at scale. Based on the high waveform similarity between reoccurring earthquakes, our application identifies potential earthquakes by…

We study the $r$-near neighbors reporting problem ($r$-NN), i.e., reporting \emph{all} points in a high-dimensional point set $S$ that lie within a radius $r$ of a given query point $q$. Our approach builds upon on the locality-sensitive…

Databases · Computer Science 2017-03-29 Ninh Pham

Recently it was shown that the problem of Maximum Inner Product Search (MIPS) is efficient and it admits provably sub-linear hashing algorithms. Asymmetric transformations before hashing were the key in solving MIPS which was otherwise…

Machine Learning · Statistics 2014-11-14 Anshumali Shrivastava , Ping Li

We present a GPU-based Locality Sensitive Hashing (LSH) algorithm to speed up beam search for sequence models. We utilize the winner-take-all (WTA) hash, which is based on relative ranking order of hidden dimensions and thus resilient to…

Computation and Language · Computer Science 2018-06-05 Xing Shi , Shizhen Xu , Kevin Knight

Locality sensitive hashing (LSH) was introduced by Indyk and Motwani (STOC `98) to give the first sublinear time algorithm for the c-approximate nearest neighbor (ANN) problem using only polynomial space. At a high level, an LSH family…

Data Structures and Algorithms · Computer Science 2017-12-25 Karthekeyan Chandrasekaran , Daniel Dadush , Venkata Gandikota , Elena Grigorescu

We present NearBucket-LSH, an effective algorithm for similarity search in large-scale distributed online social networks organized as peer-to-peer overlays. As communication is a dominant consideration in distributed systems, we focus on…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-11-24 Naama Kraus , David Carmel , Idit Keidar , Meni Orenbach

Locality-sensitive hashing~[Indyk,Motwani'98] is a classical data structure for approximate nearest neighbor search. It allows, after a close to linear time preprocessing of the input dataset, to find an approximately nearest neighbor of…

Data Structures and Algorithms · Computer Science 2024-06-18 Michael Kapralov , Mikhail Makarov , Christian Sohler

We propose a learning method with feature selection for Locality-Sensitive Hashing. Locality-Sensitive Hashing converts feature vectors into bit arrays. These bit arrays can be used to perform similarity searches and personal…

Machine Learning · Computer Science 2012-10-12 Makiko Konoshima , Yui Noma

Due to the compelling efficiency in retrieval and storage, similarity-preserving hashing has been widely applied to approximate nearest neighbor search in large-scale image retrieval. However, existing methods have poor performance in…

Multimedia · Computer Science 2020-04-27 Xingbo Liu , Xiushan Nie , Qi Dai , Yupan Huang , Yilong Yin

Similarity joins are a fundamental database operation. Given data sets S and R, the goal of a similarity join is to find all points x in S and y in R with distance at most r. Recent research has investigated how locality-sensitive hashing…

Data Structures and Algorithms · Computer Science 2018-04-17 Samuel McCauley , Francesco Silvestri

The multichannel rendezvous problem is a fundamental problem for neighbor discovery in many IoT applications. The existing works in the literature focus mostly on improving the worst-case performance, and the average-case performance is…

Networking and Internet Architecture · Computer Science 2022-11-14 Guann-Yng Jiang , Cheng-Shang Chang

As data volumes continue to grow, searches in data are becoming increasingly time-consuming. Classical index structures for neighbor search are no longer sustainable due to the "curse of dimensionality". Instead, approximated index…

Machine Learning · Computer Science 2021-11-17 Li Wang , Lilon Wangner

Automatic crash bucketing is a crucial phase in the software development process for efficiently triaging bug reports. It generally consists in grouping similar reports through clustering techniques. However, with real-time streaming bug…

Software Engineering · Computer Science 2023-10-11 Youcef Remil , Anes Bendimerad , Romain Mathonat , Chedy Raissi , Mehdi Kaytoue

We give new data-dependent locality sensitive hashing schemes (LSH) for the Earth Mover's Distance ($\mathsf{EMD}$), and as a result, improve the best approximation for nearest neighbor search under $\mathsf{EMD}$ by a quadratic factor.…

Data Structures and Algorithms · Computer Science 2024-03-11 Rajesh Jayaram , Erik Waingarten , Tian Zhang

With the rapid development of GPU (Graphics Processing Unit) technologies and neural networks, we can explore more appropriate data structures and algorithms. Recent progress shows that neural networks can partly replace traditional data…

Information Retrieval · Computer Science 2023-10-17 Renyang Liu , Jun Zhao , Xing Chu , Yu Liang , Wei Zhou , Jing He

All-pairs set similarity is a widely used data mining task, even for large and high-dimensional datasets. Traditionally, similarity search has focused on discovering very similar pairs, for which a variety of efficient algorithms are known.…

Data Structures and Algorithms · Computer Science 2020-03-09 Cyrus Rashtchian , Aneesh Sharma , David P. Woodruff

We present the first provably sublinear time algorithm for approximate \emph{Maximum Inner Product Search} (MIPS). Our proposal is also the first hashing algorithm for searching with (un-normalized) inner product as the underlying…

Machine Learning · Statistics 2014-05-23 Anshumali Shrivastava , Ping Li

Distributed frameworks are gaining increasingly widespread use in applications that process large amounts of data. One important example application is large scale similarity search, for which Locality Sensitive Hashing (LSH) has emerged as…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-10-29 Bahman Bahmani , Ashish Goel , Rajendra Shinde

Approximate nearest neighbour (ANN) search is an essential component of search engines, recommendation systems, etc. Many recent works focus on learning-based data-distribution-dependent hashing and achieve good retrieval performance.…

Information Retrieval · Computer Science 2023-04-07 Kim Yong Tan , Yueming Lyu , Yew Soon Ong , Ivor W. Tsang