English
Related papers

Related papers: qwLSH: Cache-conscious Indexing for Processing Sim…

200 papers

With the rapid development of GPU (Graphics Processing Unit) technologies and neural networks, we can explore more appropriate data structures and algorithms. Recent progress shows that neural networks can partly replace traditional data…

Information Retrieval · Computer Science 2023-10-17 Renyang Liu , Jun Zhao , Xing Chu , Yu Liang , Wei Zhou , Jing He

We show that approximate similarity (near neighbour) search can be solved in high dimensions with performance matching state of the art (data independent) Locality Sensitive Hashing, but with a guarantee of no false negatives. Specifically,…

Data Structures and Algorithms · Computer Science 2018-06-28 Thomas Dybdahl Ahle

We present an I/O-efficient algorithm for computing similarity joins based on locality-sensitive hashing (LSH). In contrast to the filtering methods commonly suggested our method has provable sub-quadratic dependency on the data size.…

Data Structures and Algorithms · Computer Science 2017-03-29 Rasmus Pagh , Ninh Pham , Francesco Silvestri , Morten Stöckel

We investigate the problem of finding reverse nearest neighbors efficiently. Although provably good solutions exist for this problem in low or fixed dimensions, to this date the methods proposed in high dimensions are mostly heuristic. We…

Computational Geometry · Computer Science 2010-11-24 David Arthur , Steve Y. Oudot

Near neighbor problems are fundamental in algorithms for high-dimensional Euclidean spaces. While classical approaches suffer from the curse of dimensionality, locality sensitive hashing (LSH) can effectively solve a-approximate r-near…

Data Structures and Algorithms · Computer Science 2016-12-15 Wenlong Mou , Liwei Wang

Locality-Sensitive Hashing (LSH) is one of the most popular methods for $c$-Approximate Nearest Neighbor Search ($c$-ANNS) in high-dimensional spaces. In this paper, we propose a novel LSH scheme based on the Longest Circular Co-Substring…

Databases · Computer Science 2020-04-14 Yifan Lei , Qiang Huang , Mohan Kankanhalli , Anthony K. H. Tung

Similarity search finds objects that are similar to a given query object based on a similarity metric. As the amount and variety of data continue to grow, similarity search in metric spaces has gained significant attention. Metric spaces…

Databases · Computer Science 2024-10-08 Yifan Zhu , Chengyang Luo , Tang Qian , Lu Chen , Yunjun Gao , Baihua Zheng

The indexing algorithms for the high-dimensional nearest neighbor search (NNS) with the best worst-case guarantees are based on the randomized Locality Sensitive Hashing (LSH), and its derivatives. In practice, many heuristic approaches…

Data Structures and Algorithms · Computer Science 2022-07-08 Alexandr Andoni , Daniel Beaglehole

Large-scale cross-modal hashing similarity retrieval has attracted more and more attention in modern search applications such as search engines and autopilot, showing great superiority in computation and storage. However, current…

Computer Vision and Pattern Recognition · Computer Science 2020-01-01 Lu Wang , Jie Yang

In this paper, we consider the problem of classification of $M$ high dimensional queries $y^1,\cdots,y^M\in B^S$ to $N$ high dimensional classes $x^1,\cdots,x^N\in A^S$ where $A$ and $B$ are discrete alphabets and the probabilistic model…

Machine Learning · Computer Science 2020-06-24 Arash Gholami Davoodi , Sean Chang , Hyun Gon Yoo , Anubhav Baweja , Mihir Mongia , Hosein Mohimani

Instance Search (INS) is a fundamental problem for many applications, while it is more challenging comparing to traditional image search since the relevancy is defined at the instance level. Existing works have demonstrated the success of…

Computer Vision and Pattern Recognition · Computer Science 2017-01-30 Jingkuan Song , Tao He , Lianli Gao , Xing Xu , Heng Tao Shen

Large-scale software systems generate vast volumes of system logs that are essential for monitoring, diagnosing, and performance optimization. However, the unstructured nature and ever-growing scale of these logs present significant…

Software Engineering · Computer Science 2025-04-04 Shu-Wei Huang , Xingfang Wu , Heng Li

Locality Sensitive Hashing (LSH) based algorithms have already shown their promise in finding approximate nearest neighbors in high dimen- sional data space. However, there are certain scenarios, as in sequential data, where the proximity…

Computer Vision and Pattern Recognition · Computer Science 2018-05-30 Angana Chakraborty , Sanghamitra Bandyopadhyay

Similarity search is the task of retrieving data items that are similar to a given query. In this paper, we introduce the time-sensitive notion of similarity search over endless data-streams (SSDS), which takes into account data quality and…

Information Retrieval · Computer Science 2017-08-08 Naama Kraus , David Carmel , Idit Keidar

High-dimensional vector similarity search (HVSS) is gaining prominence as a powerful tool for various data science and AI applications. As vector data scales up, in-memory indexes pose a significant challenge due to the substantial increase…

All pairs similarity search is a problem where a set of data objects is given and the task is to find all pairs of objects that have similarity above a certain threshold for a given similarity measure-of-interest. When the number of points…

Information Retrieval · Computer Science 2016-06-29 Aniket Chakrabarti , Srinivasan Parthasarathy

The Indyk-Motwani Locality-Sensitive Hashing (LSH) framework (STOC 1998) is a general technique for constructing a data structure to answer approximate near neighbor queries by using a distribution $\mathcal{H}$ over locality-sensitive hash…

Data Structures and Algorithms · Computer Science 2018-02-19 Tobias Christiani

We present ElasticHash, a novel approach for high-quality, efficient, and large-scale semantic image similarity search. It is based on a deep hashing model to learn hash codes for fine-grained image similarity search in natural images and a…

Computer Vision and Pattern Recognition · Computer Science 2023-05-10 Nikolaus Korfhage , Markus Mühling , Bernd Freisleben

In this work, we report on a novel application of Locality Sensitive Hashing (LSH) to seismic data at scale. Based on the high waveform similarity between reoccurring earthquakes, our application identifies potential earthquakes by…

Computing approximate nearest neighbors in high dimensional spaces is a central problem in large-scale data mining with a wide range of applications in machine learning and data science. A popular and effective technique in computing…

Machine Learning · Computer Science 2019-10-29 Lin Chen , Hossein Esfandiari , Thomas Fu , Vahab S. Mirrokni