English
Related papers

Related papers: A Survey on Locality Sensitive Hashing Algorithms …

200 papers

Approximate Nearest Neighbor Search (ANNS) is a fundamental algorithmic problem, with numerous applications in many areas of computer science. Locality-sensitive hashing (LSH) is one of the most popular solution approaches for ANNS. A…

Databases · Computer Science 2021-03-11 Huayi Wang , Jingfan Meng , Long Gong , Jun Xu , Mitsunori Ogihara

This paper reconsiders common benchmarking approaches to nearest neighbor search. It is shown that the concept of local intrinsic dimensionality (LID) allows to choose query sets of a wide range of difficulty for real-world datasets.…

Information Retrieval · Computer Science 2019-07-18 Martin Aumüller , Matteo Ceccarello

We give new data-dependent locality sensitive hashing schemes (LSH) for the Earth Mover's Distance ($\mathsf{EMD}$), and as a result, improve the best approximation for nearest neighbor search under $\mathsf{EMD}$ by a quadratic factor.…

Data Structures and Algorithms · Computer Science 2024-03-11 Rajesh Jayaram , Erik Waingarten , Tian Zhang

Instance Search (INS) is a fundamental problem for many applications, while it is more challenging comparing to traditional image search since the relevancy is defined at the instance level. Existing works have demonstrated the success of…

Computer Vision and Pattern Recognition · Computer Science 2017-01-30 Jingkuan Song , Tao He , Lianli Gao , Xing Xu , Heng Tao Shen

Recently it was shown that the problem of Maximum Inner Product Search (MIPS) is efficient and it admits provably sub-linear hashing algorithms. Asymmetric transformations before hashing were the key in solving MIPS which was otherwise…

Machine Learning · Statistics 2014-11-14 Anshumali Shrivastava , Ping Li

The advent of the Internet of Things (IoT) has brought forth additional intricacies and difficulties to computer networks. These gadgets are particularly susceptible to cyber-attacks because of their simplistic design. Therefore, it is…

Networking and Internet Architecture · Computer Science 2024-02-14 Nowfel Mashnoor , Jay Thom , Abdur Rouf , Shamik Sengupta , Batyr Charyyev

This paper proposes a binarization scheme for vectors of high dimension based on the recent concept of anti-sparse coding, and shows its excellent performance for approximate nearest neighbor search. Unlike other binarization schemes, this…

Computer Vision and Pattern Recognition · Computer Science 2011-10-27 Hervé Jégou , Teddy Furon , Jean-Jacques Fuchs

Dense high dimensional vectors are becoming increasingly vital in fields such as computer vision, machine learning, and large language models (LLMs), serving as standard representations for multimodal data. Now the dimensionality of these…

Machine Learning · Computer Science 2024-10-10 Zhonghan Chen , Ruiyuan Zhang , Xi Zhao , Xiaojun Cheng , Xiaofang Zhou

We consider the problem of designing locality sensitive hashes (LSH) for inner product similarity, and of the power of asymmetric hashes in this context. Shrivastava and Li argue that there is no symmetric LSH for the problem and propose an…

Machine Learning · Statistics 2015-06-09 Behnam Neyshabur , Nathan Srebro

This paper proposes a new framework for providing approximation guarantees of local search algorithms. Local search is a basic algorithm design technique and is widely used for various combinatorial optimization problems. To analyze local…

Data Structures and Algorithms · Computer Science 2020-06-03 Kaito Fujii

Hashing, or learning binary embeddings of data, is frequently used in nearest neighbor retrieval. In this paper, we develop learning to rank formulations for hashing, aimed at directly optimizing ranking-based evaluation metrics such as…

Machine Learning · Statistics 2018-10-11 Kun He , Fatih Cakir , Sarah Adel Bargal , Stan Sclaroff

Matrix factorization (MF) can extract the low-rank features and integrate the information of the data manifold distribution from high-dimensional data, which can consider the nonlinear neighbourhood information. Thus, MF has drawn wide…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-24 Zixuan Li , Hao Li , Kenli Li , Fan Wu , Lydia Chen , Keqin Li

Hashing has been widely used for efficient similarity search based on its query and storage efficiency. To obtain better precision, most studies focus on designing different objective functions with different constraints or penalty terms…

Data Structures and Algorithms · Computer Science 2018-10-02 Xingbo Liu , Xiushan Nie , Yilong Yin

Hashing technology has been widely used in image retrieval due to its computational and storage efficiency. Recently, deep unsupervised hashing methods have attracted increasing attention due to the high cost of human annotations in the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Qinghong Lin , Xiaojun Chen , Qin Zhang , Shangxuan Tian , Yudong Chen

Nearest-neighbor search, which returns the nearest neighbor of a query point in a set of points, is an important and widely studied problem in many fields, and it has wide range of applications. In many of them, such as sensor databases,…

Computational Geometry · Computer Science 2016-06-02 Pankaj K. Agarwal , Boris Aronov , Sariel Har-Peled , Jeff M. Philips , Ke Yi , Wuzhou Zhang

Empirical evidence suggests that hashing is an effective strategy for dimensionality reduction and practical nonparametric estimation. In this paper we provide exponential tail bounds for feature hashing and show that the interaction…

Artificial Intelligence · Computer Science 2010-02-27 Kilian Weinberger , Anirban Dasgupta , Josh Attenberg , John Langford , Alex Smola

We study the problem of domain search where a domain is a set of distinct values from an unspecified universe. We use Jaccard set containment, defined as $|Q \cap X|/|Q|$, as the relevance measure of a domain $X$ to a query domain $Q$. Our…

Databases · Computer Science 2016-07-26 Erkang Zhu , Fatemeh Nargesian , Ken Q. Pu , Renée J. Miller

Nearest Neighbor Search (NNS) over generalized weighted distances is fundamental to a wide range of applications. The problem of NNS over the generalized weighted square Euclidean distance has been studied in previous work. However,…

Databases · Computer Science 2021-10-19 Huan Hu , Jianzhong Li

Binary Hashing is widely used for effective approximate nearest neighbors search. Even though various binary hashing methods have been proposed, very few methods are feasible for extremely high-dimensional features often used in visual…

Computer Vision and Pattern Recognition · Computer Science 2015-01-30 Kohta Ishikawa , Ikuro Sato , Mitsuru Ambai

The adoption of an appropriate approximate similarity search method is an essential prereq-uisite for developing a fast and efficient CBIR system, especially when dealing with large amount ofdata. In this study we implement a web image…

Computer Vision and Pattern Recognition · Computer Science 2021-05-05 Alessio Schiavo , Filippo Minutella , Mattia Daole , Marsha Gomez Gomez