English
Related papers

Related papers: A Review for Weighted MinHash Algorithms

200 papers

We present a suite of algorithms for Dimension Independent Similarity Computation (DISCO) to compute all pairwise similarities between very high dimensional sparse vectors. All of our results are provably independent of dimension, meaning…

Data Structures and Algorithms · Computer Science 2013-05-24 Reza Bosagh Zadeh , Ashish Goel

Recent advancement of the WWW, IOT, social network, e-commerce, etc. have generated a large volume of data. These datasets are mostly represented by high dimensional and sparse datasets. Many fundamental subroutines of common data analytic…

Information Retrieval · Computer Science 2019-10-11 Rameshwar Pratap , Debajyoti Bera , Karthik Revanuru

for representing, characterizing, and modeling an ample range of structures and phenomena from both theoretical and applied perspectives. The present work describes the application of the recently introduced real-valued Jaccard and…

Physics and Society · Physics 2021-11-23 Luciano da F. Costa

Binary codes have been widely used in vision problems as a compact feature representation to achieve both space and time advantages. Various methods have been proposed to learn data-dependent hash functions which map a feature vector to a…

Computer Vision and Pattern Recognition · Computer Science 2014-10-22 Jie Feng , Wei Liu , Yan Wang

Similarity-based image hashing represents crucial technique for visual data storage reduction and expedited image search. Conventional hashing schemes typically feed hand-crafted features into hash functions, which separates the procedures…

Computer Vision and Pattern Recognition · Computer Science 2016-08-15 Yadong Mu , Zhu Liu

We develop a scalable algorithm to learn binary hash codes for indexing large-scale datasets. Near-isometric binary hashing (NIBH) is a data-dependent hashing scheme that quantizes the output of a learned low-dimensional embedding to obtain…

Data Structures and Algorithms · Computer Science 2016-03-15 Amirali Aghazadeh , Andrew Lan , Anshumali Shrivastava , Richard Baraniuk

Weighted minwise hashing (WMH) is one of the fundamental subroutine, required by many celebrated approximation algorithms, commonly adopted in industrial practice for large scale-search and learning. The resource bottleneck of the…

Data Structures and Algorithms · Computer Science 2016-02-29 Anshumali Shrivastava

Nearest neighbors search is a fundamental problem in various research fields like machine learning, data mining and pattern recognition. Recently, hashing-based approaches, e.g., Locality Sensitive Hashing (LSH), are proved to be effective…

Information Retrieval · Computer Science 2012-05-15 Yue Lin , Deng Cai , Cheng Li

We study the problem of computing similarity joins under edit distance on a set of strings. Edit similarity joins is a fundamental problem in databases, data mining and bioinformatics. It finds important applications in data cleaning and…

Databases · Computer Science 2019-05-30 Haoyu Zhang , Qin Zhang

Semantic hashing represents documents as compact binary vectors (hash codes) and allows both efficient and effective similarity search in large-scale information retrieval. The state of the art has primarily focused on learning hash codes…

Information Retrieval · Computer Science 2021-03-29 Christian Hansen , Casper Hansen , Jakob Grue Simonsen , Stephen Alstrup , Christina Lioma

Hashing has been widely adopted for large-scale data retrieval in many domains, due to its low storage cost and high retrieval speed. Existing cross-modal hashing methods optimistically assume that the correspondence between training…

Machine Learning · Computer Science 2019-05-30 Xuanwu Liu , Jun Wang , Guoxian Yu , Carlotta Domeniconi , Xiangliang Zhang

Locality-sensitive hashing (LSH) is an effective randomized technique widely used in many machine learning tasks. The cost of hashing is proportional to data dimensions, and thus often the performance bottleneck when dimensionality is high…

Machine Learning · Computer Science 2023-09-28 Zongyuan Tan , Hongya Wang , Bo Xu , Minjie Luo , Ming Du

Large-scale cross-modal hashing similarity retrieval has attracted more and more attention in modern search applications such as search engines and autopilot, showing great superiority in computation and storage. However, current…

Computer Vision and Pattern Recognition · Computer Science 2020-01-01 Lu Wang , Jie Yang

Jaccard Similarity is a very common proximity measurement used to compute the similarity between two asymmetric binary vectors. Jaccard Similarity is the ratio between the 1s (Intersection of two vectors) to 1s (Union of two vectors). This…

Data Structures and Algorithms · Computer Science 2024-08-20 Varun Puram , Ruthvik Rao Bobbili , Johnson P Thomas

Hashing is at the heart of large-scale image similarity search, and recent methods have been substantially improved through deep learning techniques. Such algorithms typically learn continuous embeddings of the data. To avoid a subsequent…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Lucas R. Schwengber , Lucas Resende , Paulo Orenstein , Roberto I. Oliveira

Similarity joins are important operations with a broad range of applications. In this paper, we study the problem of vector similarity join size estimation (VSJ). It is a generalization of the previously studied set similarity join size…

Databases · Computer Science 2011-04-19 Hongrae Lee , Raymond T. Ng , Kyuseok Shim

Finding similar images is a necessary operation in many multimedia applications. Images are often represented and stored as a set of high-dimensional features, which are extracted using localized feature extraction algorithms. Locality…

Multimedia · Computer Science 2020-10-16 Omid Jafari , Parth Nagarkar , Jonathan Montaño

Binary hashing is a well-known approach for fast approximate nearest-neighbor search in information retrieval. Much work has focused on affinity-based objective functions involving the hash functions or binary codes. These objective…

Machine Learning · Computer Science 2016-02-05 Miguel Á. Carreira-Perpiñán , Ramin Raziperchikolaei

The explosive growth in big data has attracted much attention in designing efficient indexing and search methods recently. In many critical applications such as large-scale search and pattern matching, finding the nearest neighbors to a…

Machine Learning · Computer Science 2015-09-21 Jun Wang , Wei Liu , Sanjiv Kumar , Shih-Fu Chang

Nearest neighbor search is fundamental to a wide range of applications. Since the exact nearest neighbor search suffers from the "curse of dimensionality", approximate approaches, such as Locality-Sensitive Hashing (LSH), are widely used to…

Databases · Computer Science 2021-04-14 Huan Hu , Jianzhong Li