English
Related papers

Related papers: BagMinHash - Minwise Hashing Algorithm for Weighte…

200 papers

Traditional minwise hashing (MinHash) requires applying $K$ independent permutations to estimate the Jaccard similarity in massive binary (0/1) data, where $K$ can be (e.g.,) 1024 or even larger, depending on applications. The recent work…

Data Structures and Algorithms · Computer Science 2021-09-13 Xiaoyun Li , Ping Li

Minwise hashing (MinHash) is a classical method for efficiently estimating the Jaccrad similarity in massive binary (0/1) data. To generate $K$ hash values for each data vector, the standard theory of MinHash requires $K$ independent…

Machine Learning · Statistics 2021-11-19 Xiaoyun Li , Ping Li

Semantic hashing represents documents as compact binary vectors (hash codes) and allows both efficient and effective similarity search in large-scale information retrieval. The state of the art has primarily focused on learning hash codes…

Information Retrieval · Computer Science 2021-03-29 Christian Hansen , Casper Hansen , Jakob Grue Simonsen , Stephen Alstrup , Christina Lioma

In this paper, we first demonstrate that b-bit minwise hashing, whose estimators are positive definite kernels, can be naturally integrated with learning algorithms such as SVM and logistic regression. We adopt a simple scheme to transform…

Machine Learning · Statistics 2011-06-07 Ping Li , Anshumali Shrivastava , Joshua Moore , Arnd Christian Konig

Semantic Hashing is a popular family of methods for efficient similarity search in large-scale datasets. In Semantic Hashing, documents are encoded as short binary vectors (i.e., hash codes), such that semantic similarity can be efficiently…

Information Retrieval · Computer Science 2020-07-02 Casper Hansen , Christian Hansen , Jakob Grue Simonsen , Stephen Alstrup , Christina Lioma

We aim to speed up approximate keyword matching by storing a lightweight, fixed-size block of data for each string, called a fingerprint. These work in a similar way to hash values; however, they can be also used for matching with errors.…

Data Structures and Algorithms · Computer Science 2017-11-27 Aleksander Cisłak , Szymon Grabowski

In this paper, we study several critical issues which must be tackled before one can apply b-bit minwise hashing to the volumes of data often used industrial applications, especially in the context of search. 1. (b-bit) Minwise hashing…

Information Retrieval · Computer Science 2012-05-15 Ping Li , Anshumali Shrivastava , Arnd Christian Konig

Weighted Hamming distance, as a similarity measure between binary codes and binary queries, provides superior accuracy in search tasks than Hamming distance. However, how to efficiently and accurately find $K$ binary codes that have the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Zhenyu Weng , Yuesheng Zhu , Ruixin Liu

Recently, the method of b-bit minwise hashing has been applied to large-scale linear learning and sublinear time near-neighbor search. The major drawback of minwise hashing is the expensive preprocessing cost, as the method requires…

Machine Learning · Computer Science 2012-08-08 Ping Li , Art Owen , Cun-Hui Zhang

Given a set $S$ of $n$ keys, a perfect hash function for $S$ maps the keys in $S$ to the first $m \geq n$ integers without collisions. It may return an arbitrary result for any key not in $S$ and is called minimal if $m = n$. The most…

Data Structures and Algorithms · Computer Science 2026-02-06 Hans-Peter Lehmann , Thomas Mueller , Rasmus Pagh , Giulio Ermanno Pibiri , Peter Sanders , Sebastiano Vigna , Stefan Walzer

In their seminal work, Broder \textit{et. al.}~\citep{BroderCFM98} introduces the $\mathrm{minHash}$ algorithm that computes a low-dimensional sketch of high-dimensional binary data that closely approximates pairwise Jaccard similarity.…

Machine Learning · Computer Science 2023-08-23 Rameshwar Pratap , Raghav Kulkarni

Semantic hashing has become a crucial component of fast similarity search in many large-scale information retrieval systems, in particular, for text data. Variational auto-encoders (VAEs) with binary latent variables as hashing codes…

Machine Learning · Computer Science 2020-05-22 Siamak Zamani Dadaneh , Shahin Boluki , Mingzhang Yin , Mingyuan Zhou , Xiaoning Qian

Due to the high storage and search efficiency, hashing has become prevalent for large-scale similarity search. Particularly, deep hashing methods have greatly improved the search performance under supervised scenarios. In contrast,…

Computer Vision and Pattern Recognition · Computer Science 2019-05-10 Erkun Yang , Tongliang Liu , Cheng Deng , Wei Liu , Dacheng Tao

Estimating set similarity and detecting highly similar sets are fundamental problems in areas such as databases, machine learning, and information retrieval. MinHash is a well-known technique for approximating Jaccard similarity of sets and…

Data Structures and Algorithms · Computer Science 2019-05-23 Pinghui Wang , Yiyan Qi , Yuanming Zhang , Qiaozhu Zhai , Chenxu Wang , John C. S. Lui , Xiaohong Guan

With the growth of image on the web, research on hashing which enables high-speed image retrieval has been actively studied. In recent years, various hashing methods based on deep neural networks have been proposed and achieved higher…

Computer Vision and Pattern Recognition · Computer Science 2019-05-23 Yosuke Kaga , Masakazu Fujio , Kenta Takahashi , Tetsushi Ohki , Masakatsu Nishigaki

Bit arrays, or bitmaps, are used to significantly speed up set operations in several areas, such as data warehousing, information retrieval, and data mining, to cite a few. However, bitmaps usually use a large storage space, thus requiring…

Data Structures and Algorithms · Computer Science 2015-03-14 Alessandro Colantonio , Roberto Di Pietro

HalftimeHash is a new algorithm for hashing long strings. The goals are few collisions (different inputs that produce identical output hash values) and high performance. Compared to the fastest universal hash functions on long strings…

Data Structures and Algorithms · Computer Science 2021-04-22 Jim Apple

We study the Min-Weighted Sum Bin Packing problem, a variant of the classical Bin Packing problem in which items have a weight, and each item induces a cost equal to its weight multiplied by the index of the bin in which it is packed. This…

Data Structures and Algorithms · Computer Science 2023-04-06 Guillaume Sagnol

This work focuses on representing very high-dimensional global image descriptors using very compact 64-1024 bit binary hashes for instance retrieval. We propose DeepHash: a hashing scheme based on deep networks. Key to making DeepHash work…

Computer Vision and Pattern Recognition · Computer Science 2016-02-17 Jie Lin , Olivier Morere , Vijay Chandrasekhar , Antoine Veillard , Hanlin Goh

Minimal perfect hash functions provide space-efficient and collision-free hashing on static sets. Existing algorithms and implementations that build such functions have practical limitations on the number of input elements they can process,…

Data Structures and Algorithms · Computer Science 2018-11-06 Antoine Limasset , Guillaume Rizk , Rayan Chikhi , Pierre Peterlongo