English
Related papers

Related papers: HyperMinHash: MinHash in LogLog space

200 papers

Large-scale software systems generate vast volumes of system logs that are essential for monitoring, diagnosing, and performance optimization. However, the unstructured nature and ever-growing scale of these logs present significant…

Software Engineering · Computer Science 2025-04-04 Shu-Wei Huang , Xingfang Wu , Heng Li

We present jump consistent hash, a fast, minimal memory, consistent hash algorithm that can be expressed in about 5 lines of code. In comparison to the algorithm of Karger et al., jump consistent hash requires no storage, is faster, and…

Data Structures and Algorithms · Computer Science 2014-06-10 John Lamping , Eric Veach

Hashing-based methods seek compact and efficient binary codes that preserve the neighborhood structure in the original data space. For most existing hashing methods, an image is first encoded as a vector of hand-crafted visual feature,…

Computer Vision and Pattern Recognition · Computer Science 2015-07-17 Guoqiang Zhong , Pan Yang , Sijiang Wang , Junyu Dong

With the advantage of low storage cost and high efficiency, hashing learning has received much attention in the domain of Big Data. In this paper, we propose a novel unsupervised hashing learning method to cope with this open problem to…

Computer Vision and Pattern Recognition · Computer Science 2020-09-29 Jun Yu , Xiao-Jun Wu

Data sketches are a set of widely used approximated data summarizing techniques. Their fundamental property is sub-linear memory complexity on the input cardinality, an important aspect when processing streams or data sets with a vast base…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-21 Amit Kulkarni , Monica Chiosa , Thomas B. Preußer , Kaan Kara , David Sidler , Gustavo Alonso

Hashing methods have been widely used for efficient similarity retrieval on large scale image database. Traditional hashing methods learn hash functions to generate binary codes from hand-crafted features, which achieve limited accuracy…

Computer Vision and Pattern Recognition · Computer Science 2017-11-08 Jian Zhang , Yuxin Peng

As a crucial approach for compact representation learning, hashing has achieved great success in effectiveness and efficiency. Numerous heuristic Hamming space metric learning objectives are designed to obtain high-quality hash codes.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Xiaosu Zhu , Jingkuan Song , Yu Lei , Lianli Gao , Heng Tao Shen

This work focuses on representing very high-dimensional global image descriptors using very compact 64-1024 bit binary hashes for instance retrieval. We propose DeepHash: a hashing scheme based on deep networks. Key to making DeepHash work…

Computer Vision and Pattern Recognition · Computer Science 2016-02-17 Jie Lin , Olivier Morere , Vijay Chandrasekhar , Antoine Veillard , Hanlin Goh

Introduction. Distributed data processing and storage systems require efficient methods to distribute keys across buckets. While simple and fast, the traditional modulo-based mapping is unstable when the number of buckets changes, leading…

Data Structures and Algorithms · Computer Science 2025-11-11 Otmar Ertl

Counting the number of distinct elements on a set is needed in many applications, for example to track the number of unique users in Internet services or the number of distinct flows on a network. In many cases, an estimate rather than the…

Cryptography and Security · Computer Science 2020-11-23 Pedro Reviriego , Pablo Adell , Daniel Ting

Similarity-based image hashing represents crucial technique for visual data storage reduction and expedited image search. Conventional hashing schemes typically feed hand-crafted features into hash functions, which separates the procedures…

Computer Vision and Pattern Recognition · Computer Science 2016-08-15 Yadong Mu , Zhu Liu

One-way hash chains have been used in many micropayment schemes due to their simplicity and efficiency. In this paper we introduce the notion of multi-dimensional hash chains, which is a new generalization of traditional one-way hash…

Cryptography and Security · Computer Science 2007-05-23 Quan Son Nguyen

We aim to speed up approximate keyword matching by storing a lightweight, fixed-size block of data for each string, called a fingerprint. These work in a similar way to hash values; however, they can be also used for matching with errors.…

Data Structures and Algorithms · Computer Science 2017-11-27 Aleksander Cisłak , Szymon Grabowski

We study wear-leveling techniques for cuckoo hashing, showing that it is possible to achieve a memory wear bound of $\log\log n+O(1)$ after the insertion of $n$ items into a table of size $Cn$ for a suitable constant $C$ using cuckoo…

Data Structures and Algorithms · Computer Science 2014-04-02 David Eppstein , Michael T. Goodrich , Michael Mitzenmacher , Paweł Pszona

A minimal perfect hash function (MPHF) maps a set of n keys to unique positions {1, ..., n}. Representing an MPHF requires at least 1.44 bits per key. ShockHash is a technique to construct an MPHF and requires just slightly more space. It…

Data Structures and Algorithms · Computer Science 2025-07-03 Stefan Hermann

This work presents new cardinality estimation methods for data sets recorded by HyperLogLog sketches. A simple derivation of the original estimator was found, that also gives insight how to correct its deficiencies. The result is an…

Data Structures and Algorithms · Computer Science 2017-06-23 Otmar Ertl

A Monotone Minimal Perfect Hash Function (MMPHF) constructed on a set S of keys is a function that maps each key in S to its rank. On keys not in S, the function returns an arbitrary value. Applications range from databases, search engines,…

Data Structures and Algorithms · Computer Science 2023-08-31 Paolo Ferragina , Hans-Peter Lehmann , Peter Sanders , Giorgio Vinciguerra

As hashing becomes an increasingly appealing technique for large-scale image retrieval, multi-label hashing is also attracting more attention for the ability to exploit multi-level semantic contents. In this paper, we propose a novel deep…

Computer Vision and Pattern Recognition · Computer Science 2021-02-03 Cheng Ma , Jiwen Lu , Jie Zhou

With advances in multimedia technologies and the proliferation of smart phone, digital cameras, storage devices, there are a rapidly growing massive amount of multimedia data collected in many applications such as multimedia retrieval and…

Multimedia · Computer Science 2018-08-16 Chengyuan Zhang , Yunwu Lin , Lei Zhu , XinPan Yuan , Jun Long , Fang Huang

Minwise hashing is a fundamental and one of the most successful hashing algorithm in the literature. Recent advances based on the idea of densification~\cite{Proc:OneHashLSH_ICML14,Proc:Shrivastava_UAI14} have shown that it is possible to…

Data Structures and Algorithms · Computer Science 2017-03-16 Anshumali Shrivastava