中文
相关论文

相关论文: C-MinHash: Practically Reducing Two Permutations t…

200 篇论文

Minhashing is a technique used to estimate the Jaccard Index between two sets by exploiting the probability of collision in a random permutation. In order to speed up the computation, a random permutation can be approximated by using an…

机器学习 · 计算机科学 2014-01-25 Fabricio Olivetti de Franca

Image similarity measures play an important role in nearest neighbor search and duplicate detection for large-scale image datasets. Recently, Minwise Hashing (or Minhash) and its related hashing algorithms have achieved great performances…

多媒体 · 计算机科学 2018-07-11 Jun Long , Qunfeng Liu , Xinpan Yuan , Chengyuan Zhang , Junfeng Liu

Binary code similarity analysis (BCSA) is a crucial research area in many fields such as cybersecurity. Specifically, function-level diffing tools are the most widely used in BCSA: they perform function matching one by one for evaluating…

密码学与安全 · 计算机科学 2025-06-16 Zhijie Liu , Qiyi Tang , Sen Nie , Shi Wu , Liang Feng Zhang , Yutian Tang

The existing work on densification of one permutation hashing reduces the query processing cost of the $(K,L)$-parameterized Locality Sensitive Hashing (LSH) algorithm with minwise hashing, from $O(dKL)$ to merely $O(d + KL)$, where $d$ is…

统计方法学 · 统计学 2014-06-19 Anshumali Shrivastava , Ping Li

Perfect hash functions can potentially be used to compress data in connection with a variety of data management tasks. Though there has been considerable work on how to construct good perfect hash functions, there is a gap between theory…

数据结构与算法 · 计算机科学 2007-05-23 Fabiano C. Botelho , Rasmus Pagh , Nivio Ziviani

We study explicit constructions of min-wise hash families and their extension to $k$-min-wise hash families. Informally, a min-wise hash family guarantees that for any fixed subset $X\subseteq[N]$, every element in $X$ has an equal chance…

数据结构与算法 · 计算机科学 2025-11-11 Xue Chen , Shengtang Huang , Xin Li

Document sketching using Jaccard similarity has been a workable effective technique in reducing near-duplicates in Web page and image search results, and has also proven useful in file system synchronization, compression and learning…

数据结构与算法 · 计算机科学 2014-10-17 Bernhard Haeupler , Mark Manasse , Kunal Talwar

Weighted minwise hashing (WMH) is one of the fundamental subroutine, required by many celebrated approximation algorithms, commonly adopted in industrial practice for large scale-search and learning. The resource bottleneck of the…

数据结构与算法 · 计算机科学 2016-02-29 Anshumali Shrivastava

MinHash and SimHash are the two widely adopted Locality Sensitive Hashing (LSH) algorithms for large-scale data processing applications. Deciding which LSH to use for a particular problem at hand is an important question, which has no clear…

统计计算 · 统计学 2014-07-17 Anshumali Shrivastava , Ping Li

Many hashing algorithms including minwise hashing (MinHash), one permutation hashing (OPH), and consistent weighted sampling (CWS) generate integers of $B$ bits. With $k$ hashes for each data vector, the storage would be $B\times k$ bits;…

机器学习 · 计算机科学 2023-06-29 Ping Li , Weijie Zhao

It is shown that for cuckoo hashing with a stash as proposed by Kirsch, Mitzenmacher, and Wieder (2008) families of very simple hash functions can be used, maintaining the favorable performance guarantees: with stash size $s$ the…

数据结构与算法 · 计算机科学 2012-04-20 Martin Aumüller , Martin Dietzfelbinger , Philipp Woelfel

Given a set $S$ of $n$ keys, a perfect hash function for $S$ maps the keys in $S$ to the first $m \geq n$ integers without collisions. It may return an arbitrary result for any key not in $S$ and is called minimal if $m = n$. The most…

数据结构与算法 · 计算机科学 2026-02-06 Hans-Peter Lehmann , Thomas Mueller , Rasmus Pagh , Giulio Ermanno Pibiri , Peter Sanders , Sebastiano Vigna , Stefan Walzer

Randomized algorithms and data structures are often analyzed under the assumption of access to a perfect source of randomness. The most fundamental metric used to measure how "random" a hash function or a random number generator is, is its…

数据结构与算法 · 计算机科学 2015-02-23 Mathias Bæk Tejs Knudsen , Morten Stöckel

Minimal perfect hash functions provide space-efficient and collision-free hashing on static sets. Existing algorithms and implementations that build such functions have practical limitations on the number of input elements they can process,…

数据结构与算法 · 计算机科学 2018-11-06 Antoine Limasset , Guillaume Rizk , Rayan Chikhi , Pierre Peterlongo

A minimal perfect hash function bijectively maps a key set $S$ out of a universe $U$ into the first $|S|$ natural numbers. Minimal perfect hash functions are used, for example, to map irregularly-shaped keys, such as string, in a compact…

数据结构与算法 · 计算机科学 2019-12-03 Emmanuel Esposito , Thomas Mueller Graf , Sebastiano Vigna

Hashing is a basic tool for dimensionality reduction employed in several aspects of machine learning. However, the perfomance analysis is often carried out under the abstract assumption that a truly random unit cost hash function is used,…

机器学习 · 统计学 2017-11-27 Søren Dahlgaard , Mathias Bæk Tejs Knudsen , Mikkel Thorup

Estimating set similarity and detecting highly similar sets are fundamental problems in areas such as databases, machine learning, and information retrieval. MinHash is a well-known technique for approximating Jaccard similarity of sets and…

数据结构与算法 · 计算机科学 2019-05-23 Pinghui Wang , Yiyan Qi , Yuanming Zhang , Qiaozhu Zhai , Chenxu Wang , John C. S. Lui , Xiaohong Guan

Cuckoo hashing [4] is a multiple choice hashing scheme in which each item can be placed in multiple locations, and collisions are resolved by moving items to their alternative locations. In the classical implementation of two-way cuckoo…

数据结构与算法 · 计算机科学 2011-11-16 Ely Porat , Bar Shalem

In a recent paper from SODA11 \cite{kminwise} the authors introduced a general framework for exponential time improvement of \minwise based algorithms by defining and constructing almost \kmin independent family of hash functions. Here we…

数据结构与算法 · 计算机科学 2011-02-18 Guy Feigenblat , Ely Porat , Ariel Shiftan

A deep hashing model typically has two main learning objectives: to make the learned binary hash codes discriminative and to minimize a quantization error. With further constraints such as bit balance and code orthogonality, it is not…

计算机视觉与模式识别 · 计算机科学 2021-09-30 Jiun Tian Hoe , Kam Woh Ng , Tianyu Zhang , Chee Seng Chan , Yi-Zhe Song , Tao Xiang