English
Related papers

Related papers: PTHash: Revisiting FCH Minimal Perfect Hashing

200 papers

With advances in multimedia technologies and the proliferation of smart phone, digital cameras, storage devices, there are a rapidly growing massive amount of multimedia data collected in many applications such as multimedia retrieval and…

Multimedia · Computer Science 2018-08-16 Chengyuan Zhang , Yunwu Lin , Lei Zhu , XinPan Yuan , Jun Long , Fang Huang

In their seminal work, Broder \textit{et. al.}~\citep{BroderCFM98} introduces the $\mathrm{minHash}$ algorithm that computes a low-dimensional sketch of high-dimensional binary data that closely approximates pairwise Jaccard similarity.…

Machine Learning · Computer Science 2023-08-23 Rameshwar Pratap , Raghav Kulkarni

We present an I/O-efficient algorithm for computing similarity joins based on locality-sensitive hashing (LSH). In contrast to the filtering methods commonly suggested our method has provable sub-quadratic dependency on the data size.…

Data Structures and Algorithms · Computer Science 2017-03-29 Rasmus Pagh , Ninh Pham , Francesco Silvestri , Morten Stöckel

In this paper we present an algorithm to compute keyed hash function (message authentication code MAC). Our approach uses a family of expander graphs of large girth denoted $D(n,q)$, where $n$ is a natural number bigger than one and $q$ is…

Combinatorics · Mathematics 2019-03-18 Eustrat Zhupa , Monika K. Polak

Minwise hashing (Minhash) is a widely popular indexing scheme in practice. Minhash is designed for estimating set resemblance and is known to be suboptimal in many applications where the desired measure is set overlap (i.e., inner product…

Machine Learning · Statistics 2014-11-17 Anshumali Shrivastava , Ping Li

We propose a new and easily-realizable distributed hash table (DHT) peer-to-peer structure, incorporating a random caching strategy that allows for {\em polylogarithmic search time} while having only a {\em constant cache} size. We also…

Networking and Internet Architecture · Computer Science 2007-05-23 Nima Sarshar , Vwani Roychowdhury

This paper presents a new algorithm for calculating hash signatures of sets which can be directly used for Jaccard similarity estimation. The new approach is an improvement over the MinHash algorithm, because it has a better runtime…

Data Structures and Algorithms · Computer Science 2017-06-20 Otmar Ertl

String matching is the problem of finding all the substrings of a text which match a given pattern. It is one of the most investigated problems in computer science, mainly due to its very diverse applications in several fields. Recently,…

Data Structures and Algorithms · Computer Science 2017-07-04 Domenico Cantone , Simone Faro , Arianna Pavone

Nearest neighbors search is a fundamental problem in various research fields like machine learning, data mining and pattern recognition. Recently, hashing-based approaches, e.g., Locality Sensitive Hashing (LSH), are proved to be effective…

Information Retrieval · Computer Science 2012-05-15 Yue Lin , Deng Cai , Cheng Li

We present a powerful new loss function and training scheme for learning binary hash codes with any differentiable model and similarity function. Our loss function improves over prior methods by using log likelihood loss on top of an…

Machine Learning · Computer Science 2018-10-03 Martin Loncaric , Bowei Liu , Ryan Weber

Bytewise approximate matching algorithms have in recent years shown significant promise in de- tecting files that are similar at the byte level. This is very useful for digital forensic investigators, who are regularly faced with the…

Cryptography and Security · Computer Science 2022-11-15 David Lillis , Frank Breitinger , Mark Scanlon

We study explicit constructions of min-wise hash families and their extension to $k$-min-wise hash families. Informally, a min-wise hash family guarantees that for any fixed subset $X\subseteq[N]$, every element in $X$ has an equal chance…

Data Structures and Algorithms · Computer Science 2025-11-11 Xue Chen , Shengtang Huang , Xin Li

The Cartesian-tree pattern matching is a recently introduced scheme of pattern matching that detects fragments in a sequential data stream which have a similar structure as a query pattern. Formally, Cartesian-tree pattern matching seeks…

Data Structures and Algorithms · Computer Science 2021-08-17 Akio Nishimoto , Noriki Fujisato , Yuto Nakashima , Shunsuke Inenaga

Addressing the challenge of balancing security and efficiency when deploying machine learning systems in untrusted environments, such as federated learning, remains a critical concern. A promising strategy to tackle this issue involves…

Cryptography and Security · Computer Science 2023-12-29 Dongfang Zhao

Vulnerability of dedicated hash functions to various attacks has made the task of designing hash function much more challenging. This provides us a strong motivation to design a new cryptographic hash function viz. HF-hash. This is a hash…

Cryptography and Security · Computer Science 2010-07-21 Dhananjoy Dey , Prasanna Raghaw Mishra , Indranath Sengupta

The $c$-approximate Near Neighbor problem in high dimensional spaces has been mainly addressed by Locality Sensitive Hashing (LSH), which offers polynomial dependence on the dimension, query time sublinear in the size of the dataset, and…

Computational Geometry · Computer Science 2016-12-23 Georgia Avarikioti , Ioannis Z. Emiris , Ioannis Psarros , Georgios Samaras

Image similarity measures play an important role in nearest neighbor search and duplicate detection for large-scale image datasets. Recently, Minwise Hashing (or Minhash) and its related hashing algorithms have achieved great performances…

Multimedia · Computer Science 2018-07-11 Jun Long , Qunfeng Liu , Xinpan Yuan , Chengyuan Zhang , Junfeng Liu

Finding similar images is a necessary operation in many multimedia applications. Images are often represented and stored as a set of high-dimensional features, which are extracted using localized feature extraction algorithms. Locality…

Multimedia · Computer Science 2020-10-16 Omid Jafari , Parth Nagarkar , Jonathan Montaño

Code retrieval, which retrieves code snippets based on users' natural language descriptions, is widely used by developers and plays a pivotal role in real-world software development. The advent of deep learning has shifted the retrieval…

Software Engineering · Computer Science 2024-12-17 Wenchao Gu , Ensheng Shi , Yanlin Wang , Lun Du , Shi Han , Hongyu Zhang , Dongmei Zhang , Michael R. Lyu

Minwise hashing (MinHash) is a standard algorithm widely used in the industry, for large-scale search and learning applications with the binary (0/1) Jaccard similarity. One common use of MinHash is for processing massive n-gram text…

Machine Learning · Statistics 2023-06-14 Xiaoyun Li , Ping Li