English
Related papers

Related papers: Perfect Hashing for Data Management Applications

200 papers

Many real world problems require fast and efficient lexical comparison of large numbers of short text strings. Search personalization is one such domain. We introduce the use of feature bit vectors using the hashing trick for improving…

Information Retrieval · Computer Science 2019-10-22 Braddock Gaskill

Hash tables are an essential data-structure for numerous networking applications (e.g., connection tracking, firewalls, network address translators). Among these, cuckoo hash tables provide excellent performance by allowing lookups to be…

Networking and Internet Architecture · Computer Science 2017-12-29 Nicolas Le Scouarnec

Hashing has been widely used for large-scale search due to its low storage cost and fast query speed. By using supervised information, supervised hashing can significantly outperform unsupervised hashing. Recently, discrete supervised…

Information Retrieval · Computer Science 2018-10-17 Qing-Yuan Jiang , Xue Cui , Wu-Jun Li

This paper establishes the theoretical framework of b-bit minwise hashing. The original minwise hashing method has become a standard technique for estimating set similarity (e.g., resemblance) with applications in information retrieval,…

Data Structures and Algorithms · Computer Science 2009-10-20 Ping Li , Arnd Christian Konig

Cuckoo hashing with a stash is a robust multiple choice hashing scheme with high memory utilization that can be used in many network device applications. Unfortunately, for memory loads beyond 0.5, little is known on its performance. In…

Data Structures and Algorithms · Computer Science 2011-08-10 Yossi Kanizo , David Hay , Isaac Keslassy

Locality-sensitive hashing (LSH) is an effective randomized technique widely used in many machine learning tasks. The cost of hashing is proportional to data dimensions, and thus often the performance bottleneck when dimensionality is high…

Machine Learning · Computer Science 2023-09-28 Zongyuan Tan , Hongya Wang , Bo Xu , Minjie Luo , Ming Du

We show an optimal data-dependent hashing scheme for the approximate near neighbor problem. For an $n$-point data set in a $d$-dimensional space our data structure achieves query time $O(d n^{\rho+o(1)})$ and space $O(n^{1+\rho+o(1)} +…

Data Structures and Algorithms · Computer Science 2015-07-17 Alexandr Andoni , Ilya Razenshteyn

Quantum computing has evolved quickly in recent years and is showing significant benefits in a variety of fields, especially in the realm of cybersecurity. The combination of software used to locate the most frequent hashes and $n$-grams…

Quantum Physics · Physics 2022-05-09 Nicholas R. Allgood , Charles K. Nicholas

A recent work shows how we can optimize a tree based mode of operation for a rate 1 hash function. In particular, an algorithm and a theorem are presented for selecting a good tree topology in order to optimize both the running time and the…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-04-15 Kevin Atighehchi

Recent years have seen more and more demand for a unified framework to address multiple realistic image retrieval tasks concerning both category and attributes. Considering the scale of modern datasets, hashing is favorable for its low…

Computer Vision and Pattern Recognition · Computer Science 2016-07-20 Haomiao Liu , Ruiping Wang , Shiguang Shan , Xilin Chen

The computation of a peeling order in a randomly generated hypergraph is the most time-consuming step in a number of constructions, such as perfect hashing schemes, random $r$-SAT solvers, error-correcting codes, and approximate set…

Data Structures and Algorithms · Computer Science 2013-12-03 Djamal Belazzougui , Paolo Boldi , Giuseppe Ottaviano , Rossano Venturini , Sebastiano Vigna

One way to find closest pairs in large datasets is to use hash functions. In recent years locality-sensitive hash functions for various metrics have been given: projecting an n-cube onto k bits is simple hash function that performs well. In…

Information Theory · Computer Science 2009-10-15 Daniel M. Gordon , Victor Miller , Peter Ostapenko

For nearly six decades, the central open question in the study of hash tables has been to determine the optimal achievable tradeoff curve between time and space. State-of-the-art hash tables offer the following guarantee: If keys/values are…

Data Structures and Algorithms · Computer Science 2021-11-05 Michael A. Bender , Martín Farach-Colton , John Kuszmaul , William Kuszmaul , Mingmou Liu

Feature hashing, also known as {\em the hashing trick}, introduced by Weinberger et al. (2009), is one of the key techniques used in scaling-up machine learning algorithms. Loosely speaking, feature hashing uses a random sparse projection…

Machine Learning · Computer Science 2018-05-23 Casper Benjamin Freksen , Lior Kamma , Kasper Green Larsen

This paper presents an efficient wait-free resizable hash table. To achieve high throughput at large core counts, our algorithm is specifically designed to retain the natural parallelism of concurrent hashing, while providing wait-free…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-04-21 Panagiota Fatourou , Nikolaos D. Kallimanis , Thomas Ropars

We revisit the classical problem of designing optimally efficient cryptographically secure hash functions. Hash functions are traditionally designed via applying modes of operation on primitives with smaller domains. The results of…

Cryptography and Security · Computer Science 2021-05-24 Elena Andreeva , Rishiraj Bhattacharyya , Arnab Roy

Relational datasets are being generated at an alarmingly rapid rate across organizations and industries. Compressing these datasets could significantly reduce storage and archival costs. Traditional compression algorithms, e.g., gzip, are…

Databases · Computer Science 2016-06-21 Yihan Gao , Aditya Parameswaran

Hashing techniques are in great demand for a wide range of real-world applications such as image retrieval and network compression. Nevertheless, existing approaches could hardly guarantee a satisfactory performance with the extremely…

Information Retrieval · Computer Science 2020-02-13 Yadan Luo , Zi Huang , Yang Li , Fumin Shen , Yang Yang , Peng Cui

Most cloud services and distributed applications rely on hashing algorithms that allow dynamic scaling of a robust and efficient hash table. Examples include AWS, Google Cloud and BitTorrent. Consistent and rendezvous hashing are algorithms…

Data Structures and Algorithms · Computer Science 2022-05-17 Mike Heddes , Igor Nunes , Tony Givargis , Alexandru Nicolau , Alex Veidenbaum

The family of Information Dispersal Algorithms is applied to distributed systems for secure and reliable storage and transmission. In comparison with perfect secret sharing it achieves a significantly smaller memory overhead and better…

Cryptography and Security · Computer Science 2017-05-30 Katarzyna Kapusta , Gerard Memmi , Hassan Noura