English
Related papers

Related papers: Invertible Bloom Lookup Tables

200 papers

We extend the idea of word pieces in natural language models to machine learning tasks on opaque ids. This is achieved by applying hash functions to map each id to multiple hash tokens in a much smaller space, similarly to a Bloom filter.…

Machine Learning · Computer Science 2020-02-13 John Anderson , Qingqing Huang , Walid Krichene , Steffen Rendle , Li Zhang

Set queries are fundamental operations in computer systems and applications.This paper addresses the fundamental problem of designing a probabilistic data structure that can quickly process set queries using a small amount of memory. We…

Data Structures and Algorithms · Computer Science 2016-03-23 Tong Yang , Alex X. Liu , Muhammad Shahzad , Yuankun Zhong , Qiaobin Fu , Zi Li , Gaogang Xie , Xiaoming Li

Bloom Filters are a fundamental and pervasive data structure. Within the growing area of Learned Data Structures, several Learned versions of Bloom Filters have been considered, yielding advantages over classic Filters. Each of them uses a…

Machine Learning · Computer Science 2021-12-14 Giacomo Fumagalli , Davide Raimondi , Raffaele Giancarlo , Dario Malchiodi , Marco Frasca

We present a method that uses a Bloom filter transform to preprocess data for machine learning. Each sample is encoded into a compact bit-array representation using hash-based encoding, producing a fixed-length feature space that reduces…

Machine Learning · Computer Science 2026-05-11 John Cartmell , Mihaela Cardei , Ionut Cardei

Imagine handling collisions in a hash table by storing, in each cell, the bit-wise exclusive-or of the set of keys hashing there. This appears to be a terrible idea: For $\alpha n$ keys and $n$ buckets, where $\alpha$ is constant, we expect…

Data Structures and Algorithms · Computer Science 2022-11-08 Jakob Bæk Tejs Houen , Rasmus Pagh , Stefan Walzer

Bloom filters are used in query processing to perform early data reduction and improve query performance. The optimal query plan may be different when Bloom filters are used, indicating the need for Bloom filter-aware query optimization. To…

Databases · Computer Science 2025-05-07 Tim Zeyl , Qi Cheng , Reza Pournaghi , Jason Lam , Weicheng Wang , Calvin Wong , Chong Chen , Per-Ake Larson

The main contribution of this paper is the development of a new decision tree algorithm. The proposed approach allows users to guide the algorithm through the data partitioning process. We believe this feature has many applications but in…

Machine Learning · Statistics 2020-10-27 Cédric Beaulac , Jeffrey S. Rosenthal

Big Data is the most popular emerging trends that becomes a blessing for human kinds and it is the necessity of day-to-day life. For example, Facebook. Every person involves with producing data either directly or indirectly. Thus, Big Data…

Databases · Computer Science 2019-03-18 Ripon Patgiri , Sabuzima Nayak , Samir Kumar Borgohain

Bloom filters (BF) are widely used for approximate membership queries over a set of elements. BF variants allow removals, sets of unbounded size or querying a sliding window over an unbounded stream. However, for this last case the best…

Data Structures and Algorithms · Computer Science 2020-01-10 Ariel Shtul , Carlos Baquero , Paulo Sérgio Almeida

As users migrate information to cloud storage, many distributed cloud-based services use multiple loosely consistent replicas of user information to avoid the high overhead of more tightly coupled synchronization. Periodically, the…

Data Structures and Algorithms · Computer Science 2015-04-23 Michael Mitzenmacher , Rasmus Pagh

The Bloom filter (BF) is a space efficient randomized data structure particularly suitable to represent a set supporting approximate membership queries. BFs have been extensively used in many applications especially in networking due to…

Data Structures and Algorithms · Computer Science 2016-03-04 Laura Carrea , Alexei Vernitski , Martin Reed

Most research on data discovery has so far focused on improving individual discovery operators such as join, correlation, or union discovery. However, in practice, a combination of these techniques and their corresponding indexes may be…

Databases · Computer Science 2024-12-02 Mahdi Esmailoghli , Christoph Schnell , Renée J. Miller , Ziawasch Abedjan

Filters (such as Bloom Filters) are data structures that speed up network routing and measurement operations by storing a compressed representation of a set. Filters are space efficient, but can make bounded one-sided errors: with tunable…

Data Structures and Algorithms · Computer Science 2021-05-25 Tsvi Kopelowitz , Samuel McCauley , Ely Porat

Filters such as Bloom, quotient, and cuckoo filters are fundamental building blocks providing space-efficient approximate set membership testing. However, many applications need to associate small values with keys-functionality that filters…

Data Structures and Algorithms · Computer Science 2025-10-08 Michael A. Bender , Alex Conway , Martín Farach-Colton , Rob Johnson , Prashant Pandey

We consider the hashing of a set $X\subseteq U$ with $|X|=m$ using a simple tabulation hash function $h:U\to [n]=\{0,\dots,n-1\}$ and analyse the number of non-empty bins, that is, the size of $h(X)$. We show that the expected size of…

Data Structures and Algorithms · Computer Science 2018-11-01 Anders Aamand , Mikkel Thorup

We start by summarizing the recently proposed implementation of the first non-blocking concurrent interpolation search tree (C-IST) data structure. We then analyze the individual operations of the C-IST, and show that they are correct and…

Data Structures and Algorithms · Computer Science 2020-01-03 Aleksandar Prokopec , Trevor Brown , Dan Alistarh

Bloom Filters are a space-efficient data structure used for the testing of membership in a set that errs only in the False Positive direction. However, the standard analysis that measures this False Positive rate provides a form of worst…

Data Structures and Algorithms · Computer Science 2024-02-06 Kahlil Dozier , Loqman Salamatian , Dan Rubenstein

Recent work has suggested enhancing Bloom filters by using a pre-filter, based on applying machine learning to model the data set the Bloom filter is meant to represent. Here we model such learned Bloom filters, clarifying what guarantees…

Data Structures and Algorithms · Computer Science 2018-02-06 Michael Mitzenmacher

In a partitioned Bloom Filter the $m$ bit vector is split into $k$ disjoint $m/k$ sized parts, one per hash function. Contrary to hardware designs, where they prevail, software implementations mostly adopt standard Bloom filters,…

Data Structures and Algorithms · Computer Science 2022-11-10 Paulo Sérgio Almeida

Privacy-preserving record linkage with Bloom filters has become increasingly popular in medical applications, since Bloom filters allow for probabilistic linkage of sensitive personal data. However, since evidence indicates that Bloom…

Cryptography and Security · Computer Science 2014-10-27 Martin Kroll , Simone Steinmetzer