English
Related papers

Related papers: A Bloom Filter Survey: Variants for Different Doma…

200 papers

We introduce the Deletable Bloom filter (DlBF) as a new spin on the popular data structure based on compactly encoding the information of where collisions happen when inserting elements. The DlBF design enables false-negative-free deletions…

Data Structures and Algorithms · Computer Science 2010-05-04 Christian Esteve Rothenberg , Carlos A. B. Macapuna , Fabio L. Verdi , Mauricio F. Magalhaes

Bloom filters (BF) are widely used for approximate membership queries over a set of elements. BF variants allow removals, sets of unbounded size or querying a sliding window over an unbounded stream. However, for this last case the best…

Data Structures and Algorithms · Computer Science 2020-01-10 Ariel Shtul , Carlos Baquero , Paulo Sérgio Almeida

Dynamic Bloom filters (DBF) were proposed by Guo et. al. in 2010 to tackle the situation where the size of the set to be stored compactly is not known in advance or can change during the course of the application. We propose a novel…

Data Structures and Algorithms · Computer Science 2019-01-23 Sidharth Negi , Ameya Dubey , Amitabha Bagchi , Manish Yadav , Nishant Yadav , Jeetu Raj

Most density based stream clustering algorithms separate the clustering process into an online and offline component. Exact summarized statistics are being employed for defining micro-clusters or grid cells during the online stage followed…

Databases · Computer Science 2016-12-09 Andrei Sorin Sabau

We present a method that uses a Bloom filter transform to preprocess data for machine learning. Each sample is encoded into a compact bit-array representation using hash-based encoding, producing a fixed-length feature space that reduces…

Machine Learning · Computer Science 2026-05-11 John Cartmell , Mihaela Cardei , Ionut Cardei

Recent work suggests improving the performance of Bloom filter by incorporating a machine learning model as a binary classifier. However, such learned Bloom filter does not take full advantage of the predicted probability scores. We…

Data Structures and Algorithms · Computer Science 2019-10-22 Zhenwei Dai , Anshumali Shrivastava

A data analysis pipeline is a structured sequence of steps that transforms raw data into meaningful insights by integrating various analysis algorithms. In this paper, we propose a novel statistical test to assess the significance of data…

Machine Learning · Statistics 2024-10-15 Tomohiro Shiraishi , Tatsuya Matsukawa , Shuichi Nishino , Ichiro Takeuchi

For many networking applications, recent data is more significant than older data, motivating the need for sliding window solutions. Various capabilities, such as DDoS detection and load balancing, require insights about multiple metrics…

Data Structures and Algorithms · Computer Science 2017-12-06 Eran Assaf , Ran Ben Basat , Gil Einziger , Roy Friedman

Set queries are fundamental operations in computer systems and applications.This paper addresses the fundamental problem of designing a probabilistic data structure that can quickly process set queries using a small amount of memory. We…

Data Structures and Algorithms · Computer Science 2016-03-23 Tong Yang , Alex X. Liu , Muhammad Shahzad , Yuankun Zhong , Qiaobin Fu , Zi Li , Gaogang Xie , Xiaoming Li

Recent work has suggested enhancing Bloom filters by using a pre-filter, based on applying machine learning to model the data set the Bloom filter is meant to represent. Here we model such learned Bloom filters, clarifying what guarantees…

Data Structures and Algorithms · Computer Science 2018-02-06 Michael Mitzenmacher

We investigate the multiplicity model with m values of some test statistic independently drawn from a mixture of no effect (null) and positive effect (alternative), where we seek to identify, the alternative test results with a controlled…

Methodology · Statistics 2024-02-06 Zhiwen Jiang , Stephan Morgenthaler

A Bloom filter is a memory-efficient data structure for approximate membership queries used in numerous fields of computer science. Recently, learned Bloom filters that achieve better memory efficiency using machine learning models have…

Data Structures and Algorithms · Computer Science 2023-10-31 Atsuki Sato , Yusuke Matsui

Sampling methods that choose a subset of the data proportional to its diversity in the feature space are popular for data summarization. However, recent studies have noted the occurrence of bias (under- or over-representation of a certain…

Machine Learning · Computer Science 2018-02-13 L. Elisa Celis , Vijay Keswani , Damian Straszak , Amit Deshpande , Tarun Kathuria , Nisheeth K. Vishnoi

One of the most fundamental tasks in data science is to assist a user with unknown preferences in finding high-utility tuples within a large database. To accurately elicit the unknown user preferences, a widely-adopted way is by asking the…

Databases · Computer Science 2023-07-07 Guangyi Zhang , Nikolaj Tatti , Aristides Gionis

Bloom filter is a widely used classic data structure for approximate membership queries. Learned Bloom filters improve memory efficiency by leveraging machine learning, with the partitioned learned Bloom filter (PLBF) being among the most…

Data Structures and Algorithms · Computer Science 2024-10-18 Atsuki Sato , Yusuke Matsui

Filters are ubiquitous in computer science, enabling space-efficient approximate membership testing. Since Bloom filters were introduced in 1970, decades of work improved their space efficiency and performance. Recently, three new paradigms…

Data Structures and Algorithms · Computer Science 2026-02-17 Diandre Miguel Sabale , Wolfgang Gatterbauer , Prashant Pandey

A probabilistic database with attribute-level uncertainty consists of relations where cells of some attributes may hold probability distributions rather than deterministic content. Such databases arise, implicitly or explicitly, in the…

Databases · Computer Science 2022-12-26 Amir Gilad , Aviram Imber , Benny Kimelfeld

Invertible Bloom Filter (IBF) is a data structure, which employs a small set of hash functions. An IBF allows for an efficient insertion and, with high probability, for an efficient extraction of the data. However, the success probability…

Information Theory · Computer Science 2020-08-04 Ivo Kubjas , Vitaly Skachek

Many applications of approximate membership query data structures, or filters, require only an incremental filter that supports insertions but not deletions. However, the design space of incremental filters is missing a "sweet spot" filter…

Data Structures and Algorithms · Computer Science 2022-10-26 Tomer Even , Guy Even , Adam Morrison

Data sets in the form of binary matrices are ubiquitous across scientific domains, and researchers are often interested in identifying and quantifying noteworthy structure. One approach is to compare the observed data to that which might be…

Methodology · Statistics 2020-10-30 Alex Fout , Bailey K. Fosdick , Matthew P. Hitt