English
Related papers

Related papers: Bloom Filter Encoding for Machine Learning

200 papers

Big Data is the most popular emerging trends that becomes a blessing for human kinds and it is the necessity of day-to-day life. For example, Facebook. Every person involves with producing data either directly or indirectly. Thus, Big Data…

Databases · Computer Science 2019-03-18 Ripon Patgiri , Sabuzima Nayak , Samir Kumar Borgohain

There is a plethora of data structures, algorithms, and frameworks dealing with major data-stream problems like estimating the frequency of items, answering set membership, association and multiplicity queries, and several other statistics…

Data Structures and Algorithms · Computer Science 2021-06-24 Anes Abdennebi , Kamer Kaya

Feature selection is generally used as one of the most important preprocessing techniques in machine learning, as it helps to reduce the dimensionality of data and assists researchers and practitioners in understanding data. Thereby, by…

Machine Learning · Computer Science 2021-04-26 Yiwen Liao , Raphaël Latty , Bin Yang

Bloom filters are used in query processing to perform early data reduction and improve query performance. The optimal query plan may be different when Bloom filters are used, indicating the need for Bloom filter-aware query optimization. To…

Databases · Computer Science 2025-05-07 Tim Zeyl , Qi Cheng , Reza Pournaghi , Jason Lam , Weicheng Wang , Calvin Wong , Chong Chen , Per-Ake Larson

De Brujin graphs are widely used in bioinformatics for processing next-generation sequencing data. Due to a very large size of NGS datasets, it is essential to represent de Bruijn graphs compactly, and several approaches to this problem…

Data Structures and Algorithms · Computer Science 2013-05-22 Kamil Salikhov , Gustavo Sacomoto , Gregory Kucherov

Language-image pre-training faces significant challenges due to limited data in specific formats and the constrained capacities of text encoders. While prevailing methods attempt to address these issues through data augmentation and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Anjia Cao , Xing Wei , Zhiheng Ma

Some transformer attention heads appear to function as membership testers, dedicating themselves to answering the question "has this token appeared before in the context?" We identify these heads across four language models (GPT-2 small,…

Machine Learning · Computer Science 2026-02-20 Peter Balogh

Clustering is a core task in machine learning with wide-ranging applications in data mining and pattern recognition. However, its unsupervised nature makes it inherently challenging. Many existing clustering algorithms suffer from critical…

Machine Learning · Computer Science 2025-07-29 Ahmed Shokry , Ayman Khalafallah

Bloom filter is a widely used classic data structure for approximate membership queries. Learned Bloom filters improve memory efficiency by leveraging machine learning, with the partitioned learned Bloom filter (PLBF) being among the most…

Data Structures and Algorithms · Computer Science 2024-10-18 Atsuki Sato , Yusuke Matsui

Language model approaches have recently been integrated into binary analysis tasks, such as function similarity detection and function signature recovery. These models typically employ a two-stage training process: pre-training via Masked…

Software Engineering · Computer Science 2024-12-24 Hanxiao Lu , Hongyu Cai , Yiming Liang , Antonio Bianchi , Z. Berkay Celik

A Bloom filter is a space efficient structure for storing static sets, where the space efficiency is gained at the expense of a small probability of false-positives. A Bloomier filter generalizes a Bloom filter to compactly store a function…

Data Structures and Algorithms · Computer Science 2008-07-08 Denis Charles , Kumar Chellapilla

Bloom filters are probabilistic data structures commonly used for approximate membership problems in many areas of Computer Science (networking, distributed systems, databases, etc.). With the increase in data size and distribution of data,…

Databases · Computer Science 2016-09-22 Adina Crainiceanu , Daniel Lemire

The potential impact of quantum machine learning algorithms on industrial applications remains an exciting open question. Conventional methods for encoding classical data into quantum computers are not only too costly for a potential…

Quantum Physics · Physics 2024-03-06 Kevin Shen , Bernhard Jobst , Elvira Shishenina , Frank Pollmann

Representation learning is important for solving sequence-to-sequence problems in natural language processing. Representation learning transforms raw data into vector-form representations while preserving their features. However, data with…

Computation and Language · Computer Science 2023-01-12 Yunhao Yang , Zhaokun Xue , Andrew Whinston

Learning based hashing plays a pivotal role in large-scale visual search. However, most existing hashing algorithms tend to learn shallow models that do not seek representative binary codes. In this paper, we propose a novel hashing…

Computer Vision and Pattern Recognition · Computer Science 2018-04-26 Zhaoqiang Xia , Xiaoyi Feng , Jinye Peng , Abdenour Hadid

Convolutional networks require extensive image annotation, which can be costly and time-consuming. Feature Learning from Image Markers (FLIM) tackles this challenge by estimating encoder filters (i.e., kernel weights) from user-drawn…

This paper aims to deliver an efficient and modified approach for image retrieval using multiple neural hash codes and limiting the number of queries using bloom filters by identifying false positives beforehand. Traditional approaches…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Sourin Chakrabarti

With the explosion of information stored world-wide,data intensive computing has become a central area of research.Efficient management and processing of this massively exponential amount of data from diverse sources,such as…

Information Retrieval · Computer Science 2015-03-19 Sourav Dutta , Souvik Bhattacherjee , Ankur Narang

Bytewise approximate matching algorithms have in recent years shown significant promise in de- tecting files that are similar at the byte level. This is very useful for digital forensic investigators, who are regularly faced with the…

Cryptography and Security · Computer Science 2022-11-15 David Lillis , Frank Breitinger , Mark Scanlon

In this paper we compare two probabilistic data structures for association queries derived from the well-known Bloom filter: the shifting Bloom filter (ShBF), and the spatial Bloom filter (SBF). With respect to the original data structure,…

Data Structures and Algorithms · Computer Science 2022-05-06 Luca Calderoni , Dario Maio , Paolo Palmieri