English
Related papers

Related papers: Using cascading Bloom filters to improve the memor…

200 papers

Bloom filters are data structures used to determine set membership of elements, with applications from string matching to networking and security problems. These structures are favored because of their reduced memory consumption and fast…

Data Structures and Algorithms · Computer Science 2019-02-21 Ethan Madison , Zachary Zipper

Important graph mining problems such as Clustering are computationally demanding. To significantly accelerate these problems, we propose ProbGraph: a graph representation that enables simple and fast approximate parallel graph mining with…

Motivation: Working with a large number of genomes simultaneously is of great interest in genetic population and comparative genomics research. Bubbles discovery in multi-genomes coloured de bruijn graph for de novo genome assembly is a…

Computational Engineering, Finance, and Science · Computer Science 2018-09-19 Reda Younsi , Jing Tang , Liisa Holm

Improving data systems' performance for join operations has long been an issue of great importance. More recently, a lot of focus has been devoted to multi-way join performance and especially on reducing the negative impact of producing…

Databases · Computer Science 2023-09-01 Qingzhi Ma

De novo DNA assembly is a fundamental task in Bioinformatics, and finding Eulerian paths on de Bruijn graphs is one of the dominant approaches to it. In most of the cases, there may be no one order for the de Bruijn graph that works well…

Data Structures and Algorithms · Computer Science 2018-05-15 Diego Díaz-Domínguez , Djamal Belazzougui , Travis Gagie , Veli Mäkinen , Gonzalo Navarro , Simon J. Puglisi

We suggest a method for holding a dictionary data structure, which maps keys to values, in the spirit of Bloom Filters. The space requirements of the dictionary we suggest are much smaller than those of a hashtable. We allow storing n keys,…

Data Structures and Algorithms · Computer Science 2008-04-14 Ely Porat

The Bloom filter provides fast approximate set membership while using little memory. Engineers often use these filters to avoid slow operations such as disk or network accesses. As an alternative, a cuckoo filter may need less space than a…

Data Structures and Algorithms · Computer Science 2020-10-12 Thomas Mueller Graf , Daniel Lemire

Assembling genomic sequences from a set of overlapping reads is one of the most fundamental problems in computational biology. Algorithms addressing the assembly problem fall into two broad categories -- based on the data structures which…

Data Structures and Algorithms · Computer Science 2010-03-10 Vamsi Kundeti , Sanguthevar Rajasekaran , Hieu Dinh

Bloom filter is a widely used classic data structure for approximate membership queries. Learned Bloom filters improve memory efficiency by leveraging machine learning, with the partitioned learned Bloom filter (PLBF) being among the most…

Data Structures and Algorithms · Computer Science 2024-10-18 Atsuki Sato , Yusuke Matsui

There has been a recent trend in training neural networks to replace data structures that have been crafted by hand, with an aim for faster execution, better accuracy, or greater compression. In this setting, a neural data structure is…

Machine Learning · Computer Science 2019-06-12 Jack W Rae , Sergey Bartunov , Timothy P Lillicrap

Recent studies have demonstrated that learned Bloom filters, which combine machine learning with the classical Bloom filter, can achieve superior memory efficiency. However, existing learned Bloom filters face two critical unresolved…

Data Structures and Algorithms · Computer Science 2025-02-07 Atsuki Sato , Yusuke Matsui

Bloom Filter is extensively deployed data structure in various applications and research domain since its inception. Bloom Filter is able to reduce the space consumption in an order of magnitude. Thus, Bloom Filter is used to keep…

Data Structures and Algorithms · Computer Science 2019-03-18 Ripon Patgiri , Sabuzima Nayak , Samir Kumar Borgohain

Motivation: De Bruijn graphs have been proposed as a data structure to facilitate the analysis of related whole genome sequences, in both a population and comparative genomic settings. However, current approaches do not scale well to many…

Data Structures and Algorithms · Computer Science 2016-02-19 Ilia Minkin , Son Pham , Paul Medvedev

Recommendation algorithms that incorporate techniques from deep learning are becoming increasingly popular. Due to the structure of the data coming from recommendation domains (i.e., one-hot-encoded vectors of item preferences), these…

Machine Learning · Computer Science 2017-06-14 Joan Serrà , Alexandros Karatzoglou

The reduction of the fragment assembly problem to (variations of) the classical Eulerian trail problem [Pevzner et al., PNAS 2001] has led to remarkable progress in genome assembly. This reduction employs the notion of de Bruijn graph…

Data Structures and Algorithms · Computer Science 2025-10-17 Ben Bals , Sebastiaan van Krieken , Solon P. Pissis , Leen Stougie , Hilde Verbeek

With the growing scale of big data, probabilistic structures receive increasing popularity for efficient approximate storage and query processing. For example, Bloom filters (BF) can achieve satisfactory performance for approximate…

Data Structures and Algorithms · Computer Science 2019-12-17 Yue Fu , Rong Du , Haibo Hu , Man Ho Au , Dagang Li

In-memory database query processing frequently involves substantial data transfers between the CPU and memory, leading to inefficiencies due to Von Neumann bottleneck. Processing-in-Memory (PIM) architectures offer a viable solution to…

This paper introduces the de Bruijn graph edge minimization problem, which is related to the compression of de Bruijn graphs: find the order-k de Bruijn graph with minimum edge count among all orders. We describe an efficient algorithm that…

Data Structures and Algorithms · Computer Science 2020-01-20 Uwe Baier , Thomas Büchler , Enno Ohlebusch , Pascal Weber

Graph representation learning has many real-world applications, from super-resolution imaging, 3D computer vision to drug repurposing, protein classification, social networks analysis. An adequate representation of graph data is vital to…

Machine Learning · Computer Science 2021-12-17 Xuebin Zheng , Bingxin Zhou , Yu Guang Wang , Xiaosheng Zhuang

Graph Neural Networks (GNNs) are emerging ML models to analyze graph-structure data. Graph Neural Network (GNN) execution involves both compute-intensive and memory-intensive kernels, the latter dominates the total time, being significantly…