English
Related papers

Related papers: Buffered Count-Min Sketch on SSD: Theory and Exper…

200 papers

\begin{abstract} The frequencies of the elements in a data stream are an important statistical measure and the task of estimating them arises in many applications within data analysis and machine learning. Two of the most popular algorithms…

Data Structures and Algorithms · Computer Science 2020-08-12 Anders Aamand , Piotr Indyk , Ali Vakilian

Modern stream processing systems often need to track the frequency of distinct keys in a data stream in real-time. Since maintaining exact counts can require a prohibitive amount of memory, many applications rely on compact, probabilistic…

Data Structures and Algorithms · Computer Science 2026-04-29 Navid Eslami , Ioana O. Bercea , Rasmus Pagh , Niv Dayan

With the exponentially growing Internet traffic, sketch data structure with a probabilistic algorithm has been expected to be an alternative solution for non-compromised (non-selective) security monitoring. While facilitating counting…

Cryptography and Security · Computer Science 2025-03-18 Seungsam Yang , Seyed Mohammad Mehdi Mirnajafizadeh , Sian Kim , Rhongho Jang , DaeHun Nyang

Graph-based Semi-supervised learning (SSL) algorithms have been successfully used in a large number of applications. These methods classify initially unlabeled nodes by propagating label information over the structure of graph starting from…

Machine Learning · Computer Science 2014-03-03 Partha Pratim Talukdar , William Cohen

Along with the progress of AI democratization, machine learning (ML) has been successfully applied to edge applications, such as smart phones and automated driving. Nowadays, more applications require ML on tiny devices with extremely…

Machine Learning · Computer Science 2021-11-15 Yuhong Song , Edwin Hsing-Mean Sha , Qingfeng Zhuge , Rui Xu , Yongzhuo Zhang , Bingzhe Li , Lei Yang

We present FDCMSS, a new sketch-based algorithm for mining frequent items in data streams. The algorithm cleverly combines key ideas borrowed from forward decay, the Count-Min and the Space Saving algorithms. It works in the time fading…

Data Structures and Algorithms · Computer Science 2016-08-08 Massimo Cafaro , Marco Pulimeno , Italo Epicoco , Giovanni Aloisio

Estimating cardinality, i.e., the number of distinct elements, of a data stream is a fundamental problem in areas like databases, computer networks, and information retrieval. This study delves into a broader scenario where each element…

Databases · Computer Science 2024-06-28 Yiyan Qi , Rundong Li , Pinghui Wang , Yufang Sun , Rui Xing

With the increasing rate of data generated by critical systems, estimating functions on streaming data has become essential. This demand has driven numerous advancements in algorithms designed to efficiently query and analyze one or more…

Databases · Computer Science 2024-05-16 Mike Heddes , Igor Nunes , Tony Givargis , Alex Nicolau

Monitoring streams of packets at 100~Gb/s and beyond requires using compact and efficient hashing-techniques like HyperLogLog (HLL) or Count-Min Sketch (CMS). In this work, we evaluate the uses and applications of Count-Min Sketch for Metro…

Networking and Internet Architecture · Computer Science 2024-06-24 José A. Hernández , Davide Scano , Filippo Cugini , Gonzalo Martínez , Natalia Koneva , Alvaro Sánchez-Macián , Óscar González de Dios

Currently, Burst buffer has been proposed to manage the SSD buffering of bursty write requests. Although burst buffer can improve I/O performance in many cases, we find that it has some limitations such as requiring large SSD capacity and…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-18 Xuanhua Shi , Wei Liu , Ligang He , Hai Jin , Ming Li , Yong Chen

The count-min sketch (CMS) is a time and memory efficient randomized data structure that provides estimates of tokens' frequencies in a data stream of tokens, i.e. point queries, based on random hashed data. A learning-augmented version of…

Machine Learning · Statistics 2022-09-14 Emanuele Dolera , Stefano Favaro , Stefano Peluchetti

Network monitoring is vital in modern clouds and data center networks for traffic engineering, network diagnosis, network intrusion detection, which need diverse traffic statistics ranging from flow size distributions to heavy hitters. To…

Networking and Internet Architecture · Computer Science 2019-05-09 Yongquan Fu , Dongsheng Li , Siqi Shen , Yiming Zhang , Kai Chen

A flexible conformal inference method is developed to construct confidence intervals for the frequencies of queried objects in very large data sets, based on a much smaller sketch of those data. The approach is data-adaptive and requires no…

Methodology · Statistics 2022-11-10 Matteo Sesia , Stefano Favaro

This paper develops conformal inference methods to construct a confidence interval for the frequency of a queried object in a very large discrete data set, based on a sketch with a lower memory footprint. This approach requires no knowledge…

Methodology · Statistics 2023-08-17 Matteo Sesia , Stefano Favaro , Edgar Dobriban

Sketching uses randomized Hash functions for dimensionality reduction and acceleration. The existing sketching methods, such as count sketch (CS), tensor sketch (TS), and higher-order count sketch (HCS), either suffer from low accuracy or…

Machine Learning · Computer Science 2021-06-25 Xingyu Cao , Jiani Liu

The Count-Min Sketch is a widely adopted structure for approximate event counting in large scale processing. In a previous work we improved the original version of the Count-Min-Sketch (CMS) with conservative update using approximate…

Information Retrieval · Computer Science 2016-06-16 Guillaume Pitel , Geoffroy Fouquier , Emmanuel Marchand , Abdul Mouhamadsultane

We introduce the Huffman-Bucket Sketch (HBS), a simple, mergeable data structure that losslessly compresses a HyperLogLog (HLL) sketch with $m$ registers to optimal space $O(m+\log n)$ bits, with amortized constant-time updates, acting as a…

Data Structures and Algorithms · Computer Science 2026-03-12 Matti Karppa

Leveraging the kernel trick in both the input and output spaces, surrogate kernel methods are a flexible and theoretically grounded solution to structured output prediction. If they provide state-of-the-art performance on complex data sets…

Machine Learning · Statistics 2024-05-07 Tamim El Ahmad , Luc Brogat-Motte , Pierre Laforgue , Florence d'Alché-Buc

Recently, randomly mapping vectorial data to strings of discrete symbols (i.e., sketches) for fast and space-efficient similarity searches has become popular. Such random mapping is called similarity-preserving hashing and approximates a…

Machine Learning · Computer Science 2019-10-21 Shunsuke Kanda , Yasuo Tabei

Stochastic Computing (SC) is a computing paradigm that allows for the low-cost and low-power computation of various arithmetic operations using stochastic bit streams and digital logic. In contrast to conventional representation schemes…

Emerging Technologies · Computer Science 2021-03-18 Corey Lammie , Jason K. Eshraghian , Wei D. Lu , Mostafa Rahimi Azghadi