中文
相关论文

相关论文: Buffered Count-Min Sketch on SSD: Theory and Exper…

200 篇论文

\begin{abstract} The frequencies of the elements in a data stream are an important statistical measure and the task of estimating them arises in many applications within data analysis and machine learning. Two of the most popular algorithms…

数据结构与算法 · 计算机科学 2020-08-12 Anders Aamand , Piotr Indyk , Ali Vakilian

Modern stream processing systems often need to track the frequency of distinct keys in a data stream in real-time. Since maintaining exact counts can require a prohibitive amount of memory, many applications rely on compact, probabilistic…

数据结构与算法 · 计算机科学 2026-04-29 Navid Eslami , Ioana O. Bercea , Rasmus Pagh , Niv Dayan

With the exponentially growing Internet traffic, sketch data structure with a probabilistic algorithm has been expected to be an alternative solution for non-compromised (non-selective) security monitoring. While facilitating counting…

密码学与安全 · 计算机科学 2025-03-18 Seungsam Yang , Seyed Mohammad Mehdi Mirnajafizadeh , Sian Kim , Rhongho Jang , DaeHun Nyang

Graph-based Semi-supervised learning (SSL) algorithms have been successfully used in a large number of applications. These methods classify initially unlabeled nodes by propagating label information over the structure of graph starting from…

机器学习 · 计算机科学 2014-03-03 Partha Pratim Talukdar , William Cohen

Along with the progress of AI democratization, machine learning (ML) has been successfully applied to edge applications, such as smart phones and automated driving. Nowadays, more applications require ML on tiny devices with extremely…

机器学习 · 计算机科学 2021-11-15 Yuhong Song , Edwin Hsing-Mean Sha , Qingfeng Zhuge , Rui Xu , Yongzhuo Zhang , Bingzhe Li , Lei Yang

We present FDCMSS, a new sketch-based algorithm for mining frequent items in data streams. The algorithm cleverly combines key ideas borrowed from forward decay, the Count-Min and the Space Saving algorithms. It works in the time fading…

数据结构与算法 · 计算机科学 2016-08-08 Massimo Cafaro , Marco Pulimeno , Italo Epicoco , Giovanni Aloisio

Estimating cardinality, i.e., the number of distinct elements, of a data stream is a fundamental problem in areas like databases, computer networks, and information retrieval. This study delves into a broader scenario where each element…

数据库 · 计算机科学 2024-06-28 Yiyan Qi , Rundong Li , Pinghui Wang , Yufang Sun , Rui Xing

With the increasing rate of data generated by critical systems, estimating functions on streaming data has become essential. This demand has driven numerous advancements in algorithms designed to efficiently query and analyze one or more…

数据库 · 计算机科学 2024-05-16 Mike Heddes , Igor Nunes , Tony Givargis , Alex Nicolau

Monitoring streams of packets at 100~Gb/s and beyond requires using compact and efficient hashing-techniques like HyperLogLog (HLL) or Count-Min Sketch (CMS). In this work, we evaluate the uses and applications of Count-Min Sketch for Metro…

Currently, Burst buffer has been proposed to manage the SSD buffering of bursty write requests. Although burst buffer can improve I/O performance in many cases, we find that it has some limitations such as requiring large SSD capacity and…

分布式、并行与集群计算 · 计算机科学 2019-02-18 Xuanhua Shi , Wei Liu , Ligang He , Hai Jin , Ming Li , Yong Chen

The count-min sketch (CMS) is a time and memory efficient randomized data structure that provides estimates of tokens' frequencies in a data stream of tokens, i.e. point queries, based on random hashed data. A learning-augmented version of…

机器学习 · 统计学 2022-09-14 Emanuele Dolera , Stefano Favaro , Stefano Peluchetti

Network monitoring is vital in modern clouds and data center networks for traffic engineering, network diagnosis, network intrusion detection, which need diverse traffic statistics ranging from flow size distributions to heavy hitters. To…

网络与互联网体系结构 · 计算机科学 2019-05-09 Yongquan Fu , Dongsheng Li , Siqi Shen , Yiming Zhang , Kai Chen

A flexible conformal inference method is developed to construct confidence intervals for the frequencies of queried objects in very large data sets, based on a much smaller sketch of those data. The approach is data-adaptive and requires no…

统计方法学 · 统计学 2022-11-10 Matteo Sesia , Stefano Favaro

This paper develops conformal inference methods to construct a confidence interval for the frequency of a queried object in a very large discrete data set, based on a sketch with a lower memory footprint. This approach requires no knowledge…

统计方法学 · 统计学 2023-08-17 Matteo Sesia , Stefano Favaro , Edgar Dobriban

Sketching uses randomized Hash functions for dimensionality reduction and acceleration. The existing sketching methods, such as count sketch (CS), tensor sketch (TS), and higher-order count sketch (HCS), either suffer from low accuracy or…

机器学习 · 计算机科学 2021-06-25 Xingyu Cao , Jiani Liu

The Count-Min Sketch is a widely adopted structure for approximate event counting in large scale processing. In a previous work we improved the original version of the Count-Min-Sketch (CMS) with conservative update using approximate…

信息检索 · 计算机科学 2016-06-16 Guillaume Pitel , Geoffroy Fouquier , Emmanuel Marchand , Abdul Mouhamadsultane

We introduce the Huffman-Bucket Sketch (HBS), a simple, mergeable data structure that losslessly compresses a HyperLogLog (HLL) sketch with $m$ registers to optimal space $O(m+\log n)$ bits, with amortized constant-time updates, acting as a…

数据结构与算法 · 计算机科学 2026-03-12 Matti Karppa

Leveraging the kernel trick in both the input and output spaces, surrogate kernel methods are a flexible and theoretically grounded solution to structured output prediction. If they provide state-of-the-art performance on complex data sets…

机器学习 · 统计学 2024-05-07 Tamim El Ahmad , Luc Brogat-Motte , Pierre Laforgue , Florence d'Alché-Buc

Recently, randomly mapping vectorial data to strings of discrete symbols (i.e., sketches) for fast and space-efficient similarity searches has become popular. Such random mapping is called similarity-preserving hashing and approximates a…

机器学习 · 计算机科学 2019-10-21 Shunsuke Kanda , Yasuo Tabei

Stochastic Computing (SC) is a computing paradigm that allows for the low-cost and low-power computation of various arithmetic operations using stochastic bit streams and digital logic. In contrast to conventional representation schemes…

新兴技术 · 计算机科学 2021-03-18 Corey Lammie , Jason K. Eshraghian , Wei D. Lu , Mostafa Rahimi Azghadi