中文
相关论文

相关论文: Count-Min-Log sketch: Approximately counting with …

200 篇论文

With the increasing rate of data generated by critical systems, estimating functions on streaming data has become essential. This demand has driven numerous advancements in algorithms designed to efficiently query and analyze one or more…

数据库 · 计算机科学 2024-05-16 Mike Heddes , Igor Nunes , Tony Givargis , Alex Nicolau

Random sketching is a dimensionality reduction technique that approximately preserves norms and singular values up to some $O(1)$ distortion factor with high probability. The most popular sketches in literature are the Gaussian sketch and…

数值分析 · 数学 2025-08-21 Andrew J. Higgins , Erik G. Boman , Ichitaro Yamazaki

Frequency estimation is one of the most fundamental problems in streaming algorithms. Given a stream $S$ of elements from some universe $U=\{1 \ldots n\}$, the goal is to compute, in a single pass, a short sketch of $S$ so that for any…

数据结构与算法 · 计算机科学 2021-11-09 Piotr Indyk , Shyam Narayanan , David P. Woodruff

The count-min sketch (CMS) is a time and memory efficient randomized data structure that provides estimates of tokens' frequencies in a data stream of tokens, i.e. point queries, based on random hashed data. A learning-augmented version of…

机器学习 · 统计学 2022-09-14 Emanuele Dolera , Stefano Favaro , Stefano Peluchetti

Sketching is a randomized dimensionality-reduction method that aims to preserve relevant information in large-scale datasets. Count sketch is a simple popular sketch which uses a randomized hash function to achieve compression. In this…

机器学习 · 统计学 2019-11-05 Yang Shi , Animashree Anandkumar

Modern stream processing systems often need to track the frequency of distinct keys in a data stream in real-time. Since maintaining exact counts can require a prohibitive amount of memory, many applications rely on compact, probabilistic…

数据结构与算法 · 计算机科学 2026-04-29 Navid Eslami , Ioana O. Bercea , Rasmus Pagh , Niv Dayan

Network stream mining is fundamental to many network operations. Sketches, as compact data structures that offer low memory overhead with bounded accuracy, have emerged as a promising solution for network stream mining. Recent studies…

网络与互联网体系结构 · 计算机科学 2025-02-12 Yuanpeng Li , Zhen Xu , Zongwei Lv , Yannan Hu , Yong Cui , Tong Yang

We establish efficient approximate counting algorithms for several natural problems in local lemma regimes. In particular, we consider the probability of intersection of events and the dimension of intersection of subspaces. Our approach is…

数据结构与算法 · 计算机科学 2025-12-12 Ryan L. Mann , Gabriel Waite

Kernel-based clustering algorithms have the ability to capture the non-linear structure in real world data. Among various kernel-based clustering algorithms, kernel k-means has gained popularity due to its simple iterative nature and ease…

计算机视觉与模式识别 · 计算机科学 2014-02-18 Radha Chitta , Rong Jin , Timothy C. Havens , Anil K. Jain

Modern data stream applications demand memory-efficient solutions for accurately tracking frequent items, such as heavy hitters and heavy changers, under strict resource constraints. Traditional sketches face inherent accuracy-memory…

数据库 · 计算机科学 2025-05-20 Zicang Xu , Yuxuan Tian , Yuhan Wu , Tong Yang

We consider sketching algorithms which first quickly compress data by multiplication with a random sketch matrix, and then apply the sketch to quickly solve an optimization problem, e.g., low rank approximation. In the learning-based…

机器学习 · 计算机科学 2021-06-08 Simin Liu , Tianrui Liu , Ali Vakilian , Yulin Wan , David P. Woodruff

Data sketches are approximate succinct summaries of long streams. They are widely used for processing massive amounts of data and answering statistical queries about it in real-time. Existing libraries producing sketches are very fast, but…

数据结构与算法 · 计算机科学 2019-12-06 Arik Rinberg , Alexander Spiegelman , Edward Bortnikov , Eshcar Hillel , Idit Keidar , Lee Rhodes , Hadar Serviansky

Count-Min sketch is a hash-based data structure to represent a dynamically changing associative array of counters. Here we analyse the counting version of Count-Min under a stronger update rule known as \textit{conservative update},…

数据结构与算法 · 计算机科学 2023-09-08 Éric Fusy , Gregory Kucherov

In rapid and massive data streams, it is often not possible to estimate the frequency of items with complete accuracy. To perform the operation in a reasonable amount of space and with sufficiently low latency, approximated methods are…

数据库 · 计算机科学 2019-04-18 Arijit Khan , Sixing Yan

This paper develops conformal inference methods to construct a confidence interval for the frequency of a queried object in a very large discrete data set, based on a sketch with a lower memory footprint. This approach requires no knowledge…

统计方法学 · 统计学 2023-08-17 Matteo Sesia , Stefano Favaro , Edgar Dobriban

Counting is among the most fundamental operations in computing. For example, counting the pth frequency moment has been a very active area of research, in theoretical computer science, databases, and data mining. When p=1, the task (i.e.,…

信息论 · 计算机科学 2008-02-24 Ping Li

Sketch-based streaming algorithms allow efficient processing of big data. These algorithms use small fixed-size storage to store a summary ("sketch") of the input data, and use probabilistic algorithms to estimate the desired quantity.…

数据库 · 计算机科学 2016-11-08 Reuven Cohen , Liran Katzir , Aviv Yehezkel

Sketching is a probabilistic data compression technique that has been largely developed in the computer science community. Numerical operations on big datasets can be intolerably slow; sketching algorithms address this issue by generating a…

统计方法学 · 统计学 2019-04-04 Daniel Ahfock , William J. Astle , Sylvia Richardson

Approximation of non-linear kernels using random feature maps has become a powerful technique for scaling kernel methods to large datasets. We propose $\textit{Tensor Sketch}$, an efficient random feature map for approximating polynomial…

数据结构与算法 · 计算机科学 2025-05-20 Ninh Pham , Rasmus Pagh

Matrix sketching is a recently developed data compression technique. An input matrix A is efficiently approximated with a smaller matrix B, so that B preserves most of the properties of A up to some guaranteed approximation ratio. In so…

机器学习 · 统计学 2019-12-03 Roberta Falcone , Angela Montanari , Laura Anderlucci