English
Related papers

Related papers: MTS Sketch for Accurate Estimation of Set-Expressi…

200 papers

Sketches have shown high accuracy in multi-way join cardinality estimation, a critical problem in cost-based query optimization. Accurately estimating the cardinality of a join operation -- analogous to its computational cost -- allows the…

Databases · Computer Science 2025-06-18 Brian Tsan , Abylay Amanbayev , Asoke Datta , Florin Rusu

Most density based stream clustering algorithms separate the clustering process into an online and offline component. Exact summarized statistics are being employed for defining micro-clusters or grid cells during the online stage followed…

Databases · Computer Science 2016-12-09 Andrei Sorin Sabau

Network stream mining is fundamental to many network operations. Sketches, as compact data structures that offer low memory overhead with bounded accuracy, have emerged as a promising solution for network stream mining. Recent studies…

Networking and Internet Architecture · Computer Science 2025-02-12 Yuanpeng Li , Zhen Xu , Zongwei Lv , Yannan Hu , Yong Cui , Tong Yang

This paper presents new methods to estimate the cardinalities of data sets recorded by HyperLogLog sketches. A theoretically motivated extension to the original estimator is presented that eliminates the bias for small and large…

Data Structures and Algorithms · Computer Science 2017-02-27 Otmar Ertl

Data sketches are approximate succinct summaries of long streams. They are widely used for processing massive amounts of data and answering statistical queries about it in real-time. Existing libraries producing sketches are very fast, but…

Data Structures and Algorithms · Computer Science 2019-12-06 Arik Rinberg , Alexander Spiegelman , Edward Bortnikov , Eshcar Hillel , Idit Keidar , Lee Rhodes , Hadar Serviansky

We introduce EdgeSketch, a compact graph representation for efficient analysis of massive graph streams. EdgeSketch provides unbiased estimators for key graph properties with controllable variance and supports implementing graph algorithms…

Data Structures and Algorithms · Computer Science 2026-02-24 Jakub Lemiesz , Dingqi Yang , Philippe Cudré-Mauroux

Learning parameters from voluminous data can be prohibitive in terms of memory and computational requirements. We propose a "compressive learning" framework where we estimate model parameters from a sketch of the training data. This sketch…

Machine Learning · Computer Science 2017-05-08 Nicolas Keriven , Anthony Bourrier , Rémi Gribonval , Patrick Pérez

Interactive analytics increasingly involves querying for quantiles over sub-populations of high cardinality datasets. Data processing engines such as Druid and Spark use mergeable summaries to estimate quantiles, but summary merge times can…

Databases · Computer Science 2018-07-17 Edward Gan , Jialin Ding , Kai Sheng Tai , Vatsal Sharan , Peter Bailis

A sketch is a probabilistic data structure used to record frequencies of items in a multi-set. Sketches are widely used in various fields, especially those that involve processing and storing data streams. In streaming applications with…

Data Structures and Algorithms · Computer Science 2017-02-08 Tong Yang , Lingtong Liu , Yibo Yan , Muhammad Shahzad , Yulong Shen , Xiaoming Li , Bin Cui , Gaogang Xie

Cost-based query optimization remains a critical task in relational databases even after decades of research and industrial development. Query optimizers rely on a large range of statistical synopses -- including attribute-level histograms…

Databases · Computer Science 2021-02-05 Yesdaulet Izenov , Asoke Datta , Florin Rusu , Jun Hyung Shin

Sampling of signals belonging to a low-dimensional subspace has well-documented merits for dimensionality reduction, limited memory storage, and online processing of streaming network data. When the subspace is known, these signals can be…

Information Theory · Computer Science 2019-11-26 Fernando Gama , Antonio G. Marques , Gonzalo Mateos , Alejandro Ribeiro

Understanding the nature of human sketches is challenging because of the wide variation in how they are created. Recognizing complex structural patterns improves both the accuracy in recognizing sketches and the fidelity of the generated…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Giulio Federico , Giuseppe Amato , Fabio Carrara , Claudio Gennaro , Marco Di Benedetto

Estimating the number of distinct elements in a data stream is well understood when repeated elements are identical. In modern settings, however, observations are high-dimensional and noisy, so repeated instances of the same object are only…

Machine Learning · Statistics 2026-05-18 Nikos Tsikouras , Constantine Caramanis , Christos Tzamos

Space-efficient streaming estimation of quantiles in massive datasets is a fundamental problem with numerous applications in data monitoring and analysis. While theoretical research led to optimal algorithms, such as the Greenwald-Khanna…

Data Structures and Algorithms · Computer Science 2025-09-12 Aleksander Łukasiewicz , Jakub Tětek , Pavel Veselý

Large Reasoning Models (LRMs) achieve remarkable inference-time improvements through parallel thinking. However, existing methods rely on redundant sampling of reasoning trajectories, failing to effectively explore the reasoning space to…

Artificial Intelligence · Computer Science 2026-02-05 Zicheng Xu , Xiuyi Lou , Guanchu Wang , Yu-Neng Chuang , Feng Luo , Guangyao Zheng , Alexander S. Szalay , Zirui Liu , Vladimir Braverman

We present DegreeSketch, a semi-streaming distributed sketch data structure and demonstrate its utility for estimating local neighborhood sizes and local triangle count heavy hitters on massive graphs. DegreeSketch consists of…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-10 Benjamin W. Priest

We discuss the problem of counting distinct elements in a stream. A stream is usually considered as a sequence of elements that come one at a time. An exact solution to the problem requires memory space of the size of the stream. For many…

Data Structures and Algorithms · Computer Science 2021-06-18 Tal Ohayon

Data sketching is a critical tool for distinct counting, enabling multisets to be represented by compact summaries that admit fast cardinality estimates. Because sketches may be merged to summarize multiset unions, they are a basic building…

Data Structures and Algorithms · Computer Science 2023-02-07 Jonathan Hehir , Daniel Ting , Graham Cormode

In sketched clustering, a dataset of $T$ samples is first sketched down to a vector of modest size, from which the centroids are subsequently extracted. Advantages include i) reduced storage complexity and ii) centroid extraction complexity…

Information Theory · Computer Science 2019-05-21 Evan Byrne , Antoine Chatalic , Remi Gribonval , Philip Schniter

Sketches are probabilistic data structures that can provide approximate results within mathematically proven error bounds while using orders of magnitude less memory than traditional approaches. They are tailored for streaming data analysis…

Data Structures and Algorithms · Computer Science 2019-03-05 Fatih Taşyaran , Kerem Yıldırır , Kamer Kaya , Mustafa Kemal Taş