English
Related papers

Related papers: Unmasking Vulnerabilities: Cardinality Sketches un…

200 papers

Sketches have shown high accuracy in multi-way join cardinality estimation, a critical problem in cost-based query optimization. Accurately estimating the cardinality of a join operation -- analogous to its computational cost -- allows the…

Databases · Computer Science 2025-06-18 Brian Tsan , Abylay Amanbayev , Asoke Datta , Florin Rusu

We introduce the Huffman-Bucket Sketch (HBS), a simple, mergeable data structure that losslessly compresses a HyperLogLog (HLL) sketch with $m$ registers to optimal space $O(m+\log n)$ bits, with amortized constant-time updates, acting as a…

Data Structures and Algorithms · Computer Science 2026-03-12 Matti Karppa

Join ordering is a key factor in query performance, yet traditional cost-based optimizers often produce sub-optimal plans due to inaccurate cardinality estimates in multi-predicate, multi-join queries. Existing alternatives such as…

Databases · Computer Science 2025-08-26 David Justen , Matthias Boehm

Sketch-based streaming algorithms allow efficient processing of big data. These algorithms use small fixed-size storage to store a summary ("sketch") of the input data, and use probabilistic algorithms to estimate the desired quantity.…

Databases · Computer Science 2016-11-08 Reuven Cohen , Liran Katzir , Aviv Yehezkel

We consider least-squares problems with quadratic regularization and propose novel sketching-based iterative methods with an adaptive sketch size. The sketch size can be as small as the effective dimension of the data matrix to guarantee…

Machine Learning · Computer Science 2021-04-30 Jonathan Lacotte , Mert Pilanci

Graph Neural Networks (GNNs) are widely applied to graph learning problems such as node classification. When scaling up the underlying graphs of GNNs to a larger size, we are forced to either train on the complete graph and keep the full…

Machine Learning · Computer Science 2024-06-25 Mucong Ding , Tahseen Rabbani , Bang An , Evan Z Wang , Furong Huang

With the increasing rate of data generated by critical systems, estimating functions on streaming data has become essential. This demand has driven numerous advancements in algorithms designed to efficiently query and analyze one or more…

Databases · Computer Science 2024-05-16 Mike Heddes , Igor Nunes , Tony Givargis , Alex Nicolau

Linear sketches are powerful algorithmic tools that turn an n-dimensional input into a concise lower-dimensional representation via a linear transformation. Such sketches have seen a wide range of applications including norm estimation over…

Data Structures and Algorithms · Computer Science 2012-11-07 Moritz Hardt , David P. Woodruff

Anomaly detection in dynamic graphs is essential for identifying malicious activities, fraud, and unexpected behaviors in real-world systems such as cybersecurity and power grids. However, existing approaches struggle with scalability,…

Machine Learning · Computer Science 2025-09-16 Ocheme Anthony Ekle , William Eberle

Cardinality estimation algorithms receive a stream of elements, with possible repetitions, and return the number of distinct elements in the stream. Such algorithms seek to minimize the required memory and CPU resource consumption at the…

Networking and Internet Architecture · Computer Science 2019-03-15 Reuven Cohen , Yuval Nezri

With the exponentially growing Internet traffic, sketch data structure with a probabilistic algorithm has been expected to be an alternative solution for non-compromised (non-selective) security monitoring. While facilitating counting…

Cryptography and Security · Computer Science 2025-03-18 Seungsam Yang , Seyed Mohammad Mehdi Mirnajafizadeh , Sian Kim , Rhongho Jang , DaeHun Nyang

Matrix trace estimation is ubiquitous in machine learning applications and has traditionally relied on Hutchinson's method, which requires $O(\log(1/\delta)/\epsilon^2)$ matrix-vector product queries to achieve a $(1 \pm…

Data Structures and Algorithms · Computer Science 2021-11-02 Shuli Jiang , Hai Pham , David P. Woodruff , Qiuyi , Zhang

Large, distributed data streams are now ubiquitous. High-accuracy sketches with low memory overhead have become the de facto method for analyzing this data. For instance, if we wish to group data by some label and report the largest counts…

Data Structures and Algorithms · Computer Science 2024-02-14 Homin K. Lee , Charles Masson

In all state-of-the-art sketching and coreset techniques for clustering, as well as in the best known fixed-parameter tractable approximation algorithms, randomness plays a key role. For the classic $k$-median and $k$-means problems, there…

Data Structures and Algorithms · Computer Science 2023-10-09 Vincent Cohen-Addad , David Saulpic , Chris Schwiegelshohn

We discuss the problem of counting distinct elements in a stream. A stream is usually considered as a sequence of elements that come one at a time. An exact solution to the problem requires memory space of the size of the stream. For many…

Data Structures and Algorithms · Computer Science 2021-06-18 Tal Ohayon

Motivated by the study of matrix elimination orderings in combinatorial scientific computing, we utilize graph sketching and local sampling to give a data structure that provides access to approximate fill degrees of a matrix undergoing…

Data Structures and Algorithms · Computer Science 2023-04-11 Matthew Fahrbach , Gary L. Miller , Richard Peng , Saurabh Sawlani , Junxing Wang , Shen Chen Xu

Sketched gradient algorithms have been recently introduced for efficiently solving the large-scale constrained Least-squares regressions. In this paper we provide novel convergence analysis for the basic method {\it Gradient Projection…

Optimization and Control · Mathematics 2017-06-05 Junqi Tang , Mohammad Golbabaee , Mike Davies

Recent work has explored transforming data sets into smaller, approximate summaries in order to scale Bayesian inference. We examine a related problem in which the parameters of a Bayesian model are very large and expensive to store in…

Machine Learning · Computer Science 2018-10-03 Joseph Tassarotti , Jean-Baptiste Tristan , Michael Wick

Cardinality estimation is the task of approximating the number of distinct elements in a large dataset with possibly repeating elements. LogLog and HyperLogLog (c.f. Durand and Flajolet [ESA 2003], Flajolet et al. [Discrete Math Theor.…

Data Structures and Algorithms · Computer Science 2020-08-19 Aleksander Łukasiewicz , Przemysław Uznański

DB engines produce efficient query execution plans by relying on cost models. Practical implementations estimate cardinality of queries using heuristics, with magic numbers tuned to improve average performance on benchmarks. Empirically,…