English
Related papers

Related papers: MagnifierSketch: Quantile Estimation Centered at O…

200 papers

The Count-Min sketch is an important and well-studied data summarization method. It allows one to estimate the count of any item in a stream using a small, fixed size data sketch. However, the accuracy of the sketch depends on…

Data Structures and Algorithms · Computer Science 2018-11-13 Daniel Ting

Approximation of non-linear kernels using random feature maps has become a powerful technique for scaling kernel methods to large datasets. We propose $\textit{Tensor Sketch}$, an efficient random feature map for approximating polynomial…

Data Structures and Algorithms · Computer Science 2025-05-20 Ninh Pham , Rasmus Pagh

Estimating the distribution and quantiles of data is a foundational task in data mining and data science. We study algorithms which provide accurate results for extreme quantile queries using a small amount of space, thus helping to…

Data Structures and Algorithms · Computer Science 2021-06-11 Graham Cormode , Abhinav Mishra , Joseph Ross , Pavel Veselý

We introduce Density sketches (DS): a succinct online summary of the data distribution. DS can accurately estimate point wise probability density. Interestingly, DS also provides a capability to sample unseen novel data from the underlying…

Data Structures and Algorithms · Computer Science 2021-02-25 Aditya Desai , Benjamin Coleman , Anshumali Shrivastava

Quantization has proven effective in high-resolution and large-scale simulations, which benefit from bit-level memory saving. However, identifying a quantization scheme that meets the requirement of both precision and memory efficiency…

Graphics · Computer Science 2022-07-15 Jiafeng Liu , Haoyang Shi , Siyuan Zhang , Yin Yang , Chongyang Ma , Weiwei Xu

Anomaly detection in dynamic graphs is essential for identifying malicious activities, fraud, and unexpected behaviors in real-world systems such as cybersecurity and power grids. However, existing approaches struggle with scalability,…

Machine Learning · Computer Science 2025-09-16 Ocheme Anthony Ekle , William Eberle

We present two new approaches for point prediction with streaming data. One is based on the Count-Min sketch (CMS) and the other is based on Gaussian process priors with a random bias. These methods are intended for the most general…

Machine Learning · Statistics 2024-08-05 Aleena Chanda , N. V. Vinodchandran , Bertrand Clarke

Estimating quantiles is one of the foundational problems of data sketching. Given $n$ elements $x_1, x_2, \dots, x_n$ from some universe of size $U$ arriving in a data stream, a quantile sketch estimates the rank of any element with…

Data Structures and Algorithms · Computer Science 2024-04-08 Meghal Gupta , Mihir Singhal , Hongxun Wu

Approximating quantiles and distributions over streaming data has been studied for roughly two decades now. Recently, Karnin, Lang, and Liberty proposed the first asymptotically optimal algorithm for doing so. This manuscript complements…

Data Structures and Algorithms · Computer Science 2019-07-02 Nikita Ivkin , Edo Liberty , Kevin Lang , Zohar Karnin , Vladimir Braverman

A sketch is a probabilistic data structure used to record frequencies of items in a multi-set. Sketches are widely used in various fields, especially those that involve processing and storing data streams. In streaming applications with…

Data Structures and Algorithms · Computer Science 2017-02-08 Tong Yang , Lingtong Liu , Yibo Yan , Muhammad Shahzad , Yulong Shen , Xiaoming Li , Bin Cui , Gaogang Xie

In this work, we investigate the problem of sketch-based object localization on natural images, where given a crude hand-drawn sketch of an object, the goal is to localize all the instances of the same object on the target image. This…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Aditay Tripathi , Anand Mishra , Anirban Chakraborty

With the increasing rate of data generated by critical systems, estimating functions on streaming data has become essential. This demand has driven numerous advancements in algorithms designed to efficiently query and analyze one or more…

Databases · Computer Science 2024-05-16 Mike Heddes , Igor Nunes , Tony Givargis , Alex Nicolau

This paper resolves one of the longest standing basic problems in the streaming computational model. Namely, optimal construction of quantile sketches. An $\varepsilon$ approximate quantile sketch receives a stream of items $x_1,\ldots,x_n$…

Data Structures and Algorithms · Computer Science 2016-04-07 Zohar Karnin , Kevin Lang , Edo Liberty

Many datasets such as market basket data, text or hypertext documents, and sensor observations recorded in different locations or time periods, are modeled as a collection of sets over a ground set of keys. We are interested in basic…

Databases · Computer Science 2009-03-05 Edith Cohen , Haim Kaplan

Kernel methods are learning algorithms that enjoy solid theoretical foundations while suffering from important computational limitations. Sketching, which consists in looking for solutions among a subspace of reduced dimension, is a well…

Machine Learning · Statistics 2023-11-07 Tamim El Ahmad , Pierre Laforgue , Florence d'Alché-Buc

Count-Min Sketch with Conservative Updates (CMS-CU) is a popular algorithm to approximately count items' appearances in a data stream. Despite CMS-CU's widespread adoption, the theoretical analysis of its performance is still wanting…

Discrete Mathematics · Computer Science 2022-03-29 Younes Ben Mazziane , Sara Alouf , Giovanni Neglia

Large machine learning models achieve unprecedented performance on various tasks and have evolved as the go-to technique. However, deploying these compute and memory hungry models on resource constraint environments poses new challenges. In…

Machine Learning · Computer Science 2021-06-23 Zichang Liu , Benjamin Coleman , Anshumali Shrivastava

As data volume grows extensively, data profiling helps to extract metadata of large-scale data. However, one kind of metadata, order statistics, is difficult to be computed because they are not mergeable or incremental. Thus, the limitation…

Data Structures and Algorithms · Computer Science 2020-06-29 Zhiwei Chen , Aoqian Zhang

Quantile computation is a core primitive in large-scale data analytics. In Spark, practitioners typically rely on the Greenwald-Khanna (GK) Sketch, an approximate method. When exact quantiles are required, the default option is an expensive…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-29 Ivan Cao , Jaromir J. Saloni , David A. G. Harrison

Many popular first-order optimization methods (e.g., Momentum, AdaGrad, Adam) accelerate the convergence rate of deep learning models. However, these algorithms require auxiliary parameters, which cost additional memory proportional to the…

Machine Learning · Computer Science 2019-02-27 Ryan Spring , Anastasios Kyrillidis , Vijai Mohan , Anshumali Shrivastava