English
Related papers

Related papers: Huffman-Bucket Sketch: A Simple $O(m)$ Algorithm f…

200 papers

We present the first sublinear memory sketch that can be queried to find the nearest neighbors in a dataset. Our online sketching algorithm compresses an N element dataset to a sketch of size $O(N^b \log^3 N)$ in $O(N^{(b+1)} \log^3 N)$…

Data Structures and Algorithms · Computer Science 2020-09-15 Benjamin Coleman , Richard G. Baraniuk , Anshumali Shrivastava

Set reconciliation is a fundamental algorithmic problem that arises in many networking, system, and database applications. In this problem, two large sets A and B of objects (bitcoins, files, records, etc.) are stored respectively at two…

Databases · Computer Science 2020-08-18 Long Gong , Ziheng Liu , Liang Liu , Jun Xu , Mitsunori Ogihara , Tong Yang

This paper proposes using sketch algorithms to represent the votes in Hough transforms. Replacing the accumulator array with a sketch (Sketch Hough Transform - SHT) significantly reduces the memory needed to compute a Hough transform. We…

Computer Vision and Pattern Recognition · Computer Science 2018-11-16 Levi Offen , Michael Werman

Modern large language models (LLMs) place extraordinary pressure on memory and compute budgets, making principled compression indispensable for both deployment and continued training. We present Hierarchical Sparse Plus Low-Rank (HSS)…

Machine Learning · Computer Science 2026-01-14 Pawan Kumar , Aditi Gupta

Elastic-Sketch is a hash-based data structure for counting item's appearances in a data stream, and it has been empirically shown to achieve a better memory-accuracy trade-off compared to classical methods. This algorithm combines a heavy…

Data Structures and Algorithms · Computer Science 2026-03-27 Younes Ben Mazziane , Vinay Kumar B. R. , Othmane Marfoq

Count-Min Sketch with Conservative Updates (CMS-CU) is a memory-efficient hash-based data structure used to estimate the occurrences of items within a data stream. CMS-CU stores $m$ counters and employs $d$ hash functions to map items to…

Data Structures and Algorithms · Computer Science 2024-05-22 Younes Ben Mazziane , Othmane Marfoq

Random sketching is a dimensionality reduction technique that approximately preserves norms and singular values up to some $O(1)$ distortion factor with high probability. The most popular sketches in literature are the Gaussian sketch and…

Numerical Analysis · Mathematics 2025-08-21 Andrew J. Higgins , Erik G. Boman , Ichitaro Yamazaki

Sketches have shown high accuracy in multi-way join cardinality estimation, a critical problem in cost-based query optimization. Accurately estimating the cardinality of a join operation -- analogous to its computational cost -- allows the…

Databases · Computer Science 2025-06-18 Brian Tsan , Abylay Amanbayev , Asoke Datta , Florin Rusu

Huffman-coded sphere shaping (HCSS) is an algorithm for finite-length probabilistic constellation shaping, which provides nearly optimal energy efficiency at low implementation complexity. In this paper, we experimentally study the…

Signal Processing · Electrical Eng. & Systems 2020-08-07 Pavel Skvortcov , Ian Phillips , Wladek Forysiak , Toshiaki Koike-Akino , Keisuke Kojima , Kieran Parsons , David S. Millar

Randomized sampling has recently been proven a highly efficient technique for computing approximate factorizations of matrices that have low numerical rank. This paper describes an extension of such techniques to a wider class of matrices…

Numerical Analysis · Mathematics 2015-03-25 Per-Gunnar Martinsson

Matrix sketching is aimed at finding close approximations of a matrix by factors of much smaller dimensions, which has important applications in optimization and machine learning. Given a matrix A of size m by n, state-of-the-art randomized…

Machine Learning · Computer Science 2016-07-28 Kai Zhang , Chuanren Liu , Jie Zhang , Hui Xiong , Eric Xing , Jieping Ye

In this work, we address the problem of cardinality estimation for similarity search in high-dimensional spaces. Our goal is to design a framework that is lightweight, easy to construct, and capable of providing accurate estimates with…

Databases · Computer Science 2026-04-07 Zhonghan Chen , Qintian Guo , Ruiyuan Zhang , Xiaofang Zhou

Due to its low storage cost and fast query speed, hashing has been widely used in large-scale image retrieval tasks. Hash bucket search returns data points within a given Hamming radius to each query, which can enable search at a constant…

Machine Learning · Computer Science 2024-05-07 Ming-Wei Li , Qing-Yuan Jiang , Wu-Jun Li

A sketch is a probabilistic data structure used to record frequencies of items in a multi-set. Sketches are widely used in various fields, especially those that involve processing and storing data streams. In streaming applications with…

Data Structures and Algorithms · Computer Science 2017-02-08 Tong Yang , Lingtong Liu , Yibo Yan , Muhammad Shahzad , Yulong Shen , Xiaoming Li , Bin Cui , Gaogang Xie

Cost-based query optimization remains a critical task in relational databases even after decades of research and industrial development. Query optimizers rely on a large range of statistical synopses -- including attribute-level histograms…

Databases · Computer Science 2021-02-05 Yesdaulet Izenov , Asoke Datta , Florin Rusu , Jun Hyung Shin

We propose a deep hashing framework for sketch retrieval that, for the first time, works on a multi-million scale human sketch dataset. Leveraging on this large dataset, we explore a few sketch-specific traits that were otherwise…

Computer Vision and Pattern Recognition · Computer Science 2018-04-05 Peng Xu , Yongye Huang , Tongtong Yuan , Kaiyue Pang , Yi-Zhe Song , Tao Xiang , Timothy M. Hospedales , Zhanyu Ma , Jun Guo

In this paper, we address the problem of recovering arbitrary-shaped data clusters from datasets while facing \emph{high space constraints}, as this is for instance the case in many real-world applications when analysis algorithms are…

Machine Learning · Computer Science 2018-05-29 Anne Morvan , Krzysztof Choromanski , Cédric Gouy-Pailler , Jamal Atif

We consider the task of performing Jaccard similarity queries over a large collection of items that are dynamically updated according to a streaming input model. An item here is a subset of a large universe $U$ of elements. A well-studied…

Data Structures and Algorithms · Computer Science 2025-03-11 Andrea Clementi , Luciano Gualà , Luca Pepè Sciarria , Alessandro Straziota

A randomized algorithm for computing a compressed representation of a given rank-structured matrix $A \in \mathbb{R}^{N\times N}$ is presented. The algorithm interacts with $A$ only through its action on vectors. Specifically, it draws two…

Numerical Analysis · Mathematics 2024-06-25 James Levitt , Per-Gunnar Martinsson

To approximate sums of values in key-value data streams, sketches are widely used in databases and networking systems. They offer high-confidence approximations for any given key while ensuring low time and space overhead. While existing…

Data Structures and Algorithms · Computer Science 2024-06-04 Yuhan Wu , Hanbo Wu , Xilai Liu , Yikai Zhao , Tong Yang , Kaicheng Yang , Sha Wang , Lihua Miao , Gaogang Xie