English
Related papers

Related papers: Beating CountSketch for Heavy Hitters in Insertion…

200 papers

\begin{abstract} The frequencies of the elements in a data stream are an important statistical measure and the task of estimating them arises in many applications within data analysis and machine learning. Two of the most popular algorithms…

Data Structures and Algorithms · Computer Science 2020-08-12 Anders Aamand , Piotr Indyk , Ali Vakilian

We study the problem of constructing hypergraph cut sparsifiers in the streaming model where a hypergraph on $n$ vertices is revealed either via an arbitrary sequence of hyperedge insertions alone ({\em insertion-only} streaming model) or…

Data Structures and Algorithms · Computer Science 2025-04-24 Sanjeev Khanna , Aaron Putterman , Madhu Sudan

Big data streams are possibly one of the most essential underlying notions. However, data streams are often challenging to handle owing to their rapid pace and limited information lifetime. It is difficult to collect and communicate stream…

Machine Learning · Computer Science 2022-03-03 Christos Karras , Aristeidis Karras , Spyros Sioutas

We show an improved lower bound for the Fp estimation problem in a data stream setting for p>2. A data stream is a sequence of items from the domain [n] with possible repetitions. The frequency vector x is an n-dimensional non-negative…

Data Structures and Algorithms · Computer Science 2015-03-19 Sumit Ganguly

We study the problem of solving semidefinite programs (SDP) in the streaming model. Specifically, $m$ constraint matrices and a target matrix $C$, all of size $n\times n$ together with a vector $b\in \mathbb{R}^m$ are streamed to us…

Data Structures and Algorithms · Computer Science 2023-09-12 Zhao Song , Mingquan Ye , Lichen Zhang

We study streaming algorithms in the white-box adversarial model, where the stream is chosen adaptively by an adversary who observes the entire internal state of the algorithm at each time step. We show that nontrivial algorithms are still…

Data Structures and Algorithms · Computer Science 2022-07-26 Miklos Ajtai , Vladimir Braverman , T. S. Jayram , Sandeep Silwal , Alec Sun , David P. Woodruff , Samson Zhou

Elastic-Sketch is a hash-based data structure for counting item's appearances in a data stream, and it has been empirically shown to achieve a better memory-accuracy trade-off compared to classical methods. This algorithm combines a heavy…

Data Structures and Algorithms · Computer Science 2026-03-27 Younes Ben Mazziane , Vinay Kumar B. R. , Othmane Marfoq

Detecting heavy hitters, which are flows exceeding a specified threshold, is crucial for network measurement, but it faces challenges due to increasing throughput and memory constraints. Existing sketch-based solutions, particularly those…

Networking and Internet Architecture · Computer Science 2024-08-26 Xilai Liu , Xinyi Zhang , Bingqing Liu , Tao Li , Tong Yang , Gaogang Xie

The problem of estimating frequency moments of a data stream has attracted a lot of attention since the onset of streaming algorithms [AMS99]. While the space complexity for approximately computing the $p^{\rm th}$ moment, for $p\in(0,2]$…

Data Structures and Algorithms · Computer Science 2013-06-27 Alexandr Andoni , Huy L. Nguyen , Yury Polyanskiy , Yihong Wu

To get estimators that work within a certain error bound with high probability, a common strategy is to design one that works with constant probability, and then boost the probability using independent repetitions. Important examples of…

Data Structures and Algorithms · Computer Science 2020-04-03 Anders Aamand , Debarati Das , Evangelos Kipouridis , Jakob B. T. Knudsen , Peter M. R. Rasmussen , Mikkel Thorup

The problem of estimating the pth moment F_p (p nonnegative and real) in data streams is as follows. There is a vector x which starts at 0, and many updates of the form x_i <-- x_i + v come sequentially in a stream. The algorithm also…

Data Structures and Algorithms · Computer Science 2009-04-09 Daniel M. Kane , Jelani Nelson , David P. Woodruff

In this paper, we revisit the classic CountSketch method, which is a sparse, random projection that transforms a (high-dimensional) Euclidean vector $v$ to a vector of dimension $(2t-1) s$, where $t, s > 0$ are integer parameters. It is…

Data Structures and Algorithms · Computer Science 2021-02-04 Kasper Green Larsen , Rasmus Pagh , Jakub Tětek

To approximate sums of values in key-value data streams, sketches are widely used in databases and networking systems. They offer high-confidence approximations for any given key while ensuring low time and space overhead. While existing…

Data Structures and Algorithms · Computer Science 2024-06-04 Yuhan Wu , Hanbo Wu , Xilai Liu , Yikai Zhao , Tong Yang , Kaicheng Yang , Sha Wang , Lihua Miao , Gaogang Xie

The traditional requirement for a randomized streaming algorithm is just {\em one-shot}, i.e., algorithm should be correct (within the stated $\eps$-error bound) at the end of the stream. In this paper, we study the {\em tracking} problem,…

Data Structures and Algorithms · Computer Science 2014-12-05 Zengfeng Huang , Wai Ming Tai , Ke Yi

CountSketch is a popular dimensionality reduction technique that maps vectors to a lower dimension using randomized linear measurements. The sketch supports recovering $\ell_2$-heavy hitters of a vector (entries with $v[i]^2 \geq…

Data Structures and Algorithms · Computer Science 2022-03-01 Edith Cohen , Xin Lyu , Jelani Nelson , Tamás Sarlós , Moshe Shechner , Uri Stemmer

Motivated by Johnson--Lindenstrauss dimension reduction, amplitude encoding, and the view of measurements as hash-like primitives, one might hope to compress an $n$-point approximate nearest neighbor (ANN) data structure into $O(\log n)$…

Quantum Physics · Physics 2026-02-24 Sajjad Hashemian

We study classic streaming and sparse recovery problems using deterministic linear sketches, including l1/l1 and linf/l1 sparse recovery problems (the latter also being known as l1-heavy hitters), norm estimation, and approximate inner…

Data Structures and Algorithms · Computer Science 2012-12-12 Jelani Nelson , Huy Nguyen , David P. Woodruff

We consider the unweighted bipartite maximum matching problem in the one-pass turnstile streaming model where the input stream consists of edge insertions and deletions. In the insertion-only model, a one-pass $2$-approximation streaming…

Data Structures and Algorithms · Computer Science 2015-05-07 Christian Konrad

In this paper, we present a new algorithm for maintaining linear sketches in turnstile streams with faster update time. As an application, we show that $\log n$ \texttt{Count} sketches or \texttt{CountMin} sketches with a constant number of…

Data Structures and Algorithms · Computer Science 2019-11-05 Josh Alman , Huacheng Yu

We consider the problem of estimating the value of max cut in a graph in the streaming model of computation. At one extreme, there is a trivial $2$-approximation for this problem that uses only $O(\log n)$ space, namely, count the number of…

Data Structures and Algorithms · Computer Science 2014-09-09 Michael Kapralov , Sanjeev Khanna , Madhu Sudan