English
Related papers

Related papers: Approaching 100% Confidence in Stream Summary thro…

200 papers

In data stream applications, one of the critical issues is to estimate the frequency of each item in the specific multiset. The multiset means that each item in this set can appear multiple times. The data streams in many applications are…

Data Structures and Algorithms · Computer Science 2020-01-07 Ning Li

Count-sketch is a popular matrix sketching algorithm that can produce a sketch of an input data matrix X in O(nnz(X))time where nnz(X) denotes the number of non-zero entries in X. The sketched matrix will be much smaller than X while…

Machine Learning · Computer Science 2020-11-30 Yuhan Wang , Zijian Lei , Liang Lan

Large machine learning models achieve unprecedented performance on various tasks and have evolved as the go-to technique. However, deploying these compute and memory hungry models on resource constraint environments poses new challenges. In…

Machine Learning · Computer Science 2021-06-23 Zichang Liu , Benjamin Coleman , Anshumali Shrivastava

The majority of streaming problems are defined and analyzed in a static setting, where the data stream is any worst-case sequence of insertions and deletions that is fixed in advance. However, many real-world applications require a more…

Data Structures and Algorithms · Computer Science 2024-09-25 Elena Gribelyuk , Honghao Lin , David P. Woodruff , Huacheng Yu , Samson Zhou

We study when a single linear sketch can control the largest and smallest nonzero singular values of every rank-$r$ matrix. Classical oblivious embeddings require $s=\Theta(r/\varepsilon^{2})$ for $(1\pm\varepsilon)$ distortion, but this…

Numerical Analysis · Mathematics 2025-11-18 John M. Mango , Ronald Katende

Fast detection of heavy flows (e.g., heavy hitters and heavy changers) in massive network traffic is challenging due to the stringent requirements of fast packet processing and limited resource availability. Invertible sketches are summary…

Networking and Internet Architecture · Computer Science 2020-07-23 Lu Tang , Qun Huang , Patrick P. C. Lee

This paper describes a suite of algorithms for constructing low-rank approximations of an input matrix from a random linear image of the matrix, called a sketch. These methods can preserve structural properties of the input matrix, such as…

Numerical Analysis · Computer Science 2018-01-03 Joel A. Tropp , Alp Yurtsever , Madeleine Udell , Volkan Cevher

Distance computation is one of the most fundamental primitives used in communication networks. The cost of effectively and accurately computing pairwise network distances can become prohibitive in large-scale networks such as the Internet…

Data Structures and Algorithms · Computer Science 2011-12-07 Atish Das Sarma , Michael Dinitz , Gopal Pandurangan

A methodology for using random sketching in the context of model order reduction for high-dimensional parameter-dependent systems of equations was introduced in [Balabanov and Nouy 2019, Part I]. Following this framework, we here construct…

Numerical Analysis · Mathematics 2022-03-25 Oleg Balabanov , Anthony Nouy

Network monitoring is vital in modern clouds and data center networks for traffic engineering, network diagnosis, network intrusion detection, which need diverse traffic statistics ranging from flow size distributions to heavy hitters. To…

Networking and Internet Architecture · Computer Science 2019-05-09 Yongquan Fu , Dongsheng Li , Siqi Shen , Yiming Zhang , Kai Chen

We study how well one can recover sparse principal components of a data matrix using a sketch formed from a few of its elements. We show that for a wide class of optimization problems, if the sketch is close (in the spectral norm) to the…

Machine Learning · Computer Science 2015-03-16 Abhisek Kundu , Petros Drineas , Malik Magdon-Ismail

Graph-based Semi-supervised learning (SSL) algorithms have been successfully used in a large number of applications. These methods classify initially unlabeled nodes by propagating label information over the structure of graph starting from…

Machine Learning · Computer Science 2014-03-03 Partha Pratim Talukdar , William Cohen

Streaming computation plays an important role in large-scale data analysis. The sliding window model is a model of streaming computation which also captures the recency of the data. In this model, data arrives one item at a time, but only…

Data Structures and Algorithms · Computer Science 2021-11-01 Alessandro Epasto , Mohammad Mahdian , Vahab Mirrokni , Peilin Zhong

Random sketching is a dimensionality reduction technique that approximately preserves norms and singular values up to some $O(1)$ distortion factor with high probability. The most popular sketches in literature are the Gaussian sketch and…

Numerical Analysis · Mathematics 2025-08-21 Andrew J. Higgins , Erik G. Boman , Ichitaro Yamazaki

What guarantees are possible for solving logistic regression in one pass over a data stream? To answer this question, we present the first data oblivious sketch for logistic regression. Our sketch can be computed in input sparsity time over…

Data Structures and Algorithms · Computer Science 2021-07-15 Alexander Munteanu , Simon Omlor , David Woodruff

Linear sketches are fundamental tools in data stream analytics. They are notable for supporting both approximate frequency queries and heavy hitter detection with bounded trade-offs for error and memory. Importantly, on streams that contain…

Cryptography and Security · Computer Science 2025-12-10 Rayne Holland

Large language models (LLMs) represented by GPT family have achieved remarkable success. The characteristics of LLMs lie in their ability to accommodate a wide range of tasks through a generative approach. However, the flexibility of their…

Computation and Language · Computer Science 2024-09-06 Xin Jiang , Xiang Li , Wenjia Ma , Xuezhi Fang , Yiqun Yao , Naitong Yu , Xuying Meng , Peng Han , Jing Li , Aixin Sun , Yequan Wang

Sketch-based monitoring in SDN often suffers from tightly coupled pipeline and memory constraints, limiting algorithmic flexibility and reducing accuracy. We propose PSketch, the first in-kernel priority-aware sketching framework…

Emerging Technologies · Computer Science 2025-09-10 Yuanjun Dai , Qingzhe Guo , Xiangren Wang

A fundamental question in streaming complexity is whether every space-efficient turnstile algorithm is implicitly a linear sketch. The landmark work of Li, Nguyen, and Woodruff [LNW14] established an equivalence between the two, but their…

Data Structures and Algorithms · Computer Science 2026-04-27 Cheng Jiang , Yinchen Liu , Huacheng Yu

Estimating quantiles is one of the foundational problems of data sketching. Given $n$ elements $x_1, x_2, \dots, x_n$ from some universe of size $U$ arriving in a data stream, a quantile sketch estimates the rank of any element with…

Data Structures and Algorithms · Computer Science 2024-04-08 Meghal Gupta , Mihir Singhal , Hongxun Wu