中文
相关论文

相关论文: Count-Min sketches for Telemetry: analysis of perf…

200 篇论文

Hyper-parameter Tuning (HPT) is a necessary step in machine learning (ML) pipelines but becomes computationally expensive and opaque with larger models. Recently, Large Language Models (LLMs) have been explored for HPT, yet most rely on…

机器学习 · 计算机科学 2025-09-26 Om Naphade , Saksham Bansal , Parikshit Pareek

Estimating cardinality, i.e., the number of distinct elements, of a data stream is a fundamental problem in areas like databases, computer networks, and information retrieval. This study delves into a broader scenario where each element…

数据库 · 计算机科学 2024-06-28 Yiyan Qi , Rundong Li , Pinghui Wang , Yufang Sun , Rui Xing

Sketching and streaming algorithms are in the forefront of current research directions for cut problems in graphs. In the streaming model, we show that $(1-\epsilon)$-approximation for Max-Cut must use $n^{1-O(\epsilon)}$ space; moreover,…

数据结构与算法 · 计算机科学 2026-02-23 Dmitry Kogan , Robert Krauthgamer

We study sketching and streaming algorithms for the Longest Common Subsequence problem (LCS) on strings of small alphabet size $|\Sigma|$. For the problem of deciding whether the LCS of strings $x,y$ has length at least $L$, we obtain a…

数据结构与算法 · 计算机科学 2018-10-03 Karl Bringmann , Bhaskar Ray Chaudhury

Distance computation is one of the most fundamental primitives used in communication networks. The cost of effectively and accurately computing pairwise network distances can become prohibitive in large-scale networks such as the Internet…

数据结构与算法 · 计算机科学 2011-12-07 Atish Das Sarma , Michael Dinitz , Gopal Pandurangan

In this paper, we consider the problem of estimating the distance between any two large data streams in small- space constraint. This problem is of utmost importance in data intensive monitoring applications where input streams are…

数据结构与算法 · 计算机科学 2012-08-01 Emmanuelle Anceaume , Yann Busnel

Measuring network flow sizes is important for tasks like accounting/billing, network forensics and security. Per-flow accounting is considered hard because it requires that many counters be updated at a very high speed; however, the large…

网络与互联网体系结构 · 计算机科学 2007-10-07 Yi Lu , Andrea Montanari , Balaji Prabhakar

Conservative Count-Min, an improved version of Count-Min sketch [Cormode, Muthukrishnan 2005], is an online-maintained hashing-based data structure summarizing element frequency information without storing elements themselves. Although…

数据结构与算法 · 计算机科学 2023-09-08 Éric Fusy , Gregory Kucherov

Count-sketch is a popular matrix sketching algorithm that can produce a sketch of an input data matrix X in O(nnz(X))time where nnz(X) denotes the number of non-zero entries in X. The sketched matrix will be much smaller than X while…

机器学习 · 计算机科学 2020-11-30 Yuhan Wang , Zijian Lei , Liang Lan

\begin{abstract} The frequencies of the elements in a data stream are an important statistical measure and the task of estimating them arises in many applications within data analysis and machine learning. Two of the most popular algorithms…

数据结构与算法 · 计算机科学 2020-08-12 Anders Aamand , Piotr Indyk , Ali Vakilian

Frequency estimation is one of the most fundamental problems in streaming algorithms. Given a stream $S$ of elements from some universe $U=\{1 \ldots n\}$, the goal is to compute, in a single pass, a short sketch of $S$ so that for any…

数据结构与算法 · 计算机科学 2021-11-09 Piotr Indyk , Shyam Narayanan , David P. Woodruff

Sketching is widely used in randomized linear algebra for low-rank matrix approximation, column subset selection, and many other problems, and it has gained significant traction in machine learning applications. However, sketching large…

分布式、并行与集群计算 · 计算机科学 2026-03-24 Hussam Al Daas , Grey Ballard , Laura Grigori , Md Taufique Hussain , Suraj Kumar , Mohammad Marufur Rahman , Kathryn Rouse

The challenge of estimating similarity between sets has been a significant concern in data science, finding diverse applications across various domains. However, previous approaches, such as MinHash, have predominantly centered around…

数据结构与算法 · 计算机科学 2024-05-31 Fenghao Dong , Yang He , Yutong Liang , Zirui Liu , Yuhan Wu , Peiqing Chen , Tong Yang

This paper identifies that a group of latest locally-differentially-private (LDP) algorithms for frequency estimation, including all the Hadamard-matrix-based algorithms, are equivalent to the private Count-Mean Sketch (CMS) algorithm with…

密码学与安全 · 计算机科学 2025-07-28 Mingen Pan

Random sketching is a dimensionality reduction technique that approximately preserves norms and singular values up to some $O(1)$ distortion factor with high probability. The most popular sketches in literature are the Gaussian sketch and…

数值分析 · 数学 2025-08-21 Andrew J. Higgins , Erik G. Boman , Ichitaro Yamazaki

The problem of estimating frequency moments of a data stream has attracted a lot of attention since the onset of streaming algorithms [AMS99]. While the space complexity for approximately computing the $p^{\rm th}$ moment, for $p\in(0,2]$…

数据结构与算法 · 计算机科学 2013-06-27 Alexandr Andoni , Huy L. Nguyen , Yury Polyanskiy , Yihong Wu

Approximate Nearest Neighbor (ANN) search and Approximate Kernel Density Estimation (A-KDE) are fundamental problems at the core of modern machine learning, with broad applications in data analysis, information systems, and large-scale…

机器学习 · 计算机科学 2025-10-28 Ved Danait , Srijan Das , Sujoy Bhore

Identifying the largest K flows in network traffic is an important task for applications such as flow scheduling and anomaly detection, which aim to improve network efficiency and security. However, accurately estimating flow frequencies is…

网络与互联网体系结构 · 计算机科学 2025-11-24 Carolina Gallardo-Pavesi , Yaime Fernández , Javier E. Soto , Cecilia Hernández , Miguel Figueroa

Counting the frequency of small subgraphs is a fundamental technique in network analysis across various domains, most notably in bioinformatics and social networks. The special case of triangle counting has received much attention. Getting…

数据结构与算法 · 计算机科学 2014-11-19 Madhav Jha , C. Seshadhri , Ali Pinar

Modern stream processing systems often need to track the frequency of distinct keys in a data stream in real-time. Since maintaining exact counts can require a prohibitive amount of memory, many applications rely on compact, probabilistic…

数据结构与算法 · 计算机科学 2026-04-29 Navid Eslami , Ioana O. Bercea , Rasmus Pagh , Niv Dayan