中文
相关论文

相关论文: Sketch \star-metric: Comparing Data Streams via Sk…

200 篇论文

Estimating cardinality, i.e., the number of distinct elements, of a data stream is a fundamental problem in areas like databases, computer networks, and information retrieval. This study delves into a broader scenario where each element…

数据库 · 计算机科学 2024-06-28 Yiyan Qi , Rundong Li , Pinghui Wang , Yufang Sun , Rui Xing

We provide the first streaming algorithm for computing a provable approximation to the $k$-means of sparse Big data. Here, sparse Big Data is a set of $n$ vectors in $\mathbb{R}^d$, where each vector has $O(1)$ non-zeroes entries, and…

数据结构与算法 · 计算机科学 2016-02-09 Artem Barger , Dan Feldman

Sketching algorithms have recently proven to be a powerful approach both for designing low-space streaming algorithms as well as fast polynomial time approximation schemes (PTAS). In this work, we develop new techniques to extend the…

数据结构与算法 · 计算机科学 2023-10-31 Gregory Dexter , Petros Drineas , David P. Woodruff , Taisuke Yasuda

Many real-world matrix datasets arrive as high-throughput vector streams, making it impractical to store or process them in their entirety. To enable real-time analytics under limited computational, memory, and communication resources,…

数据库 · 计算机科学 2026-01-12 Hanyan Yin , Dongxie Wen , Jiajun Li , Zhewei Wei , Xiao Zhang , Peng Zhao , Zhi-Hua Zhou

To quantify the fundamental evolution of time-varying networks, and detect abnormal behavior, one needs a notion of temporal difference that captures significant organizational changes between two successive instants. In this work, we…

社会与信息网络 · 计算机科学 2017-08-17 Nathan D Monnig , Francois G Meyer

Estimating the number of distinct elements in a data stream is well understood when repeated elements are identical. In modern settings, however, observations are high-dimensional and noisy, so repeated instances of the same object are only…

机器学习 · 统计学 2026-05-18 Nikos Tsikouras , Constantine Caramanis , Christos Tzamos

Linear sketching algorithms have been widely used for processing large-scale distributed and streaming datasets. Their popularity is largely due to the fact that linear sketches can be naturally composed in the distributed model and be…

数据结构与算法 · 计算机科学 2017-03-28 Jiecao Chen , Qin Zhang

The need to estimate a particular quantile of a distribution is an important problem which frequently arises in many computer vision and signal processing applications. For example, our work was motivated by the requirements of many…

计算机视觉与模式识别 · 计算机科学 2015-04-22 Ognjen Arandjelovic , Duc-Son Pham , Svetha Venkatesh

We introduce Density sketches (DS): a succinct online summary of the data distribution. DS can accurately estimate point wise probability density. Interestingly, DS also provides a capability to sample unseen novel data from the underlying…

数据结构与算法 · 计算机科学 2021-02-25 Aditya Desai , Benjamin Coleman , Anshumali Shrivastava

Frequency estimation is one of the most fundamental problems in streaming algorithms. Given a stream $S$ of elements from some universe $U=\{1 \ldots n\}$, the goal is to compute, in a single pass, a short sketch of $S$ so that for any…

数据结构与算法 · 计算机科学 2021-11-09 Piotr Indyk , Shyam Narayanan , David P. Woodruff

Anomaly detection in dynamic graphs is essential for identifying malicious activities, fraud, and unexpected behaviors in real-world systems such as cybersecurity and power grids. However, existing approaches struggle with scalability,…

机器学习 · 计算机科学 2025-09-16 Ocheme Anthony Ekle , William Eberle

Estimating the frequency of items on the high-volume, fast data stream has been extensively studied in many areas, such as database and network measurement. Traditional sketches provide only coarse estimates under strict memory constraints.…

机器学习 · 计算机科学 2026-03-26 Xinyu Yuan , Yan Qiao , Meng Li , Zhenchun Wei , Cuiying Feng , Zonghui Wang , Wenzhi Chen

Count-sketch is a popular matrix sketching algorithm that can produce a sketch of an input data matrix X in O(nnz(X))time where nnz(X) denotes the number of non-zero entries in X. The sketched matrix will be much smaller than X while…

机器学习 · 计算机科学 2020-11-30 Yuhan Wang , Zijian Lei , Liang Lan

Large-scale collection of contextual information is often essential in order to gather statistics, train machine learning models, and extract knowledge from data. The ability to do so in a {\em privacy-preserving} way -- i.e., without…

密码学与安全 · 计算机科学 2016-01-07 Luca Melis , George Danezis , Emiliano De Cristofaro

Estimating frequencies of items over data streams is a common building block in streaming data measurement and analysis. Misra and Gries introduced their seminal algorithm for the problem in 1982, and the problem has since been revisited…

数据结构与算法 · 计算机科学 2017-05-23 Daniel Anderson , Pryce Bevan , Kevin Lang , Edo Liberty , Lee Rhodes , Justin Thaler

A fundamental question in streaming complexity is whether every space-efficient turnstile algorithm is implicitly a linear sketch. The landmark work of Li, Nguyen, and Woodruff [LNW14] established an equivalence between the two, but their…

数据结构与算法 · 计算机科学 2026-04-27 Cheng Jiang , Yinchen Liu , Huacheng Yu

A data stream model represents setting where approximating pairwise, or $k$-wise, independence with sublinear memory is of considerable importance. In the streaming model the joint distribution is given by a stream of $k$-tuples, with the…

数据结构与算法 · 计算机科学 2009-03-03 Vladimir Braverman , Rafail Ostrovsky

We introduce EdgeSketch, a compact graph representation for efficient analysis of massive graph streams. EdgeSketch provides unbiased estimators for key graph properties with controllable variance and supports implementing graph algorithms…

数据结构与算法 · 计算机科学 2026-02-24 Jakub Lemiesz , Dingqi Yang , Philippe Cudré-Mauroux

Data stream monitoring is a crucial task which has a wide range of applications. The majority of existing research in this area can be broadly classified into two types, monitoring value sum and monitoring value cardinality. In this paper,…

数据库 · 计算机科学 2025-05-21 Siyuan Dong , Yuxuan Tian , Wenhan Ma , Tong Yang , Chenye Zhang , Yuhan Wu , Kaicheng Yang , Yaojing Wang

Recent advancement of the WWW, IOT, social network, e-commerce, etc. have generated a large volume of data. These datasets are mostly represented by high dimensional and sparse datasets. Many fundamental subroutines of common data analytic…

信息检索 · 计算机科学 2019-10-11 Rameshwar Pratap , Debajyoti Bera , Karthik Revanuru