中文
相关论文

相关论文: Approximating Large Frequency Moments with Pick-an…

200 篇论文

Frequency estimation of elements is an important task for summarizing data streams and machine learning applications. The problem is often addressed by using streaming algorithms with sublinear space data structures. These algorithms allow…

数据结构与算法 · 计算机科学 2022-04-05 Nikita Seleznev , Senthil Kumar , C. Bayan Bruss

We give efficient algorithms for volume sampling, i.e., for picking $k$-subsets of the rows of any given matrix with probabilities proportional to the squared volumes of the simplices defined by them and the origin (or the squared volumes…

数据结构与算法 · 计算机科学 2010-04-26 Amit Deshpande , Luis Rademacher

In this article, we develop efficient sampling algorithms for random surjections from $[n]$ to $[k]$ for all $n \geq k$. We make no assumption about $n$ and $k$. In particular, we do not make the common assumption that the ratio…

数据结构与算法 · 计算机科学 2026-05-26 Arnaud Carayol , Pablo Rotondo

Big data streams are possibly one of the most essential underlying notions. However, data streams are often challenging to handle owing to their rapid pace and limited information lifetime. It is difficult to collect and communicate stream…

机器学习 · 计算机科学 2022-03-03 Christos Karras , Aristeidis Karras , Spyros Sioutas

We adapt a well known streaming algorithm for approximating item frequencies to the matrix sketching setting. The algorithm receives the rows of a large matrix $A \in \R^{n \times m}$ one after the other in a streaming fashion. It maintains…

数据结构与算法 · 计算机科学 2012-07-12 Edo Liberty

Here, we present a novel algorithm for frequent itemset mining for streaming data (FIM-SD). For the past decade, various FIM-SD methods in one-pass approximation settings have been developed to approximate the frequency of each itemset.…

数据库 · 计算机科学 2019-01-08 Yoshitaka Yamamoto , Yasuo Tabei , Koji Iwanuma

Estimating ranks, quantiles, and distributions over streaming data is a central task in data analysis and monitoring. Given a stream of $n$ items from a data universe equipped with a total order, the task is to compute a sketch (data…

数据结构与算法 · 计算机科学 2023-08-25 Graham Cormode , Zohar Karnin , Edo Liberty , Justin Thaler , Pavel Veselý

We present the first efficient averaging sampler that achieves asymptotically optimal randomness complexity and near-optimal sample complexity. For any $\delta < \varepsilon$ and any constant $\alpha > 0$, our sampler uses $m + O(\log (1 /…

计算复杂性 · 计算机科学 2025-08-18 Zhiyang Xun , David Zuckerman

One of the oldest problems in the data stream model is to approximate the $p$-th moment $\|\mathcal{X}\|_p^p = \sum_{i=1}^n |\mathcal{X}_i|^p$ of an underlying vector $\mathcal{X} \in \mathbb{R}^n$, which is presented as a sequence of…

数据结构与算法 · 计算机科学 2019-07-15 Rajesh Jayaram , David P. Woodruff

Nowadays, frequent pattern mining (FPM) on large graphs receives increasing attention, since it is crucial to a variety of applications, e.g., social analysis. Informally, the FPM problem is defined as finding all the patterns in a large…

数据库 · 计算机科学 2022-05-04 Xin Wang , Zhuo Lan , Yu-Ang He , Yang Wang , Zhi-Gui Liu , Wen-Bo Xie

In Bayesian inference, we seek to compute information about random variables such as moments or quantiles on the basis of {available data} and prior information. When the distribution of random variables is {intractable}, Monte Carlo (MC)…

统计理论 · 数学 2021-04-06 Alec Koppel , Amrit Singh Bedi , Brian M. Sadler , Victor Elvira

Recently [Bhattacharya et al., STOC 2015] provide the first non-trivial algorithm for the densest subgraph problem in the streaming model with additions and deletions to its edges, i.e., for dynamic graph streams. They present a…

数据结构与算法 · 计算机科学 2015-07-30 Hossein Esfandiari , MohammadTaghi Hajiaghayi , David P. Woodruff

Change point detection plays a fundamental role in many real-world applications, where the goal is to analyze and monitor the behaviour of a data stream. In this paper, we study change detection in binary streams. To this end, we use a…

机器学习 · 计算机科学 2023-01-24 Nikolaj Tatti

We study the use of sampling for efficiently mining the top-K frequent itemsets of cardinality at most w. To this purpose, we define an approximation to the top-K frequent itemsets to be a family of itemsets which includes (resp., excludes)…

数据结构与算法 · 计算机科学 2012-04-23 Andrea Pietracaprina , Matteo Riondato , Eli Upfal , Fabio Vandin

We propose a novel framework for statistical estimation on noisy datasets. Within this framework, we focus on the frequency moments ($F_p$) problem and demonstrate that it is possible to approximate $F_p$ of the unknown ground-truth dataset…

数据结构与算法 · 计算机科学 2026-03-13 Kaiwen Liu , Qin Zhang

Computing space-efficient summary, or \textit{a.k.a. sketches}, of large data, is a central problem in the streaming algorithm. Such sketches are used to answer \textit{post-hoc} queries in several data analytics tasks. The algorithm for…

机器学习 · 计算机科学 2022-03-07 Rameshwar Pratap , Bhisham Dev Verma , Raghav Kulkarni

We consider the problem of estimating functions of distributed data using a distributed algorithm over a network. The extant literature on computing functions in distributed networks such as wired and wireless sensor networks and…

网络与互联网体系结构 · 计算机科学 2012-10-24 Pooja Vyavahare , Nutan Limaye , D. Manjunath

We consider the classic Euclidean $k$-median and $k$-means objective on data streams, where the goal is to provide a $(1+\varepsilon)$-approximation to the optimal $k$-median or $k$-means solution, while using as little memory as possible.…

数据结构与算法 · 计算机科学 2023-10-05 Vincent Cohen-Addad , David P. Woodruff , Samson Zhou

Probability density estimation is a core problem of statistics and signal processing. Moment methods are an important means of density estimation, but they are generally strongly dependent on the choice of feasible functions, which severely…

机器学习 · 统计学 2023-07-06 Guangyu Wu , Anders Lindquist

We consider a basic problem in the general data streaming model, namely, to estimate a vector $f \in \Z^n$ that is arbitrarily updated (i.e., incremented or decremented) coordinate-wise. The estimate $\hat{f} \in \Z^n$ must satisfy…

计算复杂性 · 计算机科学 2008-04-07 Sumit Ganguly