English
Related papers

Related papers: Boosting the Basic Counting on Distributed Streams

200 papers

We introduce a new technique for bounding the cover time of random walks by relating it to the runtime of randomized broadcast. In particular, we strongly confirm for dense graphs the intuition of Chandra et al. \cite{CRRST97} that "the…

Data Structures and Algorithms · Computer Science 2009-02-11 Robert Elsässer , Thomas Sauerwald

Depth first search (DFS) tree is a fundamental data structure for solving various graph problems. The classical DFS algorithm requires $O(m+n)$ time for a graph having $n$ vertices and $m$ edges. In the streaming model, an algorithm is…

Data Structures and Algorithms · Computer Science 2019-01-14 Shahbaz Khan , Shashank K. Mehta

The need for real time analysis of rapidly producing data streams (e.g., video and image streams) motivated the design of streaming algorithms that can efficiently extract and summarize useful information from massive data "on the fly".…

Data Structures and Algorithms · Computer Science 2017-12-27 Baharan Mirzasoleiman , Stefanie Jegelka , Andreas Krause

Frequency estimation of elements is an important task for summarizing data streams and machine learning applications. The problem is often addressed by using streaming algorithms with sublinear space data structures. These algorithms allow…

Data Structures and Algorithms · Computer Science 2022-04-05 Nikita Seleznev , Senthil Kumar , C. Bayan Bruss

Approximating quantiles and distributions over streaming data has been studied for roughly two decades now. Recently, Karnin, Lang, and Liberty proposed the first asymptotically optimal algorithm for doing so. This manuscript complements…

Data Structures and Algorithms · Computer Science 2019-07-02 Nikita Ivkin , Edo Liberty , Kevin Lang , Zohar Karnin , Vladimir Braverman

Operations over data streams typically hinge on efficient mechanisms to aggregate or summarize history on a rolling basis. For high-volume data steams, it is critical to manage state in a manner that is fast and memory efficient --…

Data Structures and Algorithms · Computer Science 2024-09-24 Matthew Andres Moreno , Luis Zaman , Emily Dolson

In the streaming model, the order of the stream can significantly affect the difficulty of a problem. A $t$-semirandom stream was introduced as an interpolation between random-order ($t=1$) and adversarial-order ($t=n$) streams where an…

Data Structures and Algorithms · Computer Science 2017-11-28 Harry Lang

The past decade has seen rapid growth of distributed stream data processing systems. Under these systems, a stream application is realized as a Directed Acyclic Graph (DAG) of operators, where the level of parallelism of each operator has a…

Databases · Computer Science 2023-09-22 Jinqing Lian , Xinyi Zhang , Yingxia Shao , Zenglin Pu , Qingfeng Xiang , Yawen Li , Bin Cui

We study the maximum matching problem in the random-order semi-streaming setting. In this problem, the edges of an arbitrary $n$-vertex graph $G=(V, E)$ arrive in a stream one by one and in a random order. The goal is to have a single pass…

Data Structures and Algorithms · Computer Science 2021-03-02 Sepehr Assadi , Soheil Behnezhad

The turnstile continual release model of differential privacy captures scenarios where a privacy-preserving real-time analysis is sought for a dataset evolving through additions and deletions. In typical applications of real-time data…

Data Structures and Algorithms · Computer Science 2025-05-30 Rachel Cummings , Alessandro Epasto , Jieming Mao , Tamalika Mukherjee , Tingting Ou , Peilin Zhong

We study the problem of graph and hypergraph sparsification in insertion-only data streams. The input is a hypergraph $H=(V, E, w)$ with $n$ nodes, $m$ hyperedges, and rank $r$, and the goal is to compute a hypergraph $\widehat{H}$ that…

Data Structures and Algorithms · Computer Science 2025-10-22 Vincent Cohen-Addad , David P. Woodruff , Shenghao Xie , Samson Zhou

In the adversarially robust streaming model, a stream of elements is presented to an algorithm and is allowed to depend on the output of the algorithm at earlier times during the stream. In the classic insertion-only model of data streams,…

Data Structures and Algorithms · Computer Science 2022-10-24 David P. Woodruff , Samson Zhou

In the context of the genome-wide association studies (GWAS), one has to solve long sequences of generalized least-squares problems; such a task has two limiting factors: execution time --often in the range of days or weeks-- and data…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-05-02 Lucas Beyer , Paolo Bientinesi

Depth first search is a fundamental graph problem having a wide range of applications. For a graph $G=(V,E)$ having $n$ vertices and $m$ edges, the DFS tree can be computed in $O(m+n)$ using $O(m)$ space where $m=O(n^2)$. In the streaming…

Data Structures and Algorithms · Computer Science 2024-06-10 Kancharla Nikhilesh Bhagavan , Macharla Sri Vardhan , Madamanchi Ashok Chowdary , Shahbaz Khan

We study the problem of estimating the maximum matching size in graphs whose edges are revealed in a streaming manner. We consider both insertion-only streams and dynamic streams and present new upper and lower bound results for both…

Data Structures and Algorithms · Computer Science 2017-01-17 Sepehr Assadi , Sanjeev Khanna , Yang Li

Set cover, over a universe of size $n$, may be modelled as a data-streaming problem, where the $m$ sets that comprise the instance are to be read one by one. A semi-streaming algorithm is allowed only $O(n\, \mathrm{poly}\{\log n, \log…

Computational Complexity · Computer Science 2015-08-11 Amit Chakrabarti , Anthony Wirth

Predictive queries over spatiotemporal (ST) stream data pose significant data processing and analysis challenges. ST data streams involve a set of time series whose data distributions may vary in space and time, exhibiting multiple distinct…

Machine Learning · Statistics 2024-10-03 Anderson Chaves , Eduardo Ogasawara , Patrick Valduriez , Fabio Porto

While ML model training and inference are both GPU-intensive, CPU-based data processing is often the bottleneck. Distributed data processing systems based on the batch or stream processing models assume homogeneous resource requirements.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-23 Frank Sifei Luan , Ron Yifeng Wang , Yile Gu , Ziming Mao , Charlotte Lin , Amog Kamsetty , Hao Chen , Cheng Su , Balaji Veeramani , Scott Lee , SangBin Cho , Clark Zinzow , Eric Liang , Ion Stoica , Stephanie Wang

Gaussian processes offer a flexible kernel method for regression. While Gaussian processes have many useful theoretical properties and have proven practically useful, they suffer from poor scaling in the number of observations. In…

Machine Learning · Statistics 2021-08-26 Nick Terry , Youngjun Choe

Estimating frequencies of items over data streams is a common building block in streaming data measurement and analysis. Misra and Gries introduced their seminal algorithm for the problem in 1982, and the problem has since been revisited…

Data Structures and Algorithms · Computer Science 2017-05-23 Daniel Anderson , Pryce Bevan , Kevin Lang , Edo Liberty , Lee Rhodes , Justin Thaler