English
Related papers

Related papers: Streaming Algorithms for Support-Aware Histograms

200 papers

Given a stream of data, a typical approach in streaming algorithms is to design a sophisticated algorithm with small memory that computes a specific statistic over the streaming data. Usually, if one wants to compute a different statistic…

Data Structures and Algorithms · Computer Science 2014-08-13 Vladimir Braverman , Rafail Ostrovsky , Alan Roytman

A novel approach is suggested for improving the accuracy of fault detection in distribution networks. This technique combines adaptive probability learning and waveform decomposition to optimize the similarity of features. Its objective is…

Signal Processing · Electrical Eng. & Systems 2023-10-03 Xinliang Ma , Weihua Liu , Bingying Jin

We provide a simple method and relevant theoretical analysis for efficiently estimating higher-order lp distances. While the analysis mainly focuses on l4, our methodology extends naturally to p = 6,8,10..., (i.e., when p is even).…

Machine Learning · Computer Science 2012-03-19 Ping Li , Michael W. Mahoney , Yiyuan She

The probabilistic-stream model was introduced by Jayram et al. \cite{JKV07}. It is a generalization of the data stream model that is suited to handling ``probabilistic'' data where each item of the stream represents a probability…

Data Structures and Algorithms · Computer Science 2007-05-23 Andrew McGregor , S. Muthukrishnan

Modern scientific instruments generate data at rates that increasingly exceed local compute capabilities and, when paired with the staging and I/O overheads of file-based transfers, also render file-based use of remote HPC resources…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-01 Flavio Castro , Weijian Zheng , Joaquin Chung , Ian Foster , Rajkumar Kettimuthu

We resolve the space complexity of single-pass streaming algorithms for approximating the classic set cover problem. For finding an $\alpha$-approximate set cover (for any $\alpha= o(\sqrt{n})$) using a single-pass streaming algorithm, we…

Data Structures and Algorithms · Computer Science 2016-03-21 Sepehr Assadi , Sanjeev Khanna , Yang Li

In todays digital era, data are everywhere from Internet of Things to health care or financial applications. This leads to potentially unbounded ever-growing Big data streams and it needs to be utilized effectively. Data normalization is an…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-24 Vibhuti Gupta , Rattikorn Hewett

Most of the existing methods for sparse signal recovery assume a static system: the unknown signal is a finite-length vector for which a fixed set of linear measurements and a sparse representation basis are available and an L1-norm…

Information Theory · Computer Science 2013-06-17 M. Salman Asif , Justin Romberg

We study the relation between streaming algorithms and linear sketching algorithms, in the context of binary updates. We show that for inputs in $n$ dimensions, the existence of efficient streaming algorithms which can process $\Omega(n^2)$…

Computational Complexity · Computer Science 2018-09-25 Kaave Hosseini , Shachar Lovett , Grigory Yaroslavtsev

We study $\ell_p$ sampling and frequency moment estimation in a single-pass insertion-only data stream. For $p \in (0,2)$, we present a nearly space-optimal approximate $\ell_p$ sampler that uses $\widetilde{O}(\log n \log(1/\delta))$ bits…

Data Structures and Algorithms · Computer Science 2026-04-07 Honghao Lin , Hoai-An Nguyen , William Swartworth , David P. Woodruff

We study the problem of graph and hypergraph sparsification in insertion-only data streams. The input is a hypergraph $H=(V, E, w)$ with $n$ nodes, $m$ hyperedges, and rank $r$, and the goal is to compute a hypergraph $\widehat{H}$ that…

Data Structures and Algorithms · Computer Science 2025-10-22 Vincent Cohen-Addad , David P. Woodruff , Shenghao Xie , Samson Zhou

We consider the streaming complexity of a fundamental task in approximate pattern matching: the $k$-mismatch problem. It asks to compute Hamming distances between a pattern of length $n$ and all length-$n$ substrings of a text for which the…

Data Structures and Algorithms · Computer Science 2018-04-10 Raphaël Clifford , Tomasz Kociumaka , Ely Porat

We initiate the study of sub-linear sketching and streaming techniques for estimating the output size of common dictionary compressors such as Lempel-Ziv '77, the run-length Burrows-Wheeler transform, and grammar compression. To this end,…

Data Structures and Algorithms · Computer Science 2024-08-20 Ruben Becker , Matteo Canton , Davide Cenzato , Sung-Hwan Kim , Bojana Kodric , Nicola Prezza

We study the notion of approximate entropy within the framework of network theory. Approximate entropy is an uncertainty measure originally proposed in the context of dynamical systems and time series. We firstly define a purely structural…

Disordered Systems and Neural Networks · Physics 2013-05-30 James West , Lucas Lacasa , Simone Severini , Andrew Teschendorff

The problem of estimating frequency moments of a data stream has attracted a lot of attention since the onset of streaming algorithms [AMS99]. While the space complexity for approximately computing the $p^{\rm th}$ moment, for $p\in(0,2]$…

Data Structures and Algorithms · Computer Science 2013-06-27 Alexandr Andoni , Huy L. Nguyen , Yury Polyanskiy , Yihong Wu

Recently, considerable efforts have been devoted to approximately computing the global and local (i.e., incident to each node) triangle counts of a large graph stream represented as a sequence of edges. Existing approximate triangle…

Data Structures and Algorithms · Computer Science 2018-11-27 Pinghui Wang , Peng Jia , Yiyan Qi , Yu Sun , Jing Tao , Xiaohong Guan

For an arbitrary family of predicates $\mathcal{F} \subseteq \{0,1\}^{[q]^k}$ and any $\epsilon > 0$, we prove a single-pass, linear-space streaming lower bound against the gap promise problem of distinguishing instances of…

Computational Complexity · Computer Science 2026-04-13 Noah G. Singer , Madhur Tulsiani , Santhoshini Velusamy

We propose a simple subsampling scheme for fast randomized approximate computation of optimal transport distances. This scheme operates on a random subset of the full data and can use any exact algorithm as a black-box back-end, including…

Computation · Statistics 2020-12-17 Max Sommerfeld , Jörn Schrieber , Yoav Zemel , Axel Munk

This paper presents a quantitative user study to evaluate how well users can visually perceive the underlying data distribution from a histogram representation. We used different sample and bin sizes and four different distributions…

Human-Computer Interaction · Computer Science 2021-09-15 Raphael Sahann , Torsten Möller , Johanna Schmidt

Broadcasting systems such as P2P streaming systems represent important network applications that support up to millions of online users. An efficient broadcasting mechanism is at the core of the system design. Despite substantial efforts on…

Networking and Internet Architecture · Computer Science 2013-12-13 Shaoquan Zhang