English
Related papers

Related papers: On Fine-Grained Distinct Element Estimation

200 papers

Many problems on data streams have been studied at two extremes of difficulty: either allowing randomized algorithms, in the static setting (where they should err with bounded probability on the worst case stream); or when only…

Data Structures and Algorithms · Computer Science 2022-11-11 Manuel Stoeckl

We study the problem of counting the number of distinct elements in a dataset subject to the constraint of differential privacy. We consider the challenging setting of person-level DP (a.k.a. user-level DP) where each person may contribute…

Data Structures and Algorithms · Computer Science 2023-10-30 Alexander Knop , Thomas Steinke

In this paper, we propose a fully distributed algorithm for frequency offsets estimation in decentralized systems. With the proposed algorithm, each node estimates its frequency offsets by local computations and limited exchange of…

Information Theory · Computer Science 2016-07-12 Jian Du , Yik-Chung Wu

We study the distributed computing setting in which there are multiple servers, each holding a set of points, who wish to compute functions on the union of their point sets. A key task in this setting is Principal Component Analysis (PCA),…

Machine Learning · Computer Science 2014-12-24 Maria-Florina Balcan , Vandana Kanchanapally , Yingyu Liang , David Woodruff

In this paper we study graph problems in dynamic streaming model, where the input is defined by a sequence of edge insertions and deletions. As many natural problems require $\Omega(n)$ space, where $n$ is the number of vertices, existing…

Data Structures and Algorithms · Computer Science 2016-05-03 Zengfeng Huang , Pan Peng

We revisit one of the classic problems in the data stream literature, namely, that of estimating the frequency moments $F_p$ for $0 < p < 2$ of an underlying $n$-dimensional vector presented as a sequence of additive updates in a stream. It…

Data Structures and Algorithms · Computer Science 2018-03-07 Vladimir Braverman , Emanuele Viola , David Woodruff , Lin F. Yang

We prove that any semi-streaming algorithm for $(1-\epsilon)$-approximation of maximum bipartite matching requires \[ \Omega(\frac{\log{(1/\epsilon)}}{{\log{(1/\beta)}}}) \] passes, where $\beta \in (0,1)$ is the largest parameter so that…

Data Structures and Algorithms · Computer Science 2023-10-12 Sepehr Assadi , Janani Sundaresan

The exact computation of the number of distinct elements (frequency moment $F_0$) is a fundamental problem in the study of data streaming algorithms. We denote the length of the stream by $n$ where each symbol is drawn from a universe of…

Computational Complexity · Computer Science 2014-02-28 Hartmut Klauck , Ved Prakash

Parameterized complexity attempts to give a more fine-grained analysis of the complexity of problems: instead of measuring the running time as a function of only the input size, we analyze the running time with respect to additional…

Data Structures and Algorithms · Computer Science 2019-11-22 Rajesh Chitnis , Graham Cormode

Fine-grained anomaly detection has recently been dominated by segmentation based approaches. These approaches first classify each element of the sample (e.g., image patch) as normal or anomalous and then classify the entire sample as…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Niv Cohen , Issar Tzachor , Yedid Hoshen

We investigate the estimation of multivariate extreme models with a discrete spectral measure using spherical clustering techniques. The primary contribution involves devising a method for selecting the order, that is, the number of…

Methodology · Statistics 2025-02-20 Shiyuan Deng , He Tang , Shuyang Bai

We study the distinct elements and $\ell_p$-heavy hitters problems in the sliding window model, where only the most recent $n$ elements in the data stream form the underlying set. We first introduce the composable histogram, a simple twist…

Data Structures and Algorithms · Computer Science 2023-04-12 Vladimir Braverman , Elena Grigorescu , Harry Lang , David P. Woodruff , Samson Zhou

We present two new local differentially private algorithms for frequency estimation. One solves the fundamental frequency oracle problem; the other solves the well-known heavy hitters identification problem. Consistent with prior art, these…

Data Structures and Algorithms · Computer Science 2022-02-18 Hao Wu , Anthony Wirth

We study distributed (strongly convex) optimization problems over a network of agents, with no centralized nodes. The loss functions of the agents are assumed to be \textit{similar}, due to statistical data similarity or otherwise. In order…

Optimization and Control · Mathematics 2022-04-12 Ye Tian , Gesualdo Scutari , Tianyu Cao , Alexander Gasnikov

When facing a very large stream of data, it is often desirable to extract most important statistics online in a short time and using small memory. For example, one may want to quickly find the most influential users generating posts online…

Data Structures and Algorithms · Computer Science 2022-03-30 Dariusz R. Kowalski , Dominik Pajak

Algorithm selection is crucial in the field of optimization, as no single algorithm performs perfectly across all types of optimization problems. Finding the best algorithm among a given set of algorithms for a given problem requires a…

Neural and Evolutionary Computing · Computer Science 2025-01-27 Saba Sadeghi Ahouei , Denis Antipov , Aneta Neumann , Frank Neumann

We give new upper and lower bounds on the minimax sample complexity of differentially private mean estimation of distributions with bounded $k$-th moments. Roughly speaking, in the univariate case, we show that $n =…

Data Structures and Algorithms · Computer Science 2021-02-17 Gautam Kamath , Vikrant Singhal , Jonathan Ullman

In the adversarially robust streaming model, a stream of elements is presented to an algorithm and is allowed to depend on the output of the algorithm at earlier times during the stream. In the classic insertion-only model of data streams,…

Data Structures and Algorithms · Computer Science 2022-10-24 David P. Woodruff , Samson Zhou

We give an improved algorithm for drawing a random sample from a large data stream when the input elements are distributed across multiple sites which communicate via a central coordinator. At any point in time the set of elements held by…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-03-29 Srikanta Tirthapura , David P. Woodruff

Frequency estimation is one of the most fundamental problems in streaming algorithms. Given a stream $S$ of elements from some universe $U=\{1 \ldots n\}$, the goal is to compute, in a single pass, a short sketch of $S$ so that for any…

Data Structures and Algorithms · Computer Science 2021-11-09 Piotr Indyk , Shyam Narayanan , David P. Woodruff