English
Related papers

Related papers: Frequency Moments in Noisy Streaming and Distribut…

200 papers

Due to the over-emphasize of the quantity of data, the data quality has often been overlooked. However, not all training data points contribute equally to learning. In particular, if mislabeled, it might actively damage the performance of…

Machine Learning · Computer Science 2021-09-13 Vaibhav Pulastya , Gaurav Nuti , Yash Kumar Atri , Tanmoy Chakraborty

Models that adapt their predictions based on some given contexts, also known as in-context learning, have become ubiquitous in recent years. We propose to study the behavior of such models when data is contaminated by noise. Towards this…

Machine Learning · Computer Science 2024-11-05 Chen Shapira , Dan Rosenbaum

Motivated by data-rich experiments in transcriptional regulation and sensory neuroscience, we consider the following general problem in statistical inference. When exposed to a high-dimensional signal S, a system of interest computes a…

Quantitative Methods · Quantitative Biology 2013-12-16 Justin B. Kinney , Gurinder S. Atwal

The efficient estimation of frequency moments of a data stream in one-pass using limited space and time per item is one of the most fundamental problem in data stream processing. An especially important estimation is to find the number of…

Data Structures and Algorithms · Computer Science 2010-10-29 Gokarna Sharma , Costas Busch , Srikanta Tirthapura

In this paper we consider the problem of approximating frequency moments in the streaming model. Given a stream $D = \{p_1,p_2,\dots,p_m\}$ of numbers from $\{1,\dots, n\}$, a frequency of $i$ is defined as $f_i = |\{j: p_j = i\}|$. The…

Data Structures and Algorithms · Computer Science 2014-01-28 Vladimir Braverman , Jonathan Katzman , Charles Seidell , Gregory Vorsanger

In stochastic simulation, input uncertainty refers to the output variability arising from the statistical noise in specifying the input models. This uncertainty can be measured by a variance contribution in the output, which, in the…

Methodology · Statistics 2021-05-20 Henry Lam , Huajie Qian

We consider the problems of distributed heavy hitters and frequency moments in both the coordinator model and the distributed tracking model (also known as the distributed functional monitoring model). We present simple and optimal (up to…

Data Structures and Algorithms · Computer Science 2025-05-21 Zengfeng Huang , Zhongzheng Xiong , Xiaoyi Zhu , Zhewei Wei

Real-world measurements often comprise a dominant signal contaminated by a noisy background. Robustly estimating the dominant signal in practice has been a fundamental statistical problem. Classically, mixture models have been used to…

Computation · Statistics 2026-05-20 Ananyabrata Barua , Ayanendranath Basu

The rapid growth of high-dimensional datasets across various scientific domains has created a pressing need for new statistical methods to compare distributions supported on their underlying structures. Assessing similarity between datasets…

Statistics Theory · Mathematics 2025-11-27 Hongrui Chen , Rong Ma

Histograms, i.e., piece-wise constant approximations, are a popular tool used to represent data distributions. Traditionally, the difference between the histogram and the underlying distribution (i.e., the approximation error) is measured…

Data Structures and Algorithms · Computer Science 2022-07-19 Justin Y. Chen , Piotr Indyk , Tal Wagner

One of the oldest problems in the data stream model is to approximate the $p$-th moment $\|\mathcal{X}\|_p^p = \sum_{i=1}^n |\mathcal{X}_i|^p$ of an underlying vector $\mathcal{X} \in \mathbb{R}^n$, which is presented as a sequence of…

Data Structures and Algorithms · Computer Science 2019-07-15 Rajesh Jayaram , David P. Woodruff

Functional connectivity estimates are highly sensitive to analysis choices and can be dominated by noise when the number of sampled time points is small relative to network dimensionality. This issue is particularly acute in fMRI, where…

Disordered Systems and Neural Networks · Physics 2026-02-10 Izaro Fernandez-Iriondo , Antonio Jimenez-Marin , Jesus Cortes , Pablo Villegas

We study the fundamental problem of frequency estimation under both privacy and communication constraints, where the data is distributed among $k$ parties. We consider two application scenarios: (1) one-shot, where the data is static and…

Cryptography and Security · Computer Science 2021-06-01 Ziyue Huang , Yuan Qiu , Ke Yi , Graham Cormode

Given data stream $D = \{p_1,p_2,...,p_m\}$ of size $m$ of numbers from $\{1,..., n\}$, the frequency of $i$ is defined as $f_i = |\{j: p_j = i\}|$. The $k$-th \emph{frequency moment} of $D$ is defined as $F_k = \sum_{i=1}^n f_i^k$. We…

Data Structures and Algorithms · Computer Science 2012-12-05 Vladimir Braverman , Rafail Ostrovsky

This paper studies problems of inferring order given noisy information. In these problems there is an unknown order (permutation) $\pi$ on $n$ elements denoted by $1,...,n$. We assume that information is generated in a way correlated with…

Data Structures and Algorithms · Computer Science 2009-10-08 Mark Braverman , Elchanan Mossel

While it is common practice in applied network analysis to report various standard network summary statistics, these numbers are rarely accompanied by uncertainty quantification. Yet any error inherent in the measurements underlying the…

Methodology · Statistics 2022-05-06 Jinyuan Chang , Eric D. Kolaczyk , Qiwei Yao

In this paper, we study a simple correlation-based strategy for estimating the unknown delay and amplitude of a signal based on a small number of noisy, randomly chosen frequency-domain samples. We model the output of this "compressive…

Information Theory · Computer Science 2016-11-17 Armin Eftekhari , Justin Romberg , Michael B. Wakin

We introduce a new computational model for data streams: asymptotically exact streaming algorithms. These algorithms have an approximation ratio that tends to one as the length of the stream goes to infinity while the memory used by the…

Data Structures and Algorithms · Computer Science 2014-08-11 Marc Heinrich , Alexander Munteanu , Christian Sohler

Estimating the first moment of a data stream defined as $F_1 = \sum_{i \in \{1, 2, \ldots, n\}} \abs{f_i}$ to within $1 \pm \epsilon$-relative error with high probability is a basic and influential problem in data stream processing. A tight…

Data Structures and Algorithms · Computer Science 2015-03-17 Sumit Ganguly , Purushottam Kar

Originated from distributed learning, federated learning enables privacy-preserved collaboration on a new abstracted level by sharing the model parameters only. While the current research mainly focuses on optimizing learning algorithms and…

Machine Learning · Computer Science 2020-09-17 Cong Wang , Yuanyuan Yang , Pengzhan Zhou