English
Related papers

Related papers: Estimating small frequency moments of data stream:…

200 papers

We study streaming algorithms for the fundamental geometric problem of computing the cost of the Euclidean Minimum Spanning Tree (MST) on an $n$-point set $X \subset \mathbb{R}^d$. In the streaming model, the points in $X$ can be added and…

Data Structures and Algorithms · Computer Science 2022-12-14 Vincent Cohen-Addad , Xi Chen , Rajesh Jayaram , Amit Levi , Erik Waingarten

Here we present our Python toolbox "MR. Estimator" to reliably estimate the intrinsic timescale from electrophysiologal recordings of heavily subsampled systems. Originally intended for the analysis of time series from neuronal spiking…

Neurons and Cognition · Quantitative Biology 2021-05-11 F. P. Spitzner , J. Dehning , J. Wilting , A. Hagemann , J. P. Neto , J. Zierenberg , V. Priesemann

If two probability density functions (PDFs) have values for their first $n$ moments which are quite close to each other (upper bounds of their differences are known), can it be expected that the PDFs themselves are very similar? Shown below…

Statistics Theory · Mathematics 2018-08-16 Pranava Chaitanya Jayanti , Konstantina Trivisa

Distributed compressive sensing is a framework considering jointly sparsity within signal ensembles along with multiple measurement vectors (MMVs). The current theoretical bound of performance for MMVs, however, is derived to be the same…

Information Theory · Computer Science 2016-09-12 Sung-Hsien Hsieh , Wei-Jie Liang , Chun-Shien Lu , Soo-Chang Pei

The problem of quickest change detection is studied in the context of detecting an arbitrary unknown mean-shift in multiple independent Gaussian data streams. The James-Stein estimator is used in constructing detection schemes that exhibit…

Statistics Theory · Mathematics 2026-04-21 Topi Halme , Venugopal V. Veeravalli , Visa Koivunen

Multisine excitations are widely used for identifying multi-input multi-output systems due to their periodicity, data compression properties, and control over the input spectrum. Despite their popularity, the finite sample statistical…

A streaming algorithm is adversarially robust if it is guaranteed to perform correctly even in the presence of an adaptive adversary. Recently, several sophisticated frameworks for robustification of classical streaming algorithms have been…

Data Structures and Algorithms · Computer Science 2021-09-09 Omri Ben-Eliezer , Talya Eden , Krzysztof Onak

Entropy rate of sequential data-streams naturally quantifies the complexity of the generative process. Thus entropy rate fluctuations could be used as a tool to recognize dynamical perturbations in signal sources, and could potentially be…

Information Theory · Computer Science 2014-03-24 Ishanu Chattopadhyay , Hod Lipson

This paper presents in detail the originally developed Quadratic Point Estimate Method (QPEM), aimed at efficiently and accurately computing the first four output moments of probabilistic distributions, using 2n^2+1 sample (or sigma)…

Numerical Analysis · Mathematics 2024-03-21 Minhyeok Ko , Konstantinos G. Papakonstantinou

The standard approximation of a natural logarithm in statistical analysis interprets a linear change of \(p\) in \(\ln(X)\) as a \((1+p)\) proportional change in \(X\), which is only accurate for small values of \(p\). I suggest…

Econometrics · Economics 2021-10-07 Nick Huntington-Klein

Fractional moments have been investigated by many authors to represent the density of univariate and bivariate random variables in different contexts. Fractional moments are indeed important when the density of the random variable has…

Statistical Mechanics · Physics 2009-11-18 Giulio Cottone , Mario Di Paola , Ralf Metzler

It is generally hard to count, or even estimate, how many integer points lie in a polytope P. Barvinok and Hartigan have approached the problem by way of information theory, showing how to efficiently compute a random vector which samples…

Combinatorics · Mathematics 2010-11-30 Austin Shapiro

We revisit the problem of computing with noisy information considered in Feige et al. 1994, which includes computing the OR function from noisy queries, and computing the MAX, SEARCH and SORT functions from noisy pairwise comparisons. For…

Data Structures and Algorithms · Computer Science 2023-06-22 Banghua Zhu , Ziao Wang , Nadim Ghaddar , Jiantao Jiao , Lele Wang

We present data streaming algorithms for the $k$-median problem in high-dimensional dynamic geometric data streams, i.e. streams allowing both insertions and deletions of points from a discrete Euclidean space $\{1, 2, \ldots \Delta\}^d$.…

Data Structures and Algorithms · Computer Science 2017-06-14 Vladimir Braverman , Gereon Frahling , Harry Lang , Christian Sohler , Lin F. Yang

Data stream monitoring is a crucial task which has a wide range of applications. The majority of existing research in this area can be broadly classified into two types, monitoring value sum and monitoring value cardinality. In this paper,…

Databases · Computer Science 2025-05-21 Siyuan Dong , Yuxuan Tian , Wenhan Ma , Tong Yang , Chenye Zhang , Yuhan Wu , Kaicheng Yang , Yaojing Wang

We study the approximation of arbitrary distributions $P$ on $d$-dimensional space by distributions with log-concave density. Approximation means minimizing a Kullback--Leibler-type functional. We show that such an approximation exists if…

Statistics Theory · Mathematics 2011-10-17 Lutz Duembgen , Richard Samworth , Dominic Schuhmacher

This paper studies the \emph{subset sampling} problem. The input is a set $\mathcal{S}$ of $n$ records together with a function $\textbf{p}$ that assigns each record $v\in\mathcal{S}$ a probability $\textbf{p}(v)$. A query returns a random…

Data Structures and Algorithms · Computer Science 2023-07-24 Jinchao Huang , Sibo Wang

Recently, in the context of covariance matrix estimation, in order to improve as well as to regularize the performance of the Tyler's estimator [1] also called the Fixed-Point Estimator (FPE) [2], a "shrinkage" fixed-point estimator has…

Applications · Statistics 2015-06-18 Frederic Pascal , Yacine Chitour , Yihui Quek

A finite-energy signal is represented by a square-integrable, complex-valued function $t\mapsto s(t)$ of a real variable $t$, interpreted as time. Similarly, a noisy signal is represented by a random process. Time-frequency analysis, a…

Signal Processing · Electrical Eng. & Systems 2025-04-16 Barbara Pascal , Rémi Bardenet

We propose a new method for the calculation of the statistical properties, as e.g. the entropy, of unknown generators of symbolic sequences. The probability distribution p(k) of the elements k of a population can be approximated by the…

Statistical Mechanics · Physics 2015-06-24 Thorsten Poeschel , Werner Ebeling , Helge Rose