English
Related papers

Related papers: Taylor Polynomial Estimator for Estimating Frequen…

200 papers

Change point detection plays a fundamental role in many real-world applications, where the goal is to analyze and monitor the behaviour of a data stream. In this paper, we study change detection in binary streams. To this end, we use a…

Machine Learning · Computer Science 2023-01-24 Nikolaj Tatti

We consider the problem of statistical inference when the data is collected via a Thompson Sampling-type algorithm. While Thompson Sampling (TS) is known to be both asymptotically optimal and empirically effective, its adaptive sampling…

Machine Learning · Statistics 2026-03-17 Budhaditya Halder , Shubhayan Pan , Koulik Khamaru

Using the ratios theorems, we calculate the leading order terms in $N$ for the following averages of the characteristic polynomial and its derivative: $\left< \left|\Lambda_A(1 )\right| ^{r} \frac{ \Lambda_A'(\mathrm{e}^{\mathrm{i} \phi})…

Mathematical Physics · Physics 2025-08-28 I. A. Cooper , N. C. Snaith

We consider streaming algorithms for approximating a product of input probabilities up to multiplicative error of $1-\epsilon$. It is shown that every randomized streaming algorithm for this problem needs space $\Omega(\log n + \log b -…

Data Structures and Algorithms · Computer Science 2025-10-02 Markus Lohrey , Leon Rische , Louisa Seelbach Benkner , Julio Xochitemol

We study distributed algorithms for some fundamental problems in data summarization. Given a communication graph $G$ of $n$ nodes each of which may hold a value initially, we focus on computing $\sum_{i=1}^N g(f_i)$, where $f_i$ is the…

Data Structures and Algorithms · Computer Science 2019-08-07 Hsin-Hao Su , Hoa T. Vu

We revisit the classic #Knapsack problem, which asks to count the Boolean points $(x_1,\dots,x_n)\in\{0,1\}^n$ in a given half-space $\sum_{i=1}^nW_ix_i\le T$. This #P-complete problem admits $(1\pm\epsilon)$-approximation. Before this…

Data Structures and Algorithms · Computer Science 2024-10-30 Weiming Feng , Ce Jin

In this paper, we develop a general approach for probabilistic estimation and optimization. An explicit formula and a computational approach are established for controlling the reliability of probabilistic estimation based on a mixed…

Statistics Theory · Mathematics 2012-12-06 Xinjia Chen

We propose a novel estimation framework for quadratic functionals of precision matrices in high-dimensional settings, particularly in regimes where the feature dimension $p$ exceeds the sample size $n$. Traditional moment-based estimators…

Methodology · Statistics 2026-01-08 Shizhe Hong , Weiming Li , Guangming Pan

In large-scale applications, such as machine learning, it is desirable to design non-convex optimization algorithms with a high degree of parallelization. In this work, we study the adaptive complexity of finding a stationary point, which…

Optimization and Control · Mathematics 2025-05-15 Huanjian Zhou , Andi Han , Akiko Takeda , Masashi Sugiyama

Let $a_n$ be the random increasing sequence of natural numbers which takes each value independently with probability $n^{-a}$, $0 < a < 1/2$, and let $p(n) = n^{1+\epsilon}$, $0 < \epsilon < 1$. We prove that, almost surely, for every…

Dynamical Systems · Mathematics 2019-06-27 Ben Krause , Pavel Zorin-Kranich

The Chernoff bound is a well-known tool for obtaining a high probability bound on the expectation of a Bernoulli random variable in terms of its sample average. This bound is commonly used in statistical learning theory to upper bound the…

Machine Learning · Statistics 2022-05-18 Andrew Y. K. Foong , Wessel P. Bruinsma , David R. Burt

Assume in a sample of size M one finds M_i representatives of species i with i=1...N^*. The normalized frequency p^*_i=M_i/M, based on the finite sample, may deviate considerably from the true probabilities p_i. We propose a method to infer…

Other Quantitative Biology · Quantitative Biology 2007-05-23 Thorsten Poeschel , Werner Ebeling , Cornelius Froemmel , Rosa Ramirez

Compressed Counting (CC) [22] was recently proposed for estimating the ath frequency moments of data streams, where 0 < a <= 2. CC can be used for estimating Shannon entropy, which can be approximated by certain functions of the ath…

Data Structures and Algorithms · Computer Science 2012-05-14 Ping Li

There are many research works and methods about change point detection in the literature. However, there are only a few that provide inference for such change points after being estimated. This work mainly focuses on a statistical analysis…

Methodology · Statistics 2021-08-02 Reza Valiollahi Mehrizi , Shojaeddin Chenouri

We address complexity issues for linear differential equations in characteristic $p>0$: resolution and computation of the $p$-curvature. For these tasks, our main focus is on algorithms whose complexity behaves well with respect to $p$. We…

Symbolic Computation · Computer Science 2009-01-27 Alin Bostan , Éric Schost

Computing the approximate quantiles or ranks of a stream is a fundamental task in data monitoring. Given a stream of elements $x_1, x_2, \dots, x_n$ and a query $x$, a relative-error quantile estimation algorithm can estimate the rank of…

Data Structures and Algorithms · Computer Science 2024-11-05 Elena Gribelyuk , Pachara Sawettamalya , Hongxun Wu , Huacheng Yu

We consider the problems of distributed heavy hitters and frequency moments in both the coordinator model and the distributed tracking model (also known as the distributed functional monitoring model). We present simple and optimal (up to…

Data Structures and Algorithms · Computer Science 2025-05-21 Zengfeng Huang , Zhongzheng Xiong , Xiaoyi Zhu , Zhewei Wei

A C++ class was written for the calculation of frequentist confidence intervals using the profile likelihood method. Seven combinations of Binomial, Gaussian, Poissonian and Binomial uncertainties are implemented. The package provides…

Data Analysis, Statistics and Probability · Physics 2010-01-21 J. Lundberg , J. Conrad , W. Rolke , A. Lopez

We study the relative entropy of the empirical probability vector with respect to the true probability vector in multinomial sampling of $k$ categories, which, when multiplied by sample size $n$, is also the log-likelihood ratio statistic.…

Statistics Theory · Mathematics 2022-12-06 F. Richard Guo , Thomas S. Richardson

We present a protocol in the shuffle model of differential privacy (DP) for the \textit{frequency estimation} problem that achieves error $\omega(1)\cdot O(\log n)$, almost matching the central-DP accuracy, with $1+o(1)$ messages per user.…

Cryptography and Security · Computer Science 2022-11-23 Qiyao Luo , Yilei Wang , Ke Yi