English

Sample variance of rounded variables

Statistics Theory 2021-02-18 v1 Instrumentation and Methods for Astrophysics Data Analysis, Statistics and Probability Statistics Theory

Abstract

If the rounding errors are assumed to be distributed independently from the intrinsic distribution of the random variable, the sample variance s2s^2 of the rounded variable is given by the sum of the true variance σ2\sigma^2 and the variance of the rounding errors (which is equal to w2/12w^2/12 where ww is the size of the rounding window). Here the exact expressions for the sample variance of the rounded variables are examined and it is also discussed when the simple approximation s2=σ2+w2/12s^2=\sigma^2+w^2/12 can be considered valid. In particular, if the underlying distribution ff belongs to a family of symmetric normalizable distributions such that f(x)=σ1F(u)f(x)=\sigma^{-1}F(u) where u=(xμ)/σu=(x-\mu)/\sigma, and μ\mu and σ2\sigma^2 are the mean and variance of the distribution, then the rounded sample variance scales like s2(σ2+w2/12)σΦ(σ)s^2-(\sigma^2+w^2/12)\sim\sigma\Phi'(\sigma) as σ\sigma\to\infty where Φ(τ)=dueiuτF(u)\Phi(\tau)=\int_{-\infty}^\infty{\rm d}u\,e^{iu\tau}F(u) is the characteristic function of F(u)F(u). It follows that, roughly speaking, the approximation is valid for a slowly-varying symmetric underlying distribution with its variance sufficiently larger than the size of the rounding unit.

Keywords

Cite

@article{arxiv.2102.08483,
  title  = {Sample variance of rounded variables},
  author = {J. An},
  journal= {arXiv preprint arXiv:2102.08483},
  year   = {2021}
}
R2 v1 2026-06-23T23:13:51.161Z