English

On the entropy growth of sums of iid discrete random variables

Information Theory 2025-08-08 v1 math.IT

Abstract

We derive an asymptotic lower bound on the Shannon entropy HH of sums of NN arbitrary iid discrete random variables. The derived bound Hr(X)2log(N)+cstH \geq \frac{r(X)}{2}\log(N) + {\it cst} is given in terms of the incommensurability rank r(X)r(X) of the random variable -- a positive integer quantity that we introduce. The derivation does not rely on central limit theorems, but builds upon the known expressions of the asymptotic entropy of the multinomial distribution and sums of iid lattice random variables, which correspond to the case r(X)=1r(X)=1.

Keywords

Cite

@article{arxiv.2508.05348,
  title  = {On the entropy growth of sums of iid discrete random variables},
  author = {Riccardo Castellano and Pavel Sekatski},
  journal= {arXiv preprint arXiv:2508.05348},
  year   = {2025}
}

Comments

12 pages