On the entropy growth of sums of iid discrete random variables
Information Theory
2025-08-08 v1 math.IT
Abstract
We derive an asymptotic lower bound on the Shannon entropy of sums of arbitrary iid discrete random variables. The derived bound is given in terms of the incommensurability rank of the random variable -- a positive integer quantity that we introduce. The derivation does not rely on central limit theorems, but builds upon the known expressions of the asymptotic entropy of the multinomial distribution and sums of iid lattice random variables, which correspond to the case .
Keywords
Cite
@article{arxiv.2508.05348,
title = {On the entropy growth of sums of iid discrete random variables},
author = {Riccardo Castellano and Pavel Sekatski},
journal= {arXiv preprint arXiv:2508.05348},
year = {2025}
}
Comments
12 pages