English

An entropy inequality for symmetric random variables

Information Theory 2018-01-16 v1 math.IT Probability

Abstract

We establish a lower bound on the entropy of weighted sums of (possibly dependent) random variables (X1,X2,,Xn)(X_1, X_2, \dots, X_n) possessing a symmetric joint distribution. Our lower bound is in terms of the joint entropy of (X1,X2,,Xn)(X_1, X_2, \dots, X_n). We show that for n3n \geq 3, the lower bound is tight if and only if XiX_i's are i.i.d.\ Gaussian random variables. For n=2n=2 there are numerous other cases of equality apart from i.i.d.\ Gaussians, which we completely characterize. Going beyond sums, we also present an inequality for certain linear transformations of (X1,,Xn)(X_1, \dots, X_n). Our primary technical contribution lies in the analysis of the equality cases, and our approach relies on the geometry and the symmetry of the problem.

Keywords

Cite

@article{arxiv.1801.03868,
  title  = {An entropy inequality for symmetric random variables},
  author = {Jing Hao and Varun Jog},
  journal= {arXiv preprint arXiv:1801.03868},
  year   = {2018}
}

Comments

submitted to ISIT 2018

R2 v1 2026-06-22T23:42:56.176Z