English

R\'enyi entropy and variance comparison for symmetric log-concave random variables

Information Theory 2021-10-05 v2 math.IT Probability

Abstract

We show that for any α>0\alpha>0 the R\'enyi entropy of order α\alpha is minimized, among all symmetric log-concave random variables with fixed variance, either for a uniform distribution or for a two sided exponential distribution. The first case occurs for α(0,α]\alpha \in (0,\alpha^*] and the second case for α[α,)\alpha \in [\alpha^*,\infty), where α\alpha^* satisfies the equation 1α1logα=12log6\frac{1}{\alpha^*-1}\log \alpha^*= \frac12 \log 6, that is α1.241\alpha^* \approx 1.241. Using those results, we prove that one-sided exponential distribution minimizes R\'enyi entropy of order α2\alpha \geq 2 among all log-concave random variables with fixed variance.

Keywords

Cite

@article{arxiv.2108.10100,
  title  = {R\'enyi entropy and variance comparison for symmetric log-concave random variables},
  author = {Maciej Białobrzeski and Piotr Nayar},
  journal= {arXiv preprint arXiv:2108.10100},
  year   = {2021}
}