The case for shifting the Renyi Entropy
Information Theory
2018-11-16 v1 math.IT
Abstract
We introduce a variant of the R\'enyi entropy definition that aligns it with the well-known H\"older mean: in the new formulation, the r-th order R\'enyi Entropy is the logarithm of the inverse of the r-th order H\"older mean. This brings about new insights into the relationship of the R\'enyi entropy to quantities close to it, like the information potential and the partition function of statistical mechanics. We also provide expressions that allow us to calculate the R\'enyi entropies from the Shannon cross-entropy and the escort probabilities. Finally, we discuss why shifting the R\'enyi entropy is fruitful in some applications.
Keywords
Cite
@article{arxiv.1811.06122,
title = {The case for shifting the Renyi Entropy},
author = {Francisco José Valverde-Albacete and Carmen Peláez-Moreno},
journal= {arXiv preprint arXiv:1811.06122},
year = {2018}
}
Comments
20 pages, 2 figures, 2 tables. arXiv admin note: text overlap with arXiv:1710.04728