Weighted Approach to R\'enyi Entropy
Information Theory
2012-04-13 v3 math.IT
Abstract
R\'enyi entropy of order \alpha is a general measure of entropy. In this paper we derive estimations for the R\'enyi entropy of the mixture of sources in terms of the entropy of the single sources. These relations allow to compute the R\'enyi entropy dimension of arbitrary order of a mixture of measures. The key for obtaining these results is our new definition of the weighted R\'enyi entropy. It is shown that weighted entropy is equal to the classical R\'enyi entropy.
Cite
@article{arxiv.1204.0075,
title = {Weighted Approach to R\'enyi Entropy},
author = {Marek Śmieja and Jacek Tabor},
journal= {arXiv preprint arXiv:1204.0075},
year = {2012}
}