Entropy and its discontents: A note on definitions
Information Theory
2014-08-08 v2 math.IT
Computational Physics
Data Analysis, Statistics and Probability
Abstract
The routine definitions of both entropy, and differential entropy show inconsistencies that make them not reciprocally coherent. We propose a few possible modifications of these quantities so that 1) they no longer show incongruities, 2) they go one into the other in a suitable limit as the result of a renormalization. The properties of the new quantities would slightly differ from that of the usual entropies in a few other respects
Keywords
Cite
@article{arxiv.1405.7601,
title = {Entropy and its discontents: A note on definitions},
author = {Nicola Cufaro Petroni},
journal= {arXiv preprint arXiv:1405.7601},
year = {2014}
}
Comments
18 pages, 7 figures; minor modifications required by referees; 1 reference and Acknowledgements added