A Light Discussion and Derivation of Entropy
Information Theory
2014-04-09 v1 math.IT
Abstract
The expression for entropy sometimes appears mysterious - as it often is asserted without justification. This short manuscript contains a discussion of the underlying assumptions behind entropy as well as simple derivation of this ubiquitous quantity.
Cite
@article{arxiv.1404.1998,
title = {A Light Discussion and Derivation of Entropy},
author = {Jonathon Shlens},
journal= {arXiv preprint arXiv:1404.1998},
year = {2014}
}