Understanding Shannon's Entropy metric for Information
Information Theory
2014-05-09 v1 math.IT
Abstract
Shannon's metric of "Entropy" of information is a foundational concept of information theory. This article is a primer for novices that presents an intuitive way of understanding, remembering, and/or reconstructing Shannon's Entropy metric for information.
Keywords
Cite
@article{arxiv.1405.2061,
title = {Understanding Shannon's Entropy metric for Information},
author = {Sriram Vajapeyam},
journal= {arXiv preprint arXiv:1405.2061},
year = {2014}
}
Comments
A primer for novices, presenting an intuitive way of understanding the topic