Empirical entropy in context
Information Theory
2007-08-16 v1 math.IT
Abstract
We trace the history of empirical entropy, touching briefly on its relation to Markov processes, normal numbers, Shannon entropy, the Chomsky hierarchy, Kolmogorov complexity, Ziv-Lempel compression, de Bruijn sequences and stochastic complexity.
Keywords
Cite
@article{arxiv.0708.2084,
title = {Empirical entropy in context},
author = {Travis Gagie},
journal= {arXiv preprint arXiv:0708.2084},
year = {2007}
}
Comments
A survey of some results related to empirical entropy, written in the spring of 2007 as part of an introduction to a PhD thesis