Entropy, Transinformation and Word Distribution of Information-Carrying Sequences
Statistical Mechanics
2007-05-23 v1 Genomics
Abstract
We investigate correlations in information carriers, e.g. texts and pieces of music, which are represented by strings of letters. For information carrying strings generated by one source (i.e. a novel or a piece of music) we find correlations on many length scales. The word distribution, the higher order entropies and the transinformation are calculated. The analogy to strings generated through symbolic dynamics by nonlinear systems in critical states is discussed.
Cite
@article{arxiv.cond-mat/0204045,
title = {Entropy, Transinformation and Word Distribution of Information-Carrying Sequences},
author = {Werner Ebeling and Thorsten Poeschel and Karl-Friedrich Albrecht},
journal= {arXiv preprint arXiv:cond-mat/0204045},
year = {2007}
}
Comments
9 pages, 8 figures