Universally Typical Sets for Ergodic Sources of Multidimensional Data
Information Theory
2013-11-13 v3 math.IT
Abstract
We lift important results about universally typical sets, typically sampled sets, and empirical entropy estimation in the theory of samplings of discrete ergodic information sources from the usual one-dimensional discrete-time setting to a multidimensional lattice setting. We use techniques of packings and coverings with multidimensional windows to construct sequences of multidimensional array sets which in the limit build the generated samples of any ergodic source of entropy rate below an with probability one and whose cardinality grows at most at exponential rate .
Keywords
Cite
@article{arxiv.1105.0393,
title = {Universally Typical Sets for Ergodic Sources of Multidimensional Data},
author = {Tyll Krueger and Guido Montufar and Ruedi Seiler and Rainer Siegmund-Schultze},
journal= {arXiv preprint arXiv:1105.0393},
year = {2013}
}
Comments
15 pages, 1 figure. To appear in Kybernetika. This replacement corrects typos and slightly strengthens the main theorem