English

Universally Typical Sets for Ergodic Sources of Multidimensional Data

Information Theory 2013-11-13 v3 math.IT

Abstract

We lift important results about universally typical sets, typically sampled sets, and empirical entropy estimation in the theory of samplings of discrete ergodic information sources from the usual one-dimensional discrete-time setting to a multidimensional lattice setting. We use techniques of packings and coverings with multidimensional windows to construct sequences of multidimensional array sets which in the limit build the generated samples of any ergodic source of entropy rate below an h0h_0 with probability one and whose cardinality grows at most at exponential rate h0h_0.

Keywords

Cite

@article{arxiv.1105.0393,
  title  = {Universally Typical Sets for Ergodic Sources of Multidimensional Data},
  author = {Tyll Krueger and Guido Montufar and Ruedi Seiler and Rainer Siegmund-Schultze},
  journal= {arXiv preprint arXiv:1105.0393},
  year   = {2013}
}

Comments

15 pages, 1 figure. To appear in Kybernetika. This replacement corrects typos and slightly strengthens the main theorem

R2 v1 2026-06-21T18:01:35.329Z