English

Problems of robustness for universal coding schemes

Information Theory 2008-06-30 v1 Other Computer Science math.IT

Abstract

The Lempel-Ziv universal coding scheme is asymptotically optimal for the class of all stationary ergodic sources. A problem of robustness of this property under small violations of ergodicity is studied. A notion of deficiency of algorithmic randomness is used as a measure of disagreement between data sequence and probability measure. We prove that universal compressing schemes from a large class are non-robust in the following sense: if the randomness deficiency grows arbitrarily slowly on initial fragments of an infinite sequence then the property of asymptotic optimality of any universal compressing algorithm can be violated. Lempel-Ziv compressing algorithms are robust on infinite sequences generated by ergodic Markov chains when the randomness deficiency of its initial fragments of length nn grows as o(n)o(n).

Keywords

Cite

@article{arxiv.0806.4572,
  title  = {Problems of robustness for universal coding schemes},
  author = {V. V. V'yugin},
  journal= {arXiv preprint arXiv:0806.4572},
  year   = {2008}
}

Comments

23 pages

R2 v1 2026-06-21T10:55:09.466Z