Problems of robustness for universal coding schemes
Abstract
The Lempel-Ziv universal coding scheme is asymptotically optimal for the class of all stationary ergodic sources. A problem of robustness of this property under small violations of ergodicity is studied. A notion of deficiency of algorithmic randomness is used as a measure of disagreement between data sequence and probability measure. We prove that universal compressing schemes from a large class are non-robust in the following sense: if the randomness deficiency grows arbitrarily slowly on initial fragments of an infinite sequence then the property of asymptotic optimality of any universal compressing algorithm can be violated. Lempel-Ziv compressing algorithms are robust on infinite sequences generated by ergodic Markov chains when the randomness deficiency of its initial fragments of length grows as .
Keywords
Cite
@article{arxiv.0806.4572,
title = {Problems of robustness for universal coding schemes},
author = {V. V. V'yugin},
journal= {arXiv preprint arXiv:0806.4572},
year = {2008}
}
Comments
23 pages