English

Lempel-Ziv: a "one-bit catastrophe" but not a tragedy

Data Structures and Algorithms 2017-08-01 v2

Abstract

The so-called "one-bit catastrophe" for the compression algorithm LZ'78 asks whether the compression ratio of an infinite word can change when a single bit is added in front of it. We answer positively this open question raised by Lutz and others: we show that there exists an infinite word ww such that ρsup(w)=0\rho_{sup}(w)=0 but ρinf(0w)>0\rho_{inf}(0w)>0, where ρsup\rho_{sup} and ρinf\rho_{inf} are respectively the lim sup\limsup and the lim inf\liminf of the compression ratios ρ\rho of the prefixes. To that purpose we explore the behaviour of LZ'78 on finite words and show the following results: - There is a constant C>0C>0 such that, for any finite word ww and any letter aa, ρ(aw)Cρ(w)logw\rho(aw)\leq C\sqrt{\rho(w)\log|w|}. Thus, sufficiently compressible words (ρ(w)=o(1/logw)\rho(w)=o(1/\log|w|)) remain compressible with a letter in front; - The previous result is tight up to a multiplicative constant for any compression ratio ρ(w)=O(1/logw)\rho(w)=O(1/\log|w|). In particular, there are infinitely many words ww satisfying ρ(w)=O(1/logw)\rho(w)=O(1/\log|w|) but ρ(0w)=Ω(1)\rho(0w)=\Omega(1).

Keywords

Cite

@article{arxiv.1707.04312,
  title  = {Lempel-Ziv: a "one-bit catastrophe" but not a tragedy},
  author = {Guillaume Lagarde and Sylvain Perifel},
  journal= {arXiv preprint arXiv:1707.04312},
  year   = {2017}
}

Comments

42 pages, 6 figures