English

Critical Behavior in Lossy Source Coding

Probability 2007-07-13 v1 Information Theory math.IT

Abstract

The following critical phenomenon was recently discovered. When a memoryless source is compressed using a variable-length fixed-distortion code, the fastest convergence rate of the (pointwise) compression ratio to the optimal R(D)R(D) bits/symbol is either O(n)O(\sqrt{n}) or O(logn)O(\log n). We show it is always O(n)O(\sqrt{n}), except for discrete, uniformly distributed sources.

Cite

@article{arxiv.math/0009018,
  title  = {Critical Behavior in Lossy Source Coding},
  author = {Amir Dembo and Ioannis Kontoyiannis},
  journal= {arXiv preprint arXiv:math/0009018},
  year   = {2007}
}

Comments

2 figures