English

Entropy Density and Mismatch in High-Rate Scalar Quantization with Renyi Entropy Constraint

Information Theory 2012-03-27 v2 math.IT

Abstract

Properties of scalar quantization with rrth power distortion and constrained R\'enyi entropy of order α(0,1)\alpha\in (0,1) are investigated. For an asymptotically (high-rate) optimal sequence of quantizers, the contribution to the R\'enyi entropy due to source values in a fixed interval is identified in terms of the "entropy density" of the quantizer sequence. This extends results related to the well-known point density concept in optimal fixed-rate quantization. A dual of the entropy density result quantifies the distortion contribution of a given interval to the overall distortion. The distortion loss resulting from a mismatch of source densities in the design of an asymptotically optimal sequence of quantizers is also determined. This extends Bucklew's fixed-rate (α=0\alpha=0) and Gray \emph{et al.}'s variable-rate (α=1\alpha=1) mismatch results to general values of the entropy order parameter α\alpha.

Keywords

Cite

@article{arxiv.1108.1730,
  title  = {Entropy Density and Mismatch in High-Rate Scalar Quantization with Renyi Entropy Constraint},
  author = {Wolfgang Kreitmeier and Tamas Linder},
  journal= {arXiv preprint arXiv:1108.1730},
  year   = {2012}
}

Comments

25 pages

R2 v1 2026-06-21T18:47:51.137Z