English

Variable-Length Resolvability for Mixed Sources and its Application to Variable-Length Source Coding

Information Theory 2018-01-16 v1 math.IT

Abstract

In the problem of variable-length δ\delta-channel resolvability, the channel output is approximated by encoding a variable-length uniform random number under the constraint that the variational distance between the target and approximated distributions should be within a given constant δ\delta asymptotically. In this paper, we assume that the given channel input is a mixed source whose components may be general sources. To analyze the minimum achievable length rate of the uniform random number, called the δ\delta-resolvability, we introduce a variant problem of the variable-length δ\delta-channel resolvability. A general formula for the δ\delta-resolvability in this variant problem is established for a general channel. When the channel is an identity mapping, it is shown that the δ\delta-resolvability in the original and variant problems coincide. This relation leads to a direct derivation of a single-letter formula for the δ\delta-resolvability when the given source is a mixed memoryless source. We extend the result to the second-order case. As a byproduct, we obtain the first-order and second-order formulas for fixed-to-variable length source coding allowing error probability up to δ\delta.

Keywords

Cite

@article{arxiv.1801.04439,
  title  = {Variable-Length Resolvability for Mixed Sources and its Application to Variable-Length Source Coding},
  author = {Hideki Yagi and Te Sun Han},
  journal= {arXiv preprint arXiv:1801.04439},
  year   = {2018}
}

Comments

9 pages, submitted to 2018 IEEE International Symposium on Information Theory (ISIT2018)