English

Codes for Tasks and R\'enyi Entropy Rate

Information Theory 2014-10-07 v2 math.IT

Abstract

A task is randomly drawn from a finite set of tasks and is described using a fixed number of bits. All the tasks that share its description must be performed. Upper and lower bounds on the minimum ρ\rho-th moment of the number of performed tasks are derived. The key is an analog of the Kraft Inequality for partitions of finite sets. When a sequence of tasks is produced by a source of a given R\'enyi entropy rate of order 1/(1+ρ)1/(1+\rho) and nn tasks are jointly described using nRnR bits, it is shown that for RR larger than the R\'enyi entropy rate, the ρ\rho-th moment of the ratio of performed tasks to nn can be driven to one as nn tends to infinity, and that for RR less than the R\'enyi entropy rate it tends to infinity. This generalizes a recent result for IID sources by the same authors. A mismatched version of the direct part is also considered, where the code is designed according to the wrong law. The penalty incurred by the mismatch can be expressed in terms of a divergence measure that was shown by Sundaresan to play a similar role in the Massey-Arikan guessing problem.

Keywords

Cite

@article{arxiv.1312.3735,
  title  = {Codes for Tasks and R\'enyi Entropy Rate},
  author = {Christoph Bunte and Amos Lapidoth},
  journal= {arXiv preprint arXiv:1312.3735},
  year   = {2014}
}

Comments

5 pages, to be presented at ISIT 2014; minor changes in the presentation, added a reference

R2 v1 2026-06-22T02:26:51.510Z