English

The Capacity of Channels with Feedback

Information Theory 2007-07-13 v1 math.IT

Abstract

We introduce a general framework for treating channels with memory and feedback. First, we generalize Massey's concept of directed information and use it to characterize the feedback capacity of general channels. Second, we present coding results for Markov channels. This requires determining appropriate sufficient statistics at the encoder and decoder. Third, a dynamic programming framework for computing the capacity of Markov channels is presented. Fourth, it is shown that the average cost optimality equation (ACOE) can be viewed as an implicit single-letter characterization of the capacity. Fifth, scenarios with simple sufficient statistics are described.

Keywords

Cite

@article{arxiv.cs/0609139,
  title  = {The Capacity of Channels with Feedback},
  author = {Sekhar Tatikonda and Sanjoy Mitter},
  journal= {arXiv preprint arXiv:cs/0609139},
  year   = {2007}
}