English

Another Look at the Physics of Large Deviations With Application to Rate-Distortion Theory

Information Theory 2009-08-26 v1 math.IT

Abstract

We revisit and extend the physical interpretation recently given to a certain identity between large--deviations rate--functions (as well as applications of this identity to Information Theory), as an instance of thermal equilibrium between several physical systems that are brought into contact. Our new interpretation, of mechanical equilibrium between these systems, is shown to have several advantages relative to that of thermal equilibrium. This physical point of view also provides a trigger to the development of certain alternative representations of the rate--distortion function and channel capacity, which are new to the best knowledge of the author.

Keywords

Cite

@article{arxiv.0908.3562,
  title  = {Another Look at the Physics of Large Deviations With Application to Rate-Distortion Theory},
  author = {Neri Merhav},
  journal= {arXiv preprint arXiv:0908.3562},
  year   = {2009}
}

Comments

10 pages, 2 figures, submitted to IEEE Trans. on Information Theory