Shannon Meets Carnot: Mutual Information Via Thermodynamics
Information Theory
2008-06-20 v1 math.IT
Abstract
In this contribution, the Gaussian channel is represented as an equivalent thermal system allowing to express its input-output mutual information in terms of thermodynamic quantities. This thermodynamic description of the mutual information is based upon a generalization of the thermodynamic law and provides an alternative proof to the Guo-Shamai-Verd\'{u} theorem, giving an intriguing connection between this remarkable theorem and the most fundamental laws of nature - the laws of thermodynamics.
Cite
@article{arxiv.0806.3133,
title = {Shannon Meets Carnot: Mutual Information Via Thermodynamics},
author = {Ori Shental and Ido Kanter},
journal= {arXiv preprint arXiv:0806.3133},
year = {2008}
}