Informational Divergence Approximations to Product Distributions
Information Theory
2013-05-14 v3 math.IT
Abstract
The minimum rate needed to accurately approximate a product distribution based on an unnormalized informational divergence is shown to be a mutual information. This result subsumes results of Wyner on common information and Han-Verd\'{u} on resolvability. The result also extends to cases where the source distribution is unknown but the entropy is known.
Cite
@article{arxiv.1302.0215,
title = {Informational Divergence Approximations to Product Distributions},
author = {Jie Hou and Gerhard Kramer},
journal= {arXiv preprint arXiv:1302.0215},
year = {2013}
}