On mutual information, likelihood-ratios and estimation error for the additive Gaussian channel
Probability
2016-11-18 v2 Information Theory
math.IT
Statistics Theory
Statistics Theory
Abstract
This paper considers the model of an arbitrary distributed signal x observed through an added independent white Gaussian noise w, y=x+w. New relations between the minimal mean square error of the non-causal estimator and the likelihood ratio between y and \omega are derived. This is followed by an extended version of a recently derived relation between the mutual information I(x;y) and the minimal mean square error. These results are applied to derive infinite dimensional versions of the Fisher information and the de Bruijn identity. The derivation of the results is based on the Malliavin calculus.
Keywords
Cite
@article{arxiv.math/0409548,
title = {On mutual information, likelihood-ratios and estimation error for the additive Gaussian channel},
author = {Moshe Zakai},
journal= {arXiv preprint arXiv:math/0409548},
year = {2016}
}
Comments
21 pages, to appear in the IEEE Transactions on Information Theory