English

On mutual information, likelihood-ratios and estimation error for the additive Gaussian channel

Probability 2016-11-18 v2 Information Theory math.IT Statistics Theory Statistics Theory

Abstract

This paper considers the model of an arbitrary distributed signal x observed through an added independent white Gaussian noise w, y=x+w. New relations between the minimal mean square error of the non-causal estimator and the likelihood ratio between y and \omega are derived. This is followed by an extended version of a recently derived relation between the mutual information I(x;y) and the minimal mean square error. These results are applied to derive infinite dimensional versions of the Fisher information and the de Bruijn identity. The derivation of the results is based on the Malliavin calculus.

Keywords

Cite

@article{arxiv.math/0409548,
  title  = {On mutual information, likelihood-ratios and estimation error for the additive Gaussian channel},
  author = {Moshe Zakai},
  journal= {arXiv preprint arXiv:math/0409548},
  year   = {2016}
}

Comments

21 pages, to appear in the IEEE Transactions on Information Theory

R2 v1 2026-07-22T17:10:22.508Z