Lower bounds on Information Divergence
Information Theory
2011-02-15 v1 math.IT
Probability
Abstract
In this paper we establish lower bounds on information divergence from a distribution to certain important classes of distributions as Gaussian, exponential, Gamma, Poisson, geometric, and binomial. These lower bounds are tight and for several convergence theorems where a rate of convergence can be computed, this rate is determined by the lower bounds proved in this paper. General techniques for getting lower bounds in terms of moments are developed.
Cite
@article{arxiv.1102.2536,
title = {Lower bounds on Information Divergence},
author = {Peter Harremoës and Christophe Vignat},
journal= {arXiv preprint arXiv:1102.2536},
year = {2011}
}
Comments
Submitted for the conference ISIT 2011