An inequality connecting entropy distance, Fisher Information and large deviations
Functional Analysis
2018-12-12 v1 Probability
Abstract
In this paper we introduce a new generalisation of the relative Fisher Information for Markov jump processes on a finite or countable state space, and prove an inequality which connects this object with the relative entropy and a large deviation rate functional. In addition to possessing various favourable properties, we show that this generalised Fisher Information converges to the classical Fisher Information in an appropriate limit. We then use this generalised Fisher Information and the aforementioned inequality to qualitatively study coarse-graining problems for jump processes on discrete spaces.
Keywords
Cite
@article{arxiv.1812.04358,
title = {An inequality connecting entropy distance, Fisher Information and large deviations},
author = {Bastian Hilder and Mark A. Peletier and Upanshu Sharma and Oliver Tse},
journal= {arXiv preprint arXiv:1812.04358},
year = {2018}
}
Comments
38 pages, 1 figure