On Relations Between the Relative entropy and $\chi^2$-Divergence, Generalizations and Applications
Abstract
The relative entropy and chi-squared divergence are fundamental divergence measures in information theory and statistics. This paper is focused on a study of integral relations between the two divergences, the implications of these relations, their information-theoretic applications, and some generalizations pertaining to the rich class of -divergences. Applications that are studied in this paper refer to lossless compression, the method of types and large deviations, strong~data-processing inequalities, bounds on contraction coefficients and maximal correlation, and the convergence rate to stationarity of a type of discrete-time Markov chains.
Keywords
Cite
@article{arxiv.2004.11197,
title = {On Relations Between the Relative entropy and $\chi^2$-Divergence, Generalizations and Applications},
author = {Tomohiro Nishiyama and Igal Sason},
journal= {arXiv preprint arXiv:2004.11197},
year = {2020}
}
Comments
Published in the Entropy journal, May 18, 2020. Journal version (open access) is available at https://www.mdpi.com/1099-4300/22/5/563