The strong data processing inequality under the heat flow
Abstract
Let and be probability distributions on , and be their evolution under the heat flow, that is, the probability distributions resulting from convolving their density with the density of an isotropic Gaussian random vector with variance in each entry. This paper studies the rate of decay of for various divergences, including the and Kullback-Leibler (KL) divergences. We prove upper and lower bounds on the strong data-processing inequality (SDPI) coefficients corresponding to the source and the Gaussian channel. We also prove generalizations of de Brujin's identity, and Costa's result on the concavity in of the differential entropy of . As a byproduct of our analysis, we obtain new lower bounds on the mutual information between and , where is a standard Gaussian vector in , independent of , and on the minimum mean-square error (MMSE) in estimating from , in terms of the Poincar\'e constant of .
Keywords
Cite
@article{arxiv.2406.03427,
title = {The strong data processing inequality under the heat flow},
author = {Bo'az Klartag and Or Ordentlich},
journal= {arXiv preprint arXiv:2406.03427},
year = {2024}
}