English

The strong data processing inequality under the heat flow

Information Theory 2024-06-06 v1 Functional Analysis math.IT

Abstract

Let ν\nu and μ\mu be probability distributions on Rn\mathbb{R}^n, and νs,μs\nu_s,\mu_s be their evolution under the heat flow, that is, the probability distributions resulting from convolving their density with the density of an isotropic Gaussian random vector with variance ss in each entry. This paper studies the rate of decay of sD(νsμs)s\mapsto D(\nu_s\|\mu_s) for various divergences, including the χ2\chi^2 and Kullback-Leibler (KL) divergences. We prove upper and lower bounds on the strong data-processing inequality (SDPI) coefficients corresponding to the source μ\mu and the Gaussian channel. We also prove generalizations of de Brujin's identity, and Costa's result on the concavity in ss of the differential entropy of νs\nu_s. As a byproduct of our analysis, we obtain new lower bounds on the mutual information between XX and Y=X+sZY=X+\sqrt{s} Z, where ZZ is a standard Gaussian vector in Rn\mathbb{R}^n, independent of XX, and on the minimum mean-square error (MMSE) in estimating XX from YY, in terms of the Poincar\'e constant of XX.

Keywords

Cite

@article{arxiv.2406.03427,
  title  = {The strong data processing inequality under the heat flow},
  author = {Bo'az Klartag and Or Ordentlich},
  journal= {arXiv preprint arXiv:2406.03427},
  year   = {2024}
}
R2 v1 2026-06-28T16:54:49.204Z