English

Reweighted information inequalities

Information Theory 2026-03-16 v1 math.IT Probability

Abstract

We establish a variant of the log-Sobolev and transport-information inequalities for mixture distributions. If a probability measure π\pi can be decomposed into components that individually satisfy such inequalities, then any measure μ\mu close to π\pi in relative Fisher information is close in relative entropy or transport distance to a reweighted version of π\pi with the same mixture components but possibly different weights. This provides a user-friendly interpretation of Fisher information bounds for non-log-concave measures and explains phenomena observed in the analysis of Langevin Monte Carlo for multimodal distributions.

Keywords

Cite

@article{arxiv.2603.13135,
  title  = {Reweighted information inequalities},
  author = {Jonathan Niles-Weed},
  journal= {arXiv preprint arXiv:2603.13135},
  year   = {2026}
}
R2 v1 2026-07-01T11:18:41.933Z