A Global Characterization of $f$-Divergences Yielding PSD Mutual-Information Matrices
Abstract
Given random variables, when does the matrix of pairwise -mutual informations define a PSD kernel over variables? For convex finite generators with and finite boundary value , we give a closed characterization up to linear transformation , which leaves every -divergence and every -mutual-information matrix unchanged. The matrix is PSD for every finite-alphabet family if and only if the normalized representative has a globally convergent expansion , with , on all of . Sufficiency follows from a replica embedding for monomial generators plus closure under nonnegative mixtures. Necessity first extracts the local Taylor cone at using biased three-point kernels , the Belton--Guillot--Khare--Putinar (BGKP) low-rank Hankel positivity-preserver theorem, and then bootstraps analyticity to the divergence. This is a kernel characterization problem, not a metric one: PSD of the variable-indexed matrix is distinct from Hilbertian properties of divergences between distributions. The result explains why Shannon MI and Jensen--Shannon fail, why succeeds, and why non-analytic divergences such as total variation and ReLU are excluded.
Keywords
Cite
@article{arxiv.2601.08929,
title = {A Global Characterization of $f$-Divergences Yielding PSD Mutual-Information Matrices},
author = {Zachary Robertson},
journal= {arXiv preprint arXiv:2601.08929},
year = {2026}
}
Comments
Revised main theorem and proof; fixes the local-to-global step and proves that the local analytic expansion extends to positive real line