Wasserstein KL-divergence for Gaussian distributions
Statistics Theory
2026-05-29 v2 Machine Learning
Statistics Theory
Abstract
We introduce a new version of the KL-divergence for Gaussian distributions which is based on Wasserstein geometry and referred to as WKL-divergence. We show that this version is consistent with the geometry of the sample space . In particular, we can evaluate the WKL-divergence of the Dirac measures concentrated in two points which turns out to be proportional to the squared distance between these points.
Cite
@article{arxiv.2503.24022,
title = {Wasserstein KL-divergence for Gaussian distributions},
author = {Adwait Datar and Nihat Ay},
journal= {arXiv preprint arXiv:2503.24022},
year = {2026}
}