English

Wasserstein KL-divergence for Gaussian distributions

Statistics Theory 2026-05-29 v2 Machine Learning Statistics Theory

Abstract

We introduce a new version of the KL-divergence for Gaussian distributions which is based on Wasserstein geometry and referred to as WKL-divergence. We show that this version is consistent with the geometry of the sample space Rn{\Bbb R}^n. In particular, we can evaluate the WKL-divergence of the Dirac measures concentrated in two points which turns out to be proportional to the squared distance between these points.

Keywords

Cite

@article{arxiv.2503.24022,
  title  = {Wasserstein KL-divergence for Gaussian distributions},
  author = {Adwait Datar and Nihat Ay},
  journal= {arXiv preprint arXiv:2503.24022},
  year   = {2026}
}
R2 v1 2026-06-28T22:40:29.075Z