English

A note on the $f$-divergences between multivariate location-scale families with either prescribed scale matrices or location parameters

Statistics Theory 2024-01-19 v3 Information Theory math.IT Statistics Theory

Abstract

We first extend the result of Ali and Silvey [Journal of the Royal Statistical Society: Series B, 28.1 (1966), 131-142] who first reported that any ff-divergence between two isotropic multivariate Gaussian distributions amounts to a corresponding strictly increasing scalar function of their corresponding Mahalanobis distance. We report sufficient conditions on the standard probability density function generating a multivariate location family and the function generator ff in order to generalize this result. This property is useful in practice as it allows to compare exactly ff-divergences between densities of these location families via their corresponding Mahalanobis distances, even when the ff-divergences are not available in closed-form as it is the case, for example, for the Jensen-Shannon divergence or the total variation distance between densities of a normal location family. Second, we consider ff-divergences between densities of multivariate scale families: We recall Ali and Silvey 's result that for normal scale families we get matrix spectral divergences, and we extend this result to densities of a scale family.

Keywords

Cite

@article{arxiv.2204.10952,
  title  = {A note on the $f$-divergences between multivariate location-scale families with either prescribed scale matrices or location parameters},
  author = {Frank Nielsen and Kazuki Okamura},
  journal= {arXiv preprint arXiv:2204.10952},
  year   = {2024}
}

Comments

17 pages, 1 table, 1 figure