English

The {\alpha}-divergences associated with a pair of strictly comparable quasi-arithmetic means

Information Theory 2022-11-23 v4 math.IT

Abstract

We generalize the family of α\alpha-divergences using a pair of strictly comparable weighted means. In particular, we obtain the 11-divergence in the limit case α1\alpha\rightarrow 1 (a generalization of the Kullback-Leibler divergence) and the 00-divergence in the limit case α0\alpha\rightarrow 0 (a generalization of the reverse Kullback-Leibler divergence). We state the condition for a pair of quasi-arithmetic means to be strictly comparable, and report the formula for the quasi-arithmetic α\alpha-divergences and its subfamily of bipower homogeneous α\alpha-divergences which belong to the Csis\'ar's ff-divergences. Finally, we show that these generalized quasi-arithmetic 11-divergences and 00-divergences can be decomposed as the sum of generalized cross-entropies minus entropies, and rewritten as conformal Bregman divergences using monotone embeddings.

Keywords

Cite

@article{arxiv.2001.09660,
  title  = {The {\alpha}-divergences associated with a pair of strictly comparable quasi-arithmetic means},
  author = {Frank Nielsen},
  journal= {arXiv preprint arXiv:2001.09660},
  year   = {2022}
}

Comments

18 pages