English

Relationship between H\"{o}lder Divergence and Functional Density Power Divergence: Intersection and Generalization

Information Theory 2025-04-25 v1 math.IT Statistics Theory Machine Learning Statistics Theory

Abstract

In this study, we discuss the relationship between two families of density-power-based divergences with functional degrees of freedom -- the H\"{o}lder divergence and the functional density power divergence (FDPD) -- based on their intersection and generalization. These divergence families include the density power divergence and the γ\gamma-divergence as special cases. First, we prove that the intersection of the H\"{o}lder divergence and the FDPD is limited to a general divergence family introduced by Jones et al. (Biometrika, 2001). Subsequently, motivated by the fact that H\"{o}lder's inequality is used in the proofs of nonnegativity for both the H\"{o}lder divergence and the FDPD, we define a generalized divergence family, referred to as the ξ\xi-H\"{o}lder divergence. The nonnegativity of the ξ\xi-H\"{o}lder divergence is established through a combination of the inequalities used to prove the nonnegativity of the H\"{o}lder divergence and the FDPD. Furthermore, we derive an inequality between the composite scoring rules corresponding to different FDPDs based on the ξ\xi-H\"{o}lder divergence. Finally, we prove that imposing the mathematical structure of the H\"{o}lder score on a composite scoring rule results in the ξ\xi-H\"{o}lder divergence.

Cite

@article{arxiv.2504.17008,
  title  = {Relationship between H\"{o}lder Divergence and Functional Density Power Divergence: Intersection and Generalization},
  author = {Masahiro Kobayashi},
  journal= {arXiv preprint arXiv:2504.17008},
  year   = {2025}
}

Comments

20 pages, 1 figure

R2 v1 2026-06-28T23:09:00.551Z