English

Unbiased Estimating Equation on Inverse Divergence and Its Conditions

Information Theory 2024-08-22 v1 Machine Learning math.IT Statistics Theory Statistics Theory

Abstract

This paper focuses on the Bregman divergence defined by the reciprocal function, called the inverse divergence. For the loss function defined by the monotonically increasing function ff and inverse divergence, the conditions for the statistical model and function ff under which the estimating equation is unbiased are clarified. Specifically, we characterize two types of statistical models, an inverse Gaussian type and a mixture of generalized inverse Gaussian type distributions, to show that the conditions for the function ff are different for each model. We also define Bregman divergence as a linear sum over the dimensions of the inverse divergence and extend the results to the multi-dimensional case.

Keywords

Cite

@article{arxiv.2404.16519,
  title  = {Unbiased Estimating Equation on Inverse Divergence and Its Conditions},
  author = {Masahiro Kobayashi and Kazuho Watanabe},
  journal= {arXiv preprint arXiv:2404.16519},
  year   = {2024}
}

Comments

Accepted to the 2024 IEEE International Symposium on Information Theory (ISIT 2024)