Entropy methods for the confidence assessment of probabilistic classification models
Machine Learning
2021-03-30 v1 Machine Learning
Methodology
Abstract
Many classification models produce a probability distribution as the outcome of a prediction. This information is generally compressed down to the single class with the highest associated probability. In this paper, we argue that part of the information that is discarded in this process can be in fact used to further evaluate the goodness of models, and in particular the confidence with which each prediction is made. As an application of the ideas presented in this paper, we provide a theoretical explanation of a confidence degradation phenomenon observed in the complement approach to the (Bernoulli) Naive Bayes generative model.
Keywords
Cite
@article{arxiv.2103.15157,
title = {Entropy methods for the confidence assessment of probabilistic classification models},
author = {Gabriele N. Tornetta},
journal= {arXiv preprint arXiv:2103.15157},
year = {2021}
}
Comments
12 pages, 7 figures