On Evaluating the Quality of Rule-Based Classification Systems
Artificial Intelligence
2020-04-07 v1 Machine Learning
Logic in Computer Science
Abstract
Two indicators are classically used to evaluate the quality of rule-based classification systems: predictive accuracy, i.e. the system's ability to successfully reproduce learning data and coverage, i.e. the proportion of possible cases for which the logical rules constituting the system apply. In this work, we claim that these two indicators may be insufficient, and additional measures of quality may need to be developed. We theoretically show that classification systems presenting "good" predictive accuracy and coverage can, nonetheless, be trivially improved and illustrate this proposition with examples.
Cite
@article{arxiv.2004.02671,
title = {On Evaluating the Quality of Rule-Based Classification Systems},
author = {Nassim Dehouche},
journal= {arXiv preprint arXiv:2004.02671},
year = {2020}
}
Comments
ICIC Express Letters Volume 11, Number 10, October 2017