Min-Mid-Max Scaling, Limits of Agreement, and Agreement Score
Methodology
2021-03-16 v5 Machine Learning
Abstract
In this paper, I solve a 60-year old question posed by Cohen's seminal paper (1960) and offer an agreement measure centered around the chance-expected agreement while isolating marginally forced agreement and disagreement. To achieve this, I formulate the minimum feasible agreement given row and column marginals by devising a new algorithm that minimizes the sum of diagonals in contingency tables. Based on this result, I also formulate the lower limit of the most common agreement measure-Cohen's kappa. Finally, I study the lower limit of maximum feasible agreement and devise two statistics of distribution similarity for agreement analysis.
Keywords
Cite
@article{arxiv.2006.12904,
title = {Min-Mid-Max Scaling, Limits of Agreement, and Agreement Score},
author = {Veli Safak},
journal= {arXiv preprint arXiv:2006.12904},
year = {2021}
}
Comments
Cohen's kappa, limits of agreement