Classifying token frequencies using angular Minkowski $p$-distance
Abstract
Angular Minkowski -distance is a dissimilarity measure that is obtained by replacing Euclidean distance in the definition of cosine dissimilarity with other Minkowski -distances. Cosine dissimilarity is frequently used with datasets containing token frequencies, and angular Minkowski -distance may potentially be an even better choice for certain tasks. In a case study based on the 20-newsgroups dataset, we evaluate clasification performance for classical weighted nearest neighbours, as well as fuzzy rough nearest neighbours. In addition, we analyse the relationship between the hyperparameter , the dimensionality of the dataset, the number of neighbours , the choice of weights and the choice of classifier. We conclude that it is possible to obtain substantially higher classification performance with angular Minkowski -distance with suitable values for than with classical cosine dissimilarity.
Keywords
Cite
@article{arxiv.2309.14495,
title = {Classifying token frequencies using angular Minkowski $p$-distance},
author = {Oliver Urs Lenz and Chris Cornelis},
journal= {arXiv preprint arXiv:2309.14495},
year = {2023}
}
Comments
Accepted for publication in the proceedings of IJCRS 2023