English

Classifying token frequencies using angular Minkowski $p$-distance

Machine Learning 2023-09-27 v1 Computation and Language

Abstract

Angular Minkowski pp-distance is a dissimilarity measure that is obtained by replacing Euclidean distance in the definition of cosine dissimilarity with other Minkowski pp-distances. Cosine dissimilarity is frequently used with datasets containing token frequencies, and angular Minkowski pp-distance may potentially be an even better choice for certain tasks. In a case study based on the 20-newsgroups dataset, we evaluate clasification performance for classical weighted nearest neighbours, as well as fuzzy rough nearest neighbours. In addition, we analyse the relationship between the hyperparameter pp, the dimensionality mm of the dataset, the number of neighbours kk, the choice of weights and the choice of classifier. We conclude that it is possible to obtain substantially higher classification performance with angular Minkowski pp-distance with suitable values for pp than with classical cosine dissimilarity.

Keywords

Cite

@article{arxiv.2309.14495,
  title  = {Classifying token frequencies using angular Minkowski $p$-distance},
  author = {Oliver Urs Lenz and Chris Cornelis},
  journal= {arXiv preprint arXiv:2309.14495},
  year   = {2023}
}

Comments

Accepted for publication in the proceedings of IJCRS 2023

R2 v1 2026-06-28T12:32:08.881Z