English

A penalized criterion for selecting the number of clusters for K-medians

Statistics Theory 2024-02-28 v3 Statistics Theory

Abstract

Clustering is a usual unsupervised machine learning technique for grouping the data points into groups based upon similar features. We focus here on unsupervised clustering for contaminated data, i.e in the case where K-medians should be preferred to K-means because of its robustness. More precisely, we concentrate on a common question in clustering: how to chose the number of clusters? The answer proposed here is to consider the choice of the optimal number of clusters as the minimization of a risk function via penalization. In this paper, we obtain a suitable penalty shape for our criterion and derive an associated oracle-type inequality. Finally, the performance of this approach with different types of K-medians algorithms is compared on a simulation study with other popular techniques. All studied algorithms are available in the R package Kmedians on CRAN.

Keywords

Cite

@article{arxiv.2209.03597,
  title  = {A penalized criterion for selecting the number of clusters for K-medians},
  author = {Antoine Godichon-Baggioni and Sobihan Surendran},
  journal= {arXiv preprint arXiv:2209.03597},
  year   = {2024}
}