English

Algorithms for finding $k$ in $k$-means

Data Structures and Algorithms 2020-12-09 v1 Information Retrieval

Abstract

kk-means Clustering requires as input the exact value of kk, the number of clusters. Two challenges are open: (i) Is there a data-determined definition of kk which is provably correct and (ii) Is there a polynomial time algorithm to find kk from data ? This paper provides the first affirmative answers to both these questions. As common in the literature, we assume that the data admits an unknown Ground Truth (GT) clustering with cluster centers separated. This assumption alone is not sufficient to answer Yes to (i). We assume a novel, but natural second constraint called no tight sub-cluster (NTSC) which stipulates that no substantially large subset of a GT cluster can be "tighter" (in a sense we define) than the cluster. Our yes answer to (i) and (ii) are under these two deterministic assumptions. We also give polynomial time algorithm to identify kk. Our algorithm relies on NTSC to peel off one cluster at a time by identifying points which are tightly packed. We are also able to show that our algorithm(s) apply to data generated by mixtures of Gaussians and more generally to mixtures of sub-Gaussian pdf's and hence are able to find the number of components of the mixture from data. To our knowledge, previous results for these specialized settings as well, assume generally that kk is given besides the data.

Keywords

Cite

@article{arxiv.2012.04388,
  title  = {Algorithms for finding $k$ in $k$-means},
  author = {Chiranjib Bhattacharyya and Ravindran Kannan and Amit Kumar},
  journal= {arXiv preprint arXiv:2012.04388},
  year   = {2020}
}

Comments

38 pages

R2 v1 2026-06-23T20:48:46.245Z