Sparse $K$-spatial-median clustering for high-dimensional data
Abstract
We propose a robust clustering framework for high-dimensional data with heavy tails and a large fraction of irrelevant variables. The method replaces the mean updates of Lloyd's -means with \emph{spatial medians} to enhance robustness. For the assignment step, it admits either a Euclidean rule for computational simplicity or a robust Mahalanobis-type metric constructed from the spatial sign covariance matrix to account for heterogeneous scales and feature dependence. To handle the regime, we further introduce a simple \emph{hard feature-exclusion} mechanism that removes weakly separating dimensions based on across-center dispersion, with the exclusion threshold selected automatically via a permutation-based Gap criterion. Simulation studies under correlated Gaussian and multivariate models demonstrate that the proposed approach provides competitive clustering accuracy and improved stability relative to -means and sparse -means baselines.
Cite
@article{arxiv.2605.00598,
title = {Sparse $K$-spatial-median clustering for high-dimensional data},
author = {Ping Zhao and Dan Zhuang and Long Feng},
journal= {arXiv preprint arXiv:2605.00598},
year = {2026}
}