English
Related papers

Related papers: Asymptotic Theory of Geometric and Adaptive $k$-Me…

200 papers

A celebrated result of Pollard proves asymptotic consistency for $k$-means clustering when the population distribution has finite variance. In this work, we point out that the population-level $k$-means clustering problem is, in fact,…

Statistics Theory · Mathematics 2025-07-09 Moïse Blanchard , Adam Quinn Jaffe , Nikita Zhivotovskiy

The Euclidean k-means problem is arguably the most widely-studied clustering problem in machine learning. While the k-means objective is NP-hard in the worst-case, practitioners have enjoyed remarkable success in applying heuristics like…

Machine Learning · Computer Science 2017-12-05 Abhratanu Dutta , Aravindan Vijayaraghavan , Alex Wang

In this paper, we study the strong consistency of the sparse K-means clustering for high dimensional data. We prove the consistency in both risk and clustering for the Euclidean distance. We discuss the characterization of the limit of the…

Statistics Theory · Mathematics 2025-04-15 Jeungju Kim , Johan Lim

The $k$-means is one of the most important unsupervised learning techniques in statistics and computer science. The goal is to partition a data set into many clusters, such that observations within clusters are the most homogeneous and…

Machine Learning · Statistics 2022-11-21 Tonglin Zhang

We consider the robust algorithms for the $k$-means clustering problem where a quantizer is constructed based on $N$ independent observations. Our main results are median of means based non-asymptotic excess distortion bounds that hold…

Statistics Theory · Mathematics 2020-11-04 Yegor Klochkov , Alexey Kroshnin , Nikita Zhivotovskiy

$k$-means clustering is NP-hard in the worst case but previous work has shown efficient algorithms assuming the optimal $k$-means clusters are \emph{stable} under additive or multiplicative perturbation of data. This has two caveats. First,…

Data Structures and Algorithms · Computer Science 2019-02-27 Amit Deshpande , Anand Louis , Apoorv Vikram Singh

The $k$-median and $k$-means clustering objectives are classic objectives for modeling clustering in a metric space. Given a set of points in a metric space, the goal of the $k$-median (resp. $k$-means) problem is to find $k$ representative…

Computational Geometry · Computer Science 2026-03-11 Vincent Cohen-Addad , Karthik C. S. , David Saulpic , Chris Schwiegelshohn

This paper investigates the validity of Kleinberg's axioms for clustering functions with respect to the quite popular clustering algorithm called $k$-means. While Kleinberg's axioms have been discussed heavily in the past, we concentrate…

Machine Learning · Computer Science 2017-04-25 Robert Kłopotek , Mieczysław Kłopotek

We investigate the complexity of solving stable or perturbation-resilient instances of $k$-Means and $k$-Median clustering in fixed dimension Euclidean metrics (more generally doubling metrics). The notion of stable (perturbation resilient)…

Data Structures and Algorithms · Computer Science 2024-02-01 Zachary Friggstad , Kamyar Khodamoradi , Mohammad R. Salavatipour

We study Ward's method for the hierarchical $k$-means problem. This popular greedy heuristic is based on the \emph{complete linkage} paradigm: Starting with all data points as singleton clusters, it successively merges two clusters to form…

Data Structures and Algorithms · Computer Science 2019-07-12 Anna Großwendt , Heiko Röglin , Melanie Schmidt

The widely applied k-means algorithm produces clusterings that violate our expectations with respect to high/low similarity/density and is in conflict with Kleinberg's axiomatic system for distance based clustering algorithms that…

Machine Learning · Computer Science 2023-08-08 Mieczysław A. Kłopotek

We study the complexity of the classic capacitated k-median and k-means problems parameterized by the number of centers, k. These problems are notoriously difficult since the best known approximation bound for high dimensional Euclidean…

Data Structures and Algorithms · Computer Science 2022-08-31 Vincent Cohen-Addad , Jason Li

In addition to finding meaningful clusters, centroid-based clustering algorithms such as K-means or mean-shift should ideally find centroids that are valid patterns in the input space, representative of data in their cluster. This is…

Machine Learning · Computer Science 2014-06-17 Weiran Wang , Miguel Á. Carreira-Perpiñán

The problem of clustering is considered, for the case when each data point is a sample generated by a stationary ergodic process. We propose a very natural asymptotic notion of consistency, and show that simple consistent algorithms exist,…

Machine Learning · Computer Science 2013-05-01 Daniil Ryabko

The problem of clustering is considered, for the case when each data point is a sample generated by a stationary ergodic process. We propose a very natural asymptotic notion of consistency, and show that simple consistent algorithms exist,…

Machine Learning · Computer Science 2010-05-31 Daniil Ryabko

Consider an instance of Euclidean $k$-means or $k$-medians clustering. We show that the cost of the optimal solution is preserved up to a factor of $(1+\varepsilon)$ under a projection onto a random $O(\log(k / \varepsilon) /…

Data Structures and Algorithms · Computer Science 2020-04-10 Konstantin Makarychev , Yury Makarychev , Ilya Razenshteyn

We consider the Euclidean $k$-means clustering problem in a dynamic setting, where we have to explicitly maintain a solution (a set of $k$ centers) $S \subseteq \mathbb{R}^d$ subject to point insertions/deletions in $\mathbb{R}^d$. We…

Data Structures and Algorithms · Computer Science 2026-04-03 Sayan Bhattacharya , Martín Costa , Ermiya Farokhnejad , Shaofeng H. -C. Jiang , Yaonan Jin , Jianing Lou

\textit{Clustering problems} often arise in the fields like data mining, machine learning etc. to group a collection of objects into similar groups with respect to a similarity (or dissimilarity) measure. Among the clustering problems,…

Computational Geometry · Computer Science 2015-12-10 Sayan Bandyapadhyay , Kasturi Varadarajan

We consider the problem of center-based clustering in low-dimensional Euclidean spaces under the perturbation stability assumption. An instance is $\alpha$-stable if the underlying optimal clustering continues to remain optimal even when…

Data Structures and Algorithms · Computer Science 2020-10-01 Pankaj K. Agarwal , Hsien-Chih Chang , Kamesh Munagala , Erin Taylor , Emo Welzl

If multiway cluster-robust standard errors are used routinely in applied economics, surprisingly few theoretical results justify this practice. This paper aims to fill this gap. We first prove, under nearly the same conditions as with…

Econometrics · Economics 2018-08-06 Laurent Davezies , Xavier D'Haultfoeuille , Yannick Guyonvarch
‹ Prev 1 2 3 10 Next ›