English
Related papers

Related papers: Consistency and Inconsistency in $K$-Means Cluster…

200 papers

The asymptotic solution to the problem of comparing the means of two heteroscedastic populations, based on two random samples from the populations, hinges on the pivot underpinning the construction of the confidence interval and the test…

Statistics Theory · Mathematics 2017-10-30 Rajeshwari Majumdar , Suman Majumdar

Suppose $k$ centers are fit to $m$ points by heuristically minimizing the $k$-means cost; what is the corresponding fit over the source distribution? This question is resolved here for distributions with $p\geq 4$ bounded moments; in…

Machine Learning · Computer Science 2013-11-11 Matus Telgarsky , Sanjoy Dasgupta

In this manuscript, we study the statistical properties of convex clustering. We establish that convex clustering is closely related to single linkage hierarchical clustering and $k$-means clustering. In addition, we derive the range of…

Methodology · Statistics 2015-09-15 Kean Ming Tan , Daniela Witten

It is well known that if the power spectral density of a continuous time stationary stochastic process does not have a compact support, data sampled from that process at any uniform sampling rate leads to biased and inconsistent spectrum…

Statistics Theory · Mathematics 2010-06-09 Radhendushka Srivastava , Debasis Sengupta

In this work, the possibility of clustering correlated random variables was examined, both because of their mutual similarity and because of their similarity to the principal components. The k-means algorithm and spectral algorithms were…

Machine Learning · Computer Science 2019-09-10 Zenon Gniazdowski , Dawid Kaliszewski

This paper introduces a unified approach to cluster refinement and anomaly detection in datasets. We propose a novel algorithm that iteratively reduces the intra-cluster variance of N clusters until a global minimum is reached, yielding…

Machine Learning · Computer Science 2025-06-02 Vardhan Shorewala , Shivam Shorewala

Application of K-Means algorithm is restricted by the fact that the number of clusters should be known beforehand. Previously suggested methods to solve this problem are either ad hoc or require parametric assumptions and complicated…

Machine Learning · Computer Science 2019-12-05 Sukavanan Nanjundan , Shreeviknesh Sankaran , C. R. Arjun , G. Paavai Anand

We consider quantizing an $Ld$-dimensional sample, which is obtained by concatenating $L$ vectors from datasets of $d$-dimensional vectors, to a $d$-dimensional cluster center. The distortion measure is the weighted sum of $r$th powers of…

Machine Learning · Computer Science 2020-10-26 Erdem Koyuncu

Bauschke and Moursi have recently obtained results that implicitly contain the fact that the composition of finitely many averaged mappings on a Hilbert space that have approximate fixed points also has approximate fixed points and thus is…

Optimization and Control · Mathematics 2022-11-22 Andrei Sipos

This paper focuses on a setting with observations having a cluster dependence structure and presents two main impossibility results. First, we show that when there is only one large cluster, i.e., the researcher does not have any knowledge…

Econometrics · Economics 2023-06-07 Denis Kojevnikov , Kyungchul Song

The problem of time-series clustering is considered in the case where each data-point is a sample generated by a piecewise stationary ergodic process. Stationary processes are perhaps the most general class of processes considered in…

Machine Learning · Statistics 2019-06-27 Azadeh Khaleghi , Daniil Ryabko

Persistence is considered in diffusion--limited cluster--cluster aggregation, in one dimension and when the diffusion coefficient of a cluster depends on its size $s$ as $D(s) \sim s^\gamma$. The empty and filled site persistences are…

Statistical Mechanics · Physics 2016-08-16 E. K. O. Hellén , M. J. Alava

Clustering is a widely used and powerful machine learning technique, but its effectiveness is often limited by the need to specify the number of clusters, k, or by relying on thresholds that implicitly determine k. We introduce k*-means, a…

Machine Learning · Computer Science 2025-05-20 Louis Mahon , Mirella Lapata

This paper investigates the capability of correctly recovering well-separated clusters by various brands of the $k$-means algorithm. The concept of well-separatedness used here is derived directly from the common definition of clusters,…

Machine Learning · Computer Science 2023-08-07 Mieczysław A. Kłopotek

We introduce $k$-variance, a generalization of variance built on the machinery of random bipartite matchings. $K$-variance measures the expected cost of matching two sets of $k$ samples from a distribution to each other, capturing local…

Statistics Theory · Mathematics 2020-12-15 Justin Solomon , Kristjan Greenewald , Haikady N. Nagaraja

Clustering is one of the most important unsupervised problems in machine learning and statistics. Among many existing algorithms, kernel k-means has drawn much research attention due to its ability to find non-linear cluster boundaries and…

Machine Learning · Statistics 2016-12-05 Bowei Yan , Purnamrita Sarkar

We address general-shaped clustering problems under very weak parametric assumptions with a two-step hybrid robust clustering algorithm based on trimmed k-means and hierarchical agglomeration. The algorithm has low computational complexity…

Methodology · Statistics 2022-01-19 Luca Insolia , Domenico Perrotta

This paper considers a canonical clustering problem where one receives unlabeled samples drawn from a balanced mixture of two elliptical distributions and aims for a classifier to estimate the labels. Many popular methods including PCA and…

Machine Learning · Statistics 2021-11-30 Kaizheng Wang , Yuling Yan , Mateo Díaz

In many applications, data cluster. Failing to take the cluster structure into consideration generally leads to underestimated variances of point estimators and inflated type I errors in hypothesis tests. Many circumstance-dependent…

Methodology · Statistics 2025-07-21 Jiahua Chen , Pengfei Li , Yukun Liu , James V. Zidek

Clustering is a fundamental problem in unsupervised learning, and has been studied widely both as a problem of learning mixture models and as an optimization problem. In this paper, we study clustering with respect the emph{k-median}…

Data Structures and Algorithms · Computer Science 2013-01-07 Ramgopal Mettu , Greg Plaxton