English
Related papers

Related papers: A notion of stability for k-means clustering

200 papers

We study the stability of randomized Taylor schemes for ODEs. We consider three notions of probabilistic stability: asymptotic stability, mean-square stability, and stability in probability. We prove fundamental properties of the…

Numerical Analysis · Mathematics 2023-10-26 Tomasz Bochacik

K-means is an effective clustering technique used to separate similar data into groups based on initial centroids of clusters. In this paper, Normalization based K-means clustering algorithm(N-K means) is proposed. Proposed N-K means…

Machine Learning · Computer Science 2015-03-04 Deepali Virmani , Shweta Taneja , Geetika Malhotra

We investigate the complexity of solving stable or perturbation-resilient instances of $k$-Means and $k$-Median clustering in fixed dimension Euclidean metrics (more generally doubling metrics). The notion of stable (perturbation resilient)…

Data Structures and Algorithms · Computer Science 2024-02-01 Zachary Friggstad , Kamyar Khodamoradi , Mohammad R. Salavatipour

We introduce a new notion of the stability of computations, which holds under post-processing and adaptive composition. We show that the notion is both necessary and sufficient to ensure generalization in the face of adaptivity, for any…

Machine Learning · Computer Science 2020-01-01 Katrina Ligett , Moshe Shenfeld

The widely applied k-means algorithm produces clusterings that violate our expectations with respect to high/low similarity/density and is in conflict with Kleinberg's axiomatic system for distance based clustering algorithms that…

Machine Learning · Computer Science 2023-08-08 Mieczysław A. Kłopotek

The learning of mixture models can be viewed as a clustering problem. Indeed, given data samples independently generated from a mixture of distributions, we often would like to find the {\it correct target clustering} of the samples…

Machine Learning · Statistics 2022-08-26 Zhaoqiang Liu , Vincent Y. F. Tan

Clustering methods must be tailored to the dataset it operates on, as there is no objective or universal definition of ``cluster,'' but nevertheless arbitrariness in the clustering method must be minimized. This paper develops a…

Information Theory · Computer Science 2024-05-03 Brian Weber

Reduced k-means clustering is a method for clustering objects in a low-dimensional subspace. The advantage of this method is that both clustering of objects and low-dimensional subspace reflecting the cluster structure are simultaneously…

Statistics Theory · Mathematics 2014-02-14 Yoshikazu Terada

Recently, there has been substantial interest in clustering research that takes a beyond worst-case approach to the analysis of algorithms. The typical idea is to design a clustering algorithm that outputs a near-optimal solution, provided…

Data Structures and Algorithms · Computer Science 2018-12-31 Maria-Florina Balcan , Colin White

Persistent homology is a methodology central to topological data analysis that extracts and summarizes the topological features within a dataset as a persistence diagram; it has recently gained much popularity from its myriad successful…

Applications · Statistics 2023-11-28 Yueqi Cao , Prudence Leung , Anthea Monod

We investigate different measures of stability of quantum statistical ensembles with respect to local measurements. We call a quantum statistical ensemble "stable" if a small number of local measurements cannot significantly modify the…

Quantum Physics · Physics 2018-02-15 Walter Hahn , Boris V. Fine

Clustering is one of the most fundamental problems in data analysis and it has been studied extensively in the literature. Though many clustering algorithms have been proposed, clustering theories that justify the use of these clustering…

Machine Learning · Computer Science 2016-02-22 Cheng-Shang Chang , Wanjiun Liao , Yu-Sheng Chen , Li-Heng Liou

Clustering is widely used for unsupervised structure discovery, yet it offers limited insight into how reliable each individual assignment is. Diagnostics, such as convergence behavior or objective values, may reflect global quality, but…

Machine Learning · Computer Science 2026-05-15 Aggelos Semoglou , John Pavlopoulos

We study the classic $k$-median and $k$-means clustering objectives in the beyond-worst-case scenario. We consider three well-studied notions of structured data that aim at characterizing real-world inputs: Distribution Stability…

Data Structures and Algorithms · Computer Science 2017-08-11 Vincent Cohen-Addad , Chris Schwiegelshohn

Many clustering algorithms exist that estimate a cluster centroid, such as K-means, K-medoids or mean-shift, but no algorithm seems to exist that clusters data by returning exactly K meaningful modes. We propose a natural definition of a…

Machine Learning · Computer Science 2013-04-25 Miguel Á. Carreira-Perpiñán , Weiran Wang

We propose a novel method for clustering data which is grounded in information-theoretic principles and requires no parametric assumptions. Previous attempts to use information theory to define clusters in an assumption-free way are based…

Machine Learning · Computer Science 2014-02-07 Greg Ver Steeg , Aram Galstyan , Fei Sha , Simon DeDeo

There has been much progress on efficient algorithms for clustering data points generated by a mixture of $k$ probability distributions under the assumption that the means of the distributions are well-separated, i.e., the distance between…

Data Structures and Algorithms · Computer Science 2010-04-13 Amit Kumar , Ravindran Kannan

We consider the model introduced by Bilu and Linial (2010), who study problems for which the optimal clustering does not change when distances are perturbed. They show that even when a problem is NP-hard, it is sometimes possible to obtain…

Machine Learning · Computer Science 2014-09-01 Shalev Ben-David , Lev Reyzin

We show that modularity, a quantity introduced in the study of networked systems, can be generalized and used in the clustering problem as an indicator for the quality of the solution. The introduction of this measure arises very naturally…

Statistical Mechanics · Physics 2009-11-11 L. Angelini , D. Marinazzo , M. Pellicoro , S. Stramaglia

The classical $k$-means algorithm for partitioning $n$ points in $\mathbb{R}^d$ into $k$ clusters is one of the most popular and widely spread clustering methods. The need to respect prescribed lower bounds on the cluster sizes has been…

Optimization and Control · Mathematics 2016-08-04 Steffen Borgwardt , Andreas Brieden , Peter Gritzmann