中文
相关论文

相关论文: Structures of Spurious Local Minima in $k$-means

200 篇论文

The Euclidean k-means problem is arguably the most widely-studied clustering problem in machine learning. While the k-means objective is NP-hard in the worst-case, practitioners have enjoyed remarkable success in applying heuristics like…

机器学习 · 计算机科学 2017-12-05 Abhratanu Dutta , Aravindan Vijayaraghavan , Alex Wang

The $k$-means method is an iterative clustering algorithm which associates each observation with one of $k$ clusters. It traditionally employs cluster centers in the same space as the observed data. By relaxing this requirement, it is…

统计理论 · 数学 2015-04-06 Matthew Thorpe , Florian Theil , Adam M. Johansen , Neil Cade

K-means is one of the most widely used clustering algorithms in various disciplines, especially for large datasets. However the method is known to be highly sensitive to initial seed selection of cluster centers. K-means++ has been proposed…

机器学习 · 计算机科学 2016-04-19 Fouad Khan

$k$-means algorithm is one of the most classical clustering methods, which has been widely and successfully used in signal processing. However, due to the thin-tailed property of the Gaussian distribution, $k$-means algorithm suffers from…

机器学习 · 计算机科学 2021-02-02 Yiming Li , Yang Zhang , Qingtao Tang , Weipeng Huang , Yong Jiang , Shu-Tao Xia

Clustering is an unsupervised learning task that aims to partition data into a set of clusters. In many applications, these clusters correspond to real-world constructs (e.g. electoral districts) whose benefit can only be attained by groups…

机器学习 · 计算机科学 2023-02-09 Connor Lawless , Oktay Gunluk

We consider the problem of clustering with $K$-means and Gaussian mixture models with a constraint on the separation between the centers in the context of real-valued data. We first propose a dynamic programming approach to solving the…

统计计算 · 统计学 2023-01-24 He Jiang , Ery Arias-Castro

We design a new algorithm for the Euclidean $k$-means problem that operates in the local model of differential privacy. Unlike in the non-private literature, differentially private algorithms for the $k$-means objective incur both additive…

机器学习 · 计算机科学 2021-06-29 Uri Stemmer

Gaussian mixture models (GMM) are the most widely used statistical model for the $k$-means clustering problem and form a popular framework for clustering in machine learning and data analysis. In this paper, we propose a natural semi-random…

数据结构与算法 · 计算机科学 2017-11-27 Pranjal Awasthi , Aravindan Vijayaraghavan

Though mostly used as a clustering algorithm, k-means are originally designed as a quantization algorithm. Namely, it aims at providing a compression of a probability distribution with k points. Building upon [21, 33], we try to investigate…

统计理论 · 数学 2018-01-31 Clément Levrard

We define the notion of a well-clusterable data set combining the point of view of the objective of $k$-means clustering algorithm (minimising the centric spread of data elements) and common sense (clusters shall be separated by gaps). We…

机器学习 · 计算机科学 2020-04-07 Mieczysław A. Kłopotek

One of the applications of center-based clustering algorithms such as K-Means is partitioning data points into K clusters. In some examples, the feature space relates to the underlying problem we are trying to solve, and sometimes we can…

机器学习 · 计算机科学 2020-09-23 Ali Hassani , Amir Iranmanesh , Mahdi Eftekhari , Abbas Salemi

This paper considers $k$-means clustering in the presence of noise. It is known that $k$-means clustering is highly sensitive to noise, and thus noise should be removed to obtain a quality solution. A popular formulation of this problem is…

数据结构与算法 · 计算机科学 2020-04-14 Sungjin Im , Mahshid Montazer Qaem , Benjamin Moseley , Xiaorui Sun , Rudy Zhou

In this work, we study the $k$-median and $k$-means clustering problems when the data is distributed across many servers and can contain outliers. While there has been a lot of work on these problems for worst-case instances, we focus on…

数据结构与算法 · 计算机科学 2019-03-08 Pranjal Awasthi , Ainesh Bakshi , Maria-Florina Balcan , Colin White , David Woodruff

Kernel-based clustering algorithms have the ability to capture the non-linear structure in real world data. Among various kernel-based clustering algorithms, kernel k-means has gained popularity due to its simple iterative nature and ease…

计算机视觉与模式识别 · 计算机科学 2014-02-18 Radha Chitta , Rong Jin , Timothy C. Havens , Anil K. Jain

The analysis of continously larger datasets is a task of major importance in a wide variety of scientific fields. In this sense, cluster analysis algorithms are a key element of exploratory data analysis, due to their easiness in the…

机器学习 · 统计学 2018-01-10 Marco Capó , Aritz Pérez , Jose A. Lozano

The k-means algorithm is a partitional clustering method. Over 60 years old, it has been successfully used for a variety of problems. The popularity of k-means is in large part a consequence of its simplicity and efficiency. In this paper…

计算机视觉与模式识别 · 计算机科学 2013-06-11 Ognjen Arandjelovic

We consider the classical $k$-means clustering problem in the setting bi-criteria approximation, in which an algoithm is allowed to output $\beta k > k$ clusters, and must produce a clustering with cost at most $\alpha$ times the to the…

数据结构与算法 · 计算机科学 2015-08-04 Konstantin Makarychev , Yury Makarychev , Maxim Sviridenko , Justin Ward

We present a $k$-means-based clustering algorithm, which optimizes the mean square error, for given cluster sizes. A straightforward application is balanced clustering, where the sizes of each cluster are equal. In the $k$-means assignment…

机器学习 · 计算机科学 2025-01-28 Mikko I. Malinen , Pasi Fränti

We analyze online and mini-batch k-means variants. Both scale up the widely used Lloyd 's algorithm via stochastic approximation, and have become popular for large-scale clustering and unsupervised feature learning. We show, for the first…

机器学习 · 计算机科学 2016-11-08 Cheng Tang , Claire Monteleoni

Center-based clustering is a fundamental primitive for data analysis and becomes very challenging for large datasets. In this paper, we focus on the popular $k$-median and $k$-means variants which, given a set $P$ of points from a metric…

分布式、并行与集群计算 · 计算机科学 2019-10-01 Alessio Mazzetto , Andrea Pietracaprina , Geppino Pucci