English
Related papers

Related papers: Improved Coresets for Euclidean $k$-Means

200 papers

We present the first mini-batch kernel $k$-means algorithm, offering an order of magnitude improvement in running time compared to the full batch algorithm. A single iteration of our algorithm takes $\widetilde{O}(kb^2)$ time, significantly…

Machine Learning · Computer Science 2024-10-10 Ben Jourdan , Gregory Schwartzman

$k$-means++ is an important algorithm for choosing initial cluster centers for the $k$-means clustering algorithm. In this work, we present a new algorithm that can solve the $k$-means++ problem with nearly optimal running time. Given $n$…

Data Structures and Algorithms · Computer Science 2024-02-15 Jiehao Liang , Somdeb Sarkhel , Zhao Song , Chenbo Yin , Junze Yin , Danyang Zhuo

We present a new clustering algorithm called k-means-u* which in many cases is able to significantly improve the clusterings found by k-means++, the current de-facto standard for clustering in Euclidean spaces. First we introduce the…

Machine Learning · Computer Science 2017-07-18 Bernd Fritzke

Clustering is a fundamental unsupervised learning approach. Many clustering algorithms -- such as $k$-means -- rely on the euclidean distance as a similarity measure, which is often not the most relevant metric for high dimensional data…

Machine Learning · Computer Science 2019-10-22 Aude Genevay , Gabriel Dulac-Arnold , Jean-Philippe Vert

We develop two simple and efficient approximation algorithms for the continuous $k$-medians problems, where we seek to find the optimal location of $k$ facilities among a continuum of client points in a convex polygon $C$ with $n$ vertices…

Optimization and Control · Mathematics 2023-06-28 Reyhaneh Mohammadi , Raghuveer Devulapalli , Mehdi Behroozi

Many geometric optimization problems can be reduced to finding points in space (centers) minimizing an objective function which continuously depends on the distances from the centers to given input points. Examples are $k$-Means, Geometric…

Computational Geometry · Computer Science 2021-08-26 Vladimir Shenmaier

We study the fundamental problem of clustering $n$ points into $K$ groups drawn from a mixture of isotropic Gaussians in $\mathbb{R}^d$. Specifically, we investigate the requisite minimal distance $\Delta$ between mean vectors to partially…

Statistics Theory · Mathematics 2026-02-27 Alexandra Carpentier , Nicolas Verzelen

We study the problem of constructing $(1+\varepsilon)$-coresets for Euclidean $(k,z)$-clustering in the distributed setting, where $n$ data points are partitioned across $s$ sites. We focus on two prominent communication models: the…

Data Structures and Algorithms · Computer Science 2026-03-10 Vincent Cohen-Addad , Liudeng Wang , David P. Woodruff , Samson Zhou

In this paper, we study structured quasi-Newton methods for optimization problems with orthogonality constraints. Note that the Riemannian Hessian of the objective function requires both the Euclidean Hessian and the Euclidean gradient. In…

Optimization and Control · Mathematics 2018-09-05 Jiang Hu , Bo Jiang , Lin Lin , Zaiwen Wen , Yaxiang Yuan

Coreset selection is powerful in reducing computational costs and accelerating data processing for deep learning algorithms. It strives to identify a small subset from large-scale data, so that training only on the subset practically…

Machine Learning · Computer Science 2024-03-01 Xiaobo Xia , Jiale Liu , Shaokun Zhang , Qingyun Wu , Hongxin Wei , Tongliang Liu

The fuzzy $K$-means problem is a popular generalization of the well-known $K$-means problem to soft clusterings. We present the first coresets for fuzzy $K$-means with size linear in the dimension, polynomial in the number of clusters, and…

Machine Learning · Computer Science 2018-09-28 Johannes Blömer , Sascha Brauer , Kathrin Bujna

The fairness of clustering algorithms has gained widespread attention across various areas, including machine learning, In this paper, we study fair $k$-means clustering in Euclidean space. Given a dataset comprising several groups, the…

Machine Learning · Computer Science 2024-12-10 Shihong Song , Guanlin Mo , Qingyuan Yang , Hu Ding

k-means has recently been recognized as one of the best algorithms for clustering unsupervised data. Since k-means depends mainly on distance calculation between all data points and the centers, the time cost will be high when the size of…

Data Structures and Algorithms · Computer Science 2011-08-08 Raied Salman , Vojislav Kecman , Qi Li , Robert Strack , Erik Test

Fair clustering is a constrained variant of clustering where the goal is to partition a set of colored points, such that the fraction of points of any color in every cluster is more or less equal to the fraction of points of this color in…

Data Structures and Algorithms · Computer Science 2020-07-21 Sayan Bandyapadhyay , Fedor V. Fomin , Kirill Simonov

Center-based clustering is a fundamental primitive for data analysis and becomes very challenging for large datasets. In this paper, we focus on the popular $k$-center variant which, given a set $S$ of points from some metric space and a…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-02 Matteo Ceccarello , Andrea Pietracaprina , Geppino Pucci

We consider the $k$-clustering problem with $\ell_p$-norm cost, which includes $k$-median, $k$-means and $k$-center, under an individual notion of fairness proposed by Jung et al. [2020]: given a set of points $P$ of size $n$, a set of $k$…

Data Structures and Algorithms · Computer Science 2022-03-02 Ali Vakilian , Mustafa Yalçıner

We propose k^2-means, a new clustering method which efficiently copes with large numbers of clusters and achieves low energy solutions. k^2-means builds upon the standard k-means (Lloyd's algorithm) and combines a new strategy to accelerate…

Machine Learning · Computer Science 2016-05-31 Eirikur Agustsson , Radu Timofte , Luc Van Gool

In this paper, we present a linear-time approximation scheme for $k$-means clustering of \emph{incomplete} data points in $d$-dimensional Euclidean space. An \emph{incomplete} data point with $\Delta>0$ unspecified entries is represented as…

Computational Geometry · Computer Science 2021-06-29 Kyungjin Cho , Eunjin Oh

In the $k$-median problem, given a set of locations, the goal is to select a subset of at most $k$ centers so as to minimize the total cost of connecting each location to its nearest center. We study the uniform hard capacitated version of…

Data Structures and Algorithms · Computer Science 2014-06-18 Shanfei Li

The most well known and ubiquitous clustering problem encountered in nearly every branch of science is undoubtedly $k$-means: given a set of data points and a parameter $k$, select $k$ centres and partition the data points into $k$ clusters…

Data Structures and Algorithms · Computer Science 2017-01-11 Zachary Friggstad , Mohsen Rezapour , Mohammad R. Salavatipour