English
Related papers

Related papers: Noisy k-means++ Revisited

200 papers

The k-means++ algorithm of Arthur and Vassilvitskii (SODA 2007) is a state-of-the-art algorithm for solving the k-means clustering problem and is known to give an O(log k)-approximation in expectation. Recently, Lattanzi and Sohler (ICML…

Data Structures and Algorithms · Computer Science 2020-02-19 Davin Choo , Christoph Grunau , Julian Portmann , Václav Rozhoň

The k-means++ algorithm due to Arthur and Vassilvitskii has become the most popular seeding method for Lloyd's algorithm. It samples the first center uniformly at random from the data set and the other $k-1$ centers iteratively according to…

Data Structures and Algorithms · Computer Science 2019-12-03 Anup Bhattacharya , Jan Eube , Heiko Röglin , Melanie Schmidt

The famous $k$-means++ algorithm of Arthur and Vassilvitskii [SODA 2007] is the most popular way of solving the $k$-means problem in practice. The algorithm is very simple: it samples the first center uniformly at random and each of the…

Data Structures and Algorithms · Computer Science 2022-07-19 Christoph Grunau , Ahmet Alper Özüdoğru , Václav Rozhoň , Jakub Tětek

The $k$-means is a popular clustering objective, although it is inherently non-robust and sensitive to outliers. Its popular seeding or initialization called $k$-means++ uses $D^{2}$ sampling and comes with a provable $O(\log k)$…

Machine Learning · Computer Science 2023-09-07 Amit Deshpande , Rameshwar Pratap

We prove in this paper that the expected value of the objective function of the $k$-means++ algorithm for samples converges to population expected value. As $k$-means++, for samples, provides with constant factor approximation for $k$-means…

Machine Learning · Computer Science 2017-02-22 Mieczysław A. Kłopotek

The $k$-means++ algorithm of Arthur and Vassilvitskii (SODA 2007) is often the practitioners' choice algorithm for optimizing the popular $k$-means clustering objective and is known to give an $O(\log k)$-approximation in expectation. To…

Computational Geometry · Computer Science 2024-10-29 Lorenzo Beretta , Vincent Cohen-Addad , Silvio Lattanzi , Nikos Parotsidis

Bateni et al. has recently introduced the weak-strong distance oracle model to study clustering problems in settings with limited distance information. Given query access to the strong-oracle and weak-oracle in the weak-strong oracle model,…

Data Structures and Algorithms · Computer Science 2026-02-23 Pinki Pradhan , Anup Bhattacharya , Ragesh Jaiswal

This paper shows how to adapt several simple and classical sampling-based algorithms for the $k$-means problem to the setting with outliers. Recently, Bhaskara et al. (NeurIPS 2019) showed how to adapt the classical $k$-means++ algorithm to…

Data Structures and Algorithms · Computer Science 2022-09-26 Christoph Grunau , Václav Rozhoň

We present a simple analysis of k-means|| (Bahmani et al., PVLDB 2012) -- a distributed variant of the k-means++ algorithm (Arthur and Vassilvitskii, SODA 2007). Moreover, the bound on the number of rounds is improved from $O(\log n)$ to…

Data Structures and Algorithms · Computer Science 2020-07-03 Václav Rozhoň

Since its introduction in 1957, Lloyd's algorithm for $k$-means clustering has been extensively studied and has undergone several improvements. While in its original form it does not guarantee any approximation factor at all, Arthur and…

Data Structures and Algorithms · Computer Science 2024-06-06 Theo Conrads , Lukas Drexler , Joshua Könen , Daniel R. Schmidt , Melanie Schmidt

$k$-means algorithm is one of the most classical clustering methods, which has been widely and successfully used in signal processing. However, due to the thin-tailed property of the Gaussian distribution, $k$-means algorithm suffers from…

Machine Learning · Computer Science 2021-02-02 Yiming Li , Yang Zhang , Qingtao Tang , Weipeng Huang , Yong Jiang , Shu-Tao Xia

The k-means++ seeding algorithm is one of the most popular algorithms that is used for finding the initial $k$ centers when using the k-means heuristic. The algorithm is a simple sampling procedure and can be described as follows: Pick the…

Data Structures and Algorithms · Computer Science 2014-01-15 Anup Bhattacharya , Ragesh Jaiswal , Nir Ailon

This paper considers $k$-means clustering in the presence of noise. It is known that $k$-means clustering is highly sensitive to noise, and thus noise should be removed to obtain a quality solution. A popular formulation of this problem is…

Data Structures and Algorithms · Computer Science 2020-04-14 Sungjin Im , Mahshid Montazer Qaem , Benjamin Moseley , Xiaorui Sun , Rudy Zhou

$k$-means++ \cite{arthur2007k} is a widely used clustering algorithm that is easy to implement, has nice theoretical guarantees and strong empirical performance. Despite its wide adoption, $k$-means++ sometimes suffers from being slow on…

Machine Learning · Computer Science 2020-12-23 Vincent Cohen-Addad , Silvio Lattanzi , Ashkan Norouzi-Fard , Christian Sohler , Ola Svensson

In this paper, we study k-means++ and k-means++ parallel, the two most popular algorithms for the classic k-means clustering problem. We provide novel analyses and show improved approximation and bi-criteria approximation guarantees for…

Machine Learning · Computer Science 2020-10-28 Konstantin Makarychev , Aravind Reddy , Liren Shan

$k$-means++ is an important algorithm for choosing initial cluster centers for the $k$-means clustering algorithm. In this work, we present a new algorithm that can solve the $k$-means++ problem with nearly optimal running time. Given $n$…

Data Structures and Algorithms · Computer Science 2024-02-15 Jiehao Liang , Somdeb Sarkhel , Zhao Song , Chenbo Yin , Junze Yin , Danyang Zhuo

The $k$-means algorithm is a prevalent clustering method due to its simplicity, effectiveness, and speed. However, its main disadvantage is its high sensitivity to the initial positions of the cluster centers. The global $k$-means is a…

Machine Learning · Computer Science 2023-07-17 Georgios Vardakas , Aristidis Likas

The k-means++ seeding algorithm is one of the most popular algorithms that is used for finding the initial $k$ centers when using the k-means heuristic. The algorithm is a simple sampling procedure and can be described as follows: {quote}…

Data Structures and Algorithms · Computer Science 2013-06-19 Ragesh Jaiswal , Prachi Jain , Saumya Yadav

The $k$-means algorithm (Lloyd's algorithm) is a widely used method for clustering unlabeled data. A key bottleneck of the $k$-means algorithm is that each iteration requires time linear in the number of data points, which can be expensive…

k-means++ seeding has become a de facto standard for hard clustering algorithms. In this paper, our first contribution is a two-way generalisation of this seeding, k-variates++, that includes the sampling of general densities rather than…

Machine Learning · Computer Science 2016-02-16 Richard Nock , Raphaël Canyasse , Roksana Boreli , Frank Nielsen
‹ Prev 1 2 3 10 Next ›