English
Related papers

Related papers: A New Rejection Sampling Approach to $k$-$\mathtt{…

200 papers

$k$-means algorithm is one of the most classical clustering methods, which has been widely and successfully used in signal processing. However, due to the thin-tailed property of the Gaussian distribution, $k$-means algorithm suffers from…

Machine Learning · Computer Science 2021-02-02 Yiming Li , Yang Zhang , Qingtao Tang , Weipeng Huang , Yong Jiang , Shu-Tao Xia

We study the power of uniform sampling for $k$-Median in various metric spaces. We relate the query complexity for approximating $k$-Median, to a key parameter of the dataset, called the balancedness $\beta \in (0, 1]$ (with $1$ being…

Data Structures and Algorithms · Computer Science 2023-02-23 Lingxiao Huang , Shaofeng H. -C. Jiang , Jianing Lou

Rejection sampling is a well-known method to sample from a target distribution, given the ability to sample from a given distribution. The method has been first formalized by von Neumann (1951) and has many applications in classical…

Quantum Physics · Physics 2015-03-19 Maris Ozols , Martin Roetteler , Jérémie Roland

Clustering plays a crucial role in computer science, facilitating data analysis and problem-solving across numerous fields. By partitioning large datasets into meaningful groups, clustering reveals hidden structures and relationships within…

Databases · Computer Science 2026-02-19 Aryan Esmailpour , Stavros Sintos

Clustering is an important technique for identifying structural information in large-scale data analysis, where the underlying dataset may be too large to store. In many applications, recent data can provide more accurate information and…

Data Structures and Algorithms · Computer Science 2023-11-02 David P. Woodruff , Peilin Zhong , Samson Zhou

K-means -- and the celebrated Lloyd algorithm -- is more than the clustering method it was originally designed to be. It has indeed proven pivotal to help increase the speed of many machine learning and data analysis techniques such as…

Machine Learning · Computer Science 2019-08-26 Luc Giffon , Valentin Emiya , Liva Ralaivola , Hachem Kadri

The k-means method is a widely used clustering algorithm. One of its distinguished features is its speed in practice. Its worst-case running-time, however, is exponential, leaving a gap between practical and theoretical performance. Arthur…

Data Structures and Algorithms · Computer Science 2008-09-11 Bodo Manthey , Heiko Röglin

We study efficient algorithms for the Euclidean $k$-Center problem, focusing on the regime of large $k$. We take the approach of data reduction by considering $\alpha$-coreset, which is a small subset $S$ of the dataset $P$ such that any…

Data Structures and Algorithms · Computer Science 2025-02-11 Arnold Filtser , Shaofeng H. -C. Jiang , Yi Li , Anurag Murty Naredla , Ioannis Psarros , Qiaoyuan Yang , Qin Zhang

k-means++ seeding has become a de facto standard for hard clustering algorithms. In this paper, our first contribution is a two-way generalisation of this seeding, k-variates++, that includes the sampling of general densities rather than…

Machine Learning · Computer Science 2016-02-16 Richard Nock , Raphaël Canyasse , Roksana Boreli , Frank Nielsen

Being robust to the presence of outliers is crucial for applying clustering algorithms in practice. In the $\textit{robust $k$-Means}$ problem (i.e., $k$-Means with outliers), the goal is to remove $z$ outliers and minimize the $k$-Means…

Machine Learning · Computer Science 2026-05-11 Tianle Jiang , Yufa Zhou

In this paper we initiate a systematic study of exact algorithms for well-known clustering problems, namely $k$-Median and $k$-Means. In $k$-Median, the input consists of a set $X$ of $n$ points belonging to a metric space, and the task is…

Data Structures and Algorithms · Computer Science 2022-08-16 Fedor V. Fomin , Petr A. Golovach , Tanmay Inamdar , Nidhi Purohit , Saket Saurabh

The $k$-means++ algorithm by Arthur and Vassilvitskii [SODA 2007] is a classical and time-tested algorithm for the $k$-means problem. While being very practical, the algorithm also has good theoretical guarantees: its solution is $O(\log…

Data Structures and Algorithms · Computer Science 2023-07-26 Christoph Grunau , Ahmet Alper Özüdoğru , Václav Rozhoň

Most current sampling algorithms for high-dimensional distributions are based on MCMC techniques and are approximate in the sense that they are valid only asymptotically. Rejection sampling, on the other hand, produces valid samples, but is…

Artificial Intelligence · Computer Science 2012-07-04 Marc Dymetman , Guillaume Bouchard , Simon Carter

We consider the problem of approximate $K$-means clustering with outliers and side information provided by same-cluster queries and possibly noisy answers. Our solution shows that, under some mild assumptions on the smallest cluster size,…

Machine Learning · Statistics 2018-11-13 I Chien , Chao Pan , Olgica Milenkovic

Since its introduction in 1957, Lloyd's algorithm for $k$-means clustering has been extensively studied and has undergone several improvements. While in its original form it does not guarantee any approximation factor at all, Arthur and…

Data Structures and Algorithms · Computer Science 2024-06-06 Theo Conrads , Lukas Drexler , Joshua Könen , Daniel R. Schmidt , Melanie Schmidt

This paper shows how to adapt several simple and classical sampling-based algorithms for the $k$-means problem to the setting with outliers. Recently, Bhaskara et al. (NeurIPS 2019) showed how to adapt the classical $k$-means++ algorithm to…

Data Structures and Algorithms · Computer Science 2022-09-26 Christoph Grunau , Václav Rozhoň

We introduce an evolutionary algorithm called recombinator-$k$-means for optimizing the highly non-convex kmeans problem. Its defining feature is that its crossover step involves all the members of the current generation, stochastically…

Machine Learning · Computer Science 2022-02-10 Carlo Baldassi

The k-means clustering algorithm is a popular algorithm that partitions data into k clusters. There are many improvements to accelerate the standard algorithm. Most current research employs upper and lower bounds on point-to-cluster…

Machine Learning · Computer Science 2024-10-22 Andreas Lang , Erich Schubert

We introduce the breathing k-means algorithm, which on average significantly improves solutions obtained by the widely-known greedy k-means++ algorithm, the default method for k-means clustering in the scikit-learn package. The improvements…

Machine Learning · Computer Science 2024-08-20 Bernd Fritzke

We give an improved analysis of the simple $D^2$-sampling based PTAS for the $k$-means clustering problem given by Jaiswal, Kumar, and Sen (Algorithmica, 2013). The improvement on the running time is from $O\left(nd \cdot…

Data Structures and Algorithms · Computer Science 2014-01-16 Ragesh Jaiswal , Mehul Kumar , Pulkit Yadav