English
Related papers

Related papers: On the Consistency of $k$-means++ algorithm

200 papers

This paper shows that one can be competitive with the k-means objective while operating online. In this model, the algorithm receives vectors v_1,...,v_n one by one in an arbitrary order. For each vector the algorithm outputs a cluster…

Data Structures and Algorithms · Computer Science 2015-02-24 Edo Liberty , Ram Sriharsha , Maxim Sviridenko

Selection of initial seeds greatly affects the quality of the clusters and in k-means type algorithms. Most of the seed selection methods result different results in different independent runs. We propose a single, optimal, outlier…

Computer Vision and Pattern Recognition · Computer Science 2012-02-09 K. Karteeka Pavan , Allam Appa Rao , A. V. Dattatreya Rao , G. R. Sridhar

Sequential importance sampling algorithms have been defined to estimate likelihoods in models of ancestral population processes. However, these algorithms are based on features of the models with constant population size, and become…

Statistics Theory · Mathematics 2016-03-24 Coralie Merle , Raphaël Leblois , François Rousset , Pierre Pudlo

This paper presents a comparative analysis of different optimization techniques for the K-means algorithm in the context of big data. K-means is a widely used clustering algorithm, but it can suffer from scalability issues when dealing with…

Machine Learning · Computer Science 2024-05-21 Ravil Mussabayev , Rustam Mussabayev

Bayesian models offer great flexibility for clustering applications---Bayesian nonparametrics can be used for modeling infinite mixtures, and hierarchical Bayesian models can be utilized for sharing clusters across multiple data sets. For…

Machine Learning · Computer Science 2012-06-15 Brian Kulis , Michael I. Jordan

Data analysis often involves an iterative process, where solutions must be continuously refined in response to new data. Typically, as new data becomes available, an existing solution must be updated to incorporate the latest information.…

Data Structures and Algorithms · Computer Science 2025-12-18 Ameet Gadekar , Aristides Gionis , Thibault Marette

This paper proposes a quantum circuit for computing the mean value from a given set of numbers or function evaluations. Suppose a Quantum Random Access Memory is given as a black-box function, which allows us to store and read the values of…

Quantum Physics · Physics 2022-03-09 Amanuel Tamirat

The $K$-means algorithm is extended to allow for partitioning of skewed groups. Our algorithm is called TiK-Means and contributes a $K$-means type algorithm that assigns observations to groups while estimating their skewness-transformation…

Machine Learning · Statistics 2019-05-21 Nicholas S. Berry , Ranjan Maitra

Efficient algorithms for $k$-means clustering frequently converge to suboptimal partitions, and given a partition, it is difficult to detect $k$-means optimality. In this paper, we develop an a posteriori certifier of approximate optimality…

Machine Learning · Statistics 2017-10-04 Dustin G. Mixon , Soledad Villar

Kernel methods augmented with random features give scalable algorithms for learning from big data. But it has been computationally hard to sample random features according to a probability distribution that is optimized for the data, so as…

Quantum Physics · Physics 2021-11-02 Hayata Yamasaki , Sathyawageeswar Subramanian , Sho Sonoda , Masato Koashi

Given a stream of points in a metric space, is it possible to maintain a constant approximate clustering by changing the cluster centers only a small number of times during the entire execution of the algorithm? This question received…

Data Structures and Algorithms · Computer Science 2020-11-16 Hendrik Fichtenberger , Silvio Lattanzi , Ashkan Norouzi-Fard , Ola Svensson

Causal effects are often characterized with population summaries. These might provide an incomplete picture when there are heterogeneous treatment effects across subgroups. Since the subgroup structure is typically unknown, it is more…

Methodology · Statistics 2026-04-07 Kwangho Kim , Jisu Kim , Edward H. Kennedy

K-means++ is an algorithm which is invented to improve the process of finding initial seeds in K-means algorithm. In this algorithm, initial seeds are chosen consecutively by a probability which is proportional to the distance to the…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-08-07 Maliheh Heydarpour Shahrezaei , Reza Tavoli

Most convex and nonconvex clustering algorithms come with one crucial parameter: the $k$ in $k$-means. To this day, there is not one generally accepted way to accurately determine this parameter. Popular methods are simple yet theoretically…

Machine Learning · Computer Science 2021-08-04 Sibylle Hess , Wouter Duivesteijn

Clustering is a classic topic in optimization with $k$-means being one of the most fundamental such problems. In the absence of any restrictions on the input, the best known algorithm for $k$-means with a provable guarantee is a simple…

Data Structures and Algorithms · Computer Science 2017-04-11 Sara Ahmadian , Ashkan Norouzi-Fard , Ola Svensson , Justin Ward

Quantum-inspired classical algorithms has received much attention due to its exponential speedup compared to existing algorithms, under certain data storage assumptions. The improvements are noticeable in fundamental linear algebra tasks.…

Quantum Physics · Physics 2025-12-08 Hyunho Cha , Jungwoo Lee

This paper presents universal algorithms for clustering problems, including the widely studied $k$-median, $k$-means, and $k$-center objectives. The input is a metric space containing all potential client locations. The algorithm must…

Data Structures and Algorithms · Computer Science 2021-07-16 Arun Ganesh , Bruce M. Maggs , Debmalya Panigrahi

There is growing empirical evidence that spherical $k$-means clustering performs well at identifying groups of concomitant extremes in high dimensions, thereby leading to sparse models. We provide one of the first theoretical results…

Statistics Theory · Mathematics 2022-03-21 V. Fomichov , J. Ivanovs

A key limitation of sampling algorithms for approximate inference is that it is difficult to quantify their approximation error. Widely used sampling schemes, such as sequential importance sampling with resampling and Metropolis-Hastings,…

Artificial Intelligence · Computer Science 2017-05-09 Marco F. Cusumano-Towner , Vikash K. Mansinghka

We study the sample-based k-median clustering objective under a sequential setting without substitutions. In this setting, an i.i.d. sequence of examples is observed. An example can be selected as a center only immediately after it is…

Machine Learning · Computer Science 2021-05-25 Tom Hess , Sivan Sabato