English
Related papers

Related papers: Statistical and Computational Guarantees of Lloyd'…

200 papers

In the context of unsupervised learning, Lloyd's algorithm is one of the most widely used clustering algorithms. It has inspired a plethora of work investigating the correctness of the algorithm under various settings with ground truth…

Machine Learning · Computer Science 2026-04-28 Dhruv Patel , Hui Shen , Shankar Bhamidi , Yufeng Liu , Vladas Pipiras

Clustering is a fundamental tool in statistical machine learning in the presence of heterogeneous data. Most recent results focus primarily on optimal mislabeling guarantees when data are distributed around centroids with sub-Gaussian…

Statistics Theory · Mathematics 2024-10-24 Soham Jana , Jianqing Fan , Sanjeev Kulkarni

This paper investigates the computational and statistical limits in clustering matrix-valued observations. We propose a low-rank mixture model (LrMM), adapted from the classical Gaussian mixture model (GMM) to treat matrix-valued…

Statistics Theory · Mathematics 2023-06-08 Zhongyuan Lyu , Dong Xia

We consider the problem of clustering data points coming from sub-Gaussian mixtures. Existing methods that provably achieve the optimal mislabeling error, such as the Lloyd algorithm, are usually vulnerable to outliers. In contrast,…

Statistics Theory · Mathematics 2025-11-03 Soham Jana , Kun Yang , Sanjeev Kulkarni

Clustering is a pivotal challenge in unsupervised machine learning and is often investigated through the lens of mixture models. The optimal error rate for recovering cluster labels in Gaussian and sub-Gaussian mixture models involves ad…

Statistics Theory · Mathematics 2024-07-18 Maximilien Dreveton , Alperen Gözeten , Matthias Grossglauser , Patrick Thiran

Clustering is a key task in machine learning, with $k$-means being widely used for its simplicity and effectiveness. While 1D clustering is common, existing methods often fail to exploit the structure of 1D data, leading to inefficiencies.…

Data Structures and Algorithms · Computer Science 2024-12-25 Jake Hyun

Algorithms for clustering points in metric spaces is a long-studied area of research. Clustering has seen a multitude of work both theoretically, in understanding the approximation guarantees possible for many objective functions such as…

Data Structures and Algorithms · Computer Science 2019-05-27 Maria-Florina Balcan , Travis Dick , Colin White

Clustering is a widely used technique with a long and rich history in a variety of areas. However, most existing algorithms do not scale well to large datasets, or are missing theoretical guarantees of convergence. This paper introduces a…

Machine Learning · Statistics 2024-10-16 Yijia Zhou , Kyle A. Gallivan , Adrian Barbu

Lloyd's algorithm is an iterative method that solves the quantization problem, i.e. the approximation of a target probability measure by a discrete one, and is particularly used in digital applications. This algorithm can be interpreted as…

Optimization and Control · Mathematics 2026-05-14 Léo Portales , Elsa Cazelles , Edouard Pauwels

Recently, there has been substantial interest in clustering research that takes a beyond worst-case approach to the analysis of algorithms. The typical idea is to design a clustering algorithm that outputs a near-optimal solution, provided…

Data Structures and Algorithms · Computer Science 2018-12-31 Maria-Florina Balcan , Colin White

Clustering is a commonplace problem in many areas of data science, with applications in biology and bioinformatics, understanding chemical structure, image segmentation, building recommender systems, and many more fields. While there are…

Numerical Analysis · Mathematics 2023-12-25 Tareq Zaman , Nicolas Nytko , Ali Taghibakhshi , Scott MacLachlan , Luke Olson , Matthew West

We study the clustering task under anisotropic Gaussian Mixture Models where the covariance matrices from different clusters are unknown and are not necessarily the identical matrix. We characterize the dependence of signal-to-noise ratios…

Statistics Theory · Mathematics 2021-01-19 Xin Chen , Anderson Y. Zhang

Gaussian mixture models (GMM) are the most widely used statistical model for the $k$-means clustering problem and form a popular framework for clustering in machine learning and data analysis. In this paper, we propose a natural semi-random…

Data Structures and Algorithms · Computer Science 2017-11-27 Pranjal Awasthi , Aravindan Vijayaraghavan

In recent years, crowdsourcing, aka human aided computation has emerged as an effective platform for solving problems that are considered complex for machines alone. Using human is time-consuming and costly due to monetary compensations.…

Data Structures and Algorithms · Computer Science 2016-04-08 Arya Mazumdar , Barna Saha

Correlation clustering is a central problem in unsupervised learning, with applications spanning community detection, duplicate detection, automated labelling and many more. In the correlation clustering problem one receives as input a set…

High-order clustering aims to identify heterogeneous substructures in multiway datasets that arise commonly in neuroimaging, genomics, social network studies, etc. The non-convex and discontinuous nature of this problem pose significant…

Methodology · Statistics 2022-10-11 Rungang Han , Yuetian Luo , Miaoyan Wang , Anru R. Zhang

Clustering is a widely used unsupervised learning method for finding structure in the data. However, the resulting clusters are typically presented without any guarantees on their robustness; slightly changing the used data sample or…

Machine Learning · Statistics 2017-01-02 Andreas Henelius , Kai Puolamäki , Henrik Boström , Panagiotis Papapetrou

Clustering is a fundamental primitive in unsupervised learning which gives rise to a rich class of computationally-challenging inference tasks. In this work, we focus on the canonical task of clustering d-dimensional Gaussian mixtures with…

Machine Learning · Computer Science 2022-01-10 Ilias Zadik , Min Jae Song , Alexander S. Wein , Joan Bruna

Clustering is an unsupervised learning task that aims to partition data into a set of clusters. In many applications, these clusters correspond to real-world constructs (e.g. electoral districts) whose benefit can only be attained by groups…

Machine Learning · Computer Science 2023-02-09 Connor Lawless , Oktay Gunluk

In this paper, we first study the fundamental limit of clustering networks when a multi-layer network is present. Under the mixture multi-layer stochastic block model (MMSBM), we show that the minimax optimal network clustering error rate,…

Statistics Theory · Mathematics 2023-11-28 Zhongyuan Lyu , Ting Li , Dong Xia
‹ Prev 1 2 3 10 Next ›