English
Related papers

Related papers: Provably noise-robust, regularised $k$-means clust…

200 papers

We present a $k$-means-based clustering algorithm, which optimizes the mean square error, for given cluster sizes. A straightforward application is balanced clustering, where the sizes of each cluster are equal. In the $k$-means assignment…

Machine Learning · Computer Science 2025-01-28 Mikko I. Malinen , Pasi Fränti

Clustering is a key task in machine learning, with $k$-means being widely used for its simplicity and effectiveness. While 1D clustering is common, existing methods often fail to exploit the structure of 1D data, leading to inefficiencies.…

Data Structures and Algorithms · Computer Science 2024-12-25 Jake Hyun

Clustering is often a challenging problem because of the inherent ambiguity in what the "correct" clustering should be. Even when the number of clusters $K$ is known, this ambiguity often still exists, particularly when there is variation…

Information Theory · Computer Science 2025-05-09 Kayvon Mazooji , Ilan Shomorony

Regularization is a well studied problem in the context of neural networks. It is usually used to improve the generalization performance when the number of input samples is relatively small or heavily contaminated with noise. The…

Artificial Intelligence · Computer Science 2011-04-19 Salah Rifai , Xavier Glorot , Yoshua Bengio , Pascal Vincent

To learn and reason in the presence of uncertainty, the brain must be capable of imposing some form of regularization. Here we suggest, through theoretical and computational arguments, that the combination of noise with synchronization…

Neurons and Cognition · Quantitative Biology 2013-12-06 Jake Bouvrie , Jean-Jacques Slotine

In solving hard computational problems, semidefinite program (SDP) relaxations often play an important role because they come with a guarantee of optimality. Here, we focus on a popular semidefinite relaxation of K-means clustering which…

Machine Learning · Computer Science 2018-09-07 Mariano Tepper , Anirvan M. Sengupta , Dmitri Chklovskii

We advocate Laplacian K-modes for joint clustering and density mode finding, and propose a concave-convex relaxation of the problem, which yields a parallel algorithm that scales up to large datasets and high dimensions. We optimize a tight…

Machine Learning · Computer Science 2018-11-22 Imtiaz Masud Ziko , Eric Granger , Ismail Ben Ayed

$K$-means clustering is a widely used machine learning method for identifying patterns in large datasets. Recently, semidefinite programming (SDP) relaxations have been proposed for solving the $K$-means optimization problem, which enjoy…

Machine Learning · Statistics 2024-04-16 Yubo Zhuang , Xiaohui Chen , Yun Yang , Richard Y. Zhang

Due to their conceptual simplicity, k-means algorithm variants have been extensively used for unsupervised cluster analysis. However, one main shortcoming of these algorithms is that they essentially fit a mixture of identical spherical…

Machine Learning · Computer Science 2024-02-06 Raphael Araujo Sampaio , Joaquim Dias Garcia , Marcus Poggi , Thibaut Vidal

We consider the problem of clustering in the learning-augmented setting, where we are given a data set in $d$-dimensional Euclidean space, and a label for each data point given by an oracle indicating what subsets of points should be…

Machine Learning · Computer Science 2023-03-02 Thy Nguyen , Anamay Chaturvedi , Huy Lê Nguyen

The K-means algorithm is arguably the most popular data clustering method, commonly applied to processed datasets in some "feature spaces", as is in spectral clustering. Highly sensitive to initializations, however, K-means encounters a…

Machine Learning · Computer Science 2019-06-04 Feiyu Chen , Yuchen Yang , Liwei Xu , Taiping Zhang , Yin Zhang

Recent empirical evidence indicates that many machine learning applications involve heavy-tailed gradient noise, which challenges the standard assumptions of bounded variance in stochastic optimization. Gradient clipping has emerged as a…

Optimization and Control · Mathematics 2025-07-10 Florian Hübler , Ilyas Fatkhullin , Niao He

We improve current instability-based methods for the selection of the number of clusters $k$ in cluster analysis by developing a normalized cluster instability measure that corrects for the distribution of cluster sizes, a previously…

Machine Learning · Statistics 2018-10-16 Jonas M. B. Haslbeck , Dirk U. Wulff

We employ unsupervised machine learning to enhance the accuracy of our recently presented scaling method for wave confinement analysis [1]. We employ the standard k-means++ algorithm as well as our own model-based algorithm. We investigate…

Non-negative matrix factorization (NMF) and its variants have been widely employed in clustering and classification tasks (Long, & Jian , 2021). However, noises can seriously affect the results of our experiments. Our research is dedicated…

Machine Learning · Computer Science 2023-12-05 Cheng Zeng , Jiaqi Tian , Yixuan Xu

We consider the robust algorithms for the $k$-means clustering problem where a quantizer is constructed based on $N$ independent observations. Our main results are median of means based non-asymptotic excess distortion bounds that hold…

Statistics Theory · Mathematics 2020-11-04 Yegor Klochkov , Alexey Kroshnin , Nikita Zhivotovskiy

The fuzzy $K$-means problem is a generalization of the classical $K$-means problem to soft clusterings, i.e. clusterings where each points belongs to each cluster to some degree. Although popular in practice, prior to this work the fuzzy…

Machine Learning · Computer Science 2015-12-21 Johannes Blömer , Sascha Brauer , Kathrin Bujna

Noise robustness in keyword spotting remains a challenge as many models fail to overcome the heavy influence of noises, causing the deterioration of the quality of feature embeddings. We proposed a contrastive regularization method called…

Sound · Computer Science 2022-09-15 Dianwen Ng , Jia Qi Yip , Tanmay Surana , Zhao Yang , Chong Zhang , Yukun Ma , Chongjia Ni , Eng Siong Chng , Bin Ma

We introduce a model-free relax-and-round algorithm for k-means clustering based on a semidefinite relaxation due to Peng and Wei. The algorithm interprets the SDP output as a denoised version of the original data and then rounds this…

Machine Learning · Statistics 2016-05-11 Dustin G. Mixon , Soledad Villar , Rachel Ward

We study federated clustering, where interconnected devices collaboratively cluster the data points of private local datasets. Focusing on hard clustering via the k-means principle, we formulate federated k-means as an instance of…

Machine Learning · Computer Science 2026-01-29 Xu Yang , Salvatore Rastelli , Alexander Jung