English
Related papers

Related papers: TiK-means: $K$-means clustering for skewed groups

200 papers

Group convolutions and cross-correlations, which are equivariant to the actions of group elements, are commonly used in mathematics to analyze or take advantage of symmetries inherent in a given problem setting. Here, we provide efficient…

The K-means algorithm is a widely used clustering algorithm that offers simplicity and efficiency. However, the traditional K-means algorithm uses the random method to determine the initial cluster centers, which make clustering results…

Machine Learning · Computer Science 2019-11-28 Jie Yang , Yu-Kai Wang , Xin Yao , Chin-Teng Lin

We study federated clustering, where interconnected devices collaboratively cluster the data points of private local datasets. Focusing on hard clustering via the k-means principle, we formulate federated k-means as an instance of…

Machine Learning · Computer Science 2026-01-29 Xu Yang , Salvatore Rastelli , Alexander Jung

We combine K-means clustering with the least-squares kernel classification method. K-means clustering is used to extract a set of representative vectors for each class. The least-squares kernel method uses these representative vectors as a…

Machine Learning · Computer Science 2020-12-25 M. Andrecut

Centroid-based clustering algorithms, such as hard K-means (HKM) and fuzzy K-means (FKM), have suffered from learning bias towards large clusters. Their centroids tend to be crowded in large clusters, compromising performance when the true…

Machine Learning · Computer Science 2024-06-07 Yudong He

Data mining focuses on discovering interesting, non-trivial and meaningful information from large datasets. Data clustering is one of the unsupervised and descriptive data mining task which group data based on similarity features and…

Neural and Evolutionary Computing · Computer Science 2023-05-09 Pitawelayalage Dasun Dileepa Pitawela , Gamage Upeksha Ganegoda

Clustering is one of the most fundamental tasks in machine learning, and the k-means clustering algorithm is perhaps one of the most widely used clustering algorithms. However, it suffers from several limitations, such as sensitivity to…

Quantum Physics · Physics 2026-04-10 Syed M. Abdullah , Alisha Baba , Muhammad Siddique , Muhammad Faryad

We show how to convert any clustering into a prediction set. This has the effect of converting the clustering into a (possibly overlapping) union of spheres or ellipsoids. The tuning parameters can be chosen to minimize the size of the…

Methodology · Statistics 2019-11-28 Jaehyeok Shin , Alessandro Rinaldo , Larry Wasserman

We provide a new bi-criteria $\tilde{O}(\log^2 k)$ competitive algorithm for explainable $k$-means clustering. Explainable $k$-means was recently introduced by Dasgupta, Frost, Moshkovitz, and Rashtchian (ICML 2020). It is described by an…

Machine Learning · Computer Science 2022-04-28 Konstantin Makarychev , Liren Shan

Clustering is a fundamental unsupervised learning task with applications across a wide range of domains. Popular algorithms such as $k$-means are efficient and widely used, but can be sensitive to outliers, ambiguous boundary points, and…

Machine Learning · Computer Science 2026-03-12 Aggelos Semoglou , Aristidis Likas , John Pavlopoulos

In a real-world data set there is always the possibility, rather high in our opinion, that different features may have different degrees of relevance. Most machine learning algorithms deal with this fact by either selecting or deselecting…

Machine Learning · Computer Science 2016-01-15 Renato Cordeiro de Amorim

There has been much progress on efficient algorithms for clustering data points generated by a mixture of $k$ probability distributions under the assumption that the means of the distributions are well-separated, i.e., the distance between…

Data Structures and Algorithms · Computer Science 2010-04-13 Amit Kumar , Ravindran Kannan

We propose the \emph{weighted K-harmonic means} (WKHM) clustering algorithm, a regularized variant of K-harmonic means designed to ensure numerical stability while enabling soft assignments through inverse-distance weighting. Unlike…

Artificial Intelligence · Computer Science 2025-12-19 Gourab Ghatak

The invention of the transformer architecture has revolutionized Artificial Intelligence (AI), yielding unprecedented success in areas such as natural language processing, computer vision, and multimodal reasoning. Despite these advances,…

Machine Learning · Computer Science 2025-06-25 Kenneth L. Clarkson , Lior Horesh , Takuya Ito , Charlotte Park , Parikshit Ram

Clustering, a fundamental activity in unsupervised learning, is notoriously difficult when the feature space is high-dimensional. Fortunately, in many realistic scenarios, only a handful of features are relevant in distinguishing clusters.…

Machine Learning · Statistics 2020-10-23 Zhiyue Zhang , Kenneth Lange , Jason Xu

We present methods for k-means clustering on a stream with a focus on providing fast responses to clustering queries. Compared to the current state-of-the-art, our methods provide substantial improvement in the query time for cluster…

Data Structures and Algorithms · Computer Science 2018-12-10 Yu Zhang , Kanat Tangwongsan , Srikanta Tirthapura

This paper shows that one can be competitive with the k-means objective while operating online. In this model, the algorithm receives vectors v_1,...,v_n one by one in an arbitrary order. For each vector the algorithm outputs a cluster…

Data Structures and Algorithms · Computer Science 2015-02-24 Edo Liberty , Ram Sriharsha , Maxim Sviridenko

In location-based resource allocation scenarios, the distances between each individual and the facility are desired to be approximately equal, thereby ensuring fairness. Individually fair clustering is often employed to achieve the…

Machine Learning · Computer Science 2024-06-25 Shengkun Zhu , Jinshan Zeng , Yuan Sun , Sheng Wang , Xiaodong Li , Zhiyong Peng

We propose a simple yet effective multiple kernel clustering algorithm, termed simple multiple kernel k-means (SimpleMKKM). It extends the widely used supervised kernel alignment criterion to multi-kernel clustering. Our criterion is given…

Machine Learning · Computer Science 2020-05-13 Xinwang Liu , En Zhu , Jiyuan Liu , Timothy Hospedales , Yang Wang , Meng Wang

This paper presents a novel centroid-based heuristic algorithm, termed Kempe Swap K-Means, for constrained clustering under rigid must-link (ML) and cannot-link (CL) constraints. The algorithm employs a dual-phase iterative process: an…

Machine Learning · Computer Science 2026-03-31 Yuxuan Ren , Shijie Deng