English
Related papers

Related papers: k-Means Clustering Is Matrix Factorization

200 papers

Clustering is a powerful machine learning technique that groups "similar" data points based on their characteristics. Many clustering algorithms work by approximating the minimization of an objective function, namely the sum of…

Quantum Physics · Physics 2018-01-29 Vaibhaw Kumar , Gideon Bass , Casey Tomlin , Joseph Dulny

Ensuring fairness in machine learning algorithms is a challenging and essential task. We consider the problem of clustering a set of points while satisfying fairness constraints. While there have been several attempts to capture group…

Machine Learning · Computer Science 2023-02-07 Debajyoti Kar , Mert Kosan , Debmalya Mandal , Sourav Medya , Arlei Silva , Palash Dey , Swagato Sanyal

K-means is one of the most widely used clustering algorithms in various disciplines, especially for large datasets. However the method is known to be highly sensitive to initial seed selection of cluster centers. K-means++ has been proposed…

Machine Learning · Computer Science 2016-04-19 Fouad Khan

Common clustering methods, such as $k$-means and convex clustering, group similar vector-valued observations into clusters. However, with the increasing prevalence of matrix-valued observations, which often exhibit low rank characteristics,…

Optimization and Control · Mathematics 2024-12-24 Meixia Lin , Yangjing Zhang

The $K$-means algorithm is extended to allow for partitioning of skewed groups. Our algorithm is called TiK-Means and contributes a $K$-means type algorithm that assigns observations to groups while estimating their skewness-transformation…

Machine Learning · Statistics 2019-05-21 Nicholas S. Berry , Ranjan Maitra

We prove in this paper that the expected value of the objective function of the $k$-means++ algorithm for samples converges to population expected value. As $k$-means++, for samples, provides with constant factor approximation for $k$-means…

Machine Learning · Computer Science 2017-02-22 Mieczysław A. Kłopotek

Application of K-Means algorithm is restricted by the fact that the number of clusters should be known beforehand. Previously suggested methods to solve this problem are either ad hoc or require parametric assumptions and complicated…

Machine Learning · Computer Science 2019-12-05 Sukavanan Nanjundan , Shreeviknesh Sankaran , C. R. Arjun , G. Paavai Anand

Clustering plays a crucial role in computer science, facilitating data analysis and problem-solving across numerous fields. By partitioning large datasets into meaningful groups, clustering reveals hidden structures and relationships within…

Databases · Computer Science 2026-02-19 Aryan Esmailpour , Stavros Sintos

Coresets are among the most popular paradigms for summarizing data. In particular, there exist many high performance coresets for clustering problems such as $k$-means in both theory and practice. Curiously, there exists no work on…

Data Structures and Algorithms · Computer Science 2022-07-05 Chris Schwiegelshohn , Omar Ali Sheikh-Omar

In a recent work, [19] studied the following "fair" variants of classical clustering problems such as $k$-means and $k$-median: given a set of $n$ data points in $\mathbb{R}^d$ and a binary type associated to each data point, the goal is to…

Data Structures and Algorithms · Computer Science 2019-12-18 Lingxiao Huang , Shaofeng H. -C. Jiang , Nisheeth K. Vishnoi

This work proposes a clusterization algorithm called k-Morphological Sets (k-MS), based on morphological reconstruction and heuristics. k-MS is faster than the CPU-parallel k-Means in worst case scenarios and produces enhanced…

Machine Learning · Computer Science 2022-08-31 É. O. Rodrigues , L. Torok , P. Liatsis , J. Viterbo , A. Conci

The problem of constrained clustering has attracted significant attention in the past decades. In this paper, we study the balanced $k$-center, $k$-median, and $k$-means clustering problems where the size of each cluster is constrained by…

Computational Geometry · Computer Science 2018-09-11 Hu Ding

We extend the fair machine learning literature by considering the problem of proportional centroid clustering in a metric context. For clustering $n$ points with $k$ centers, we define fairness as proportionality to mean that any $n/k$…

Machine Learning · Computer Science 2020-10-13 Xingyu Chen , Brandon Fain , Liang Lyu , Kamesh Munagala

The $k$-means is one of the most important unsupervised learning techniques in statistics and computer science. The goal is to partition a data set into many clusters, such that observations within clusters are the most homogeneous and…

Machine Learning · Statistics 2022-11-21 Tonglin Zhang

In this paper, we study the problem of fair clustering on the $k-$center objective. In fair clustering, the input is $N$ points, each belonging to at least one of $l$ protected groups, e.g. male, female, Asian, Hispanic. The objective is to…

Machine Learning · Computer Science 2020-11-10 Elfarouk Harb , Ho Shan Lam

In addition to finding meaningful clusters, centroid-based clustering algorithms such as K-means or mean-shift should ideally find centroids that are valid patterns in the input space, representative of data in their cluster. This is…

Machine Learning · Computer Science 2014-06-17 Weiran Wang , Miguel Á. Carreira-Perpiñán

In this contribution, the clustering procedure based on K-Means algorithm is studied as an inverse problem, which is a special case of the illposed problems. The attempts to improve the quality of the clustering inverse problem drive to…

Numerical Analysis · Mathematics 2022-11-16 Alberto Arturo Vergani

The ability to monitor the progress of students academic performance is a critical issue to the academic community of higher learning. A system for analyzing students results based on cluster analysis and uses standard statistical…

Machine Learning · Computer Science 2010-02-12 O. J. Oyelade , O. O. Oladipupo , I. C. Obagbuwa

K-means clustering is an unsupervised clustering method that requires an initial decision of number of clusters. One method to determine the number of clusters is the elbow method, a heuristic method that relies on visual representation.…

Methodology · Statistics 2025-02-11 Indra Herdiana , M Alfin Kamal , Triyani , Mutia Nur Estri , Renny

In data summarization we want to choose $k$ prototypes in order to summarize a data set. We study a setting where the data set comprises several demographic groups and we are restricted to choose $k_i$ prototypes belonging to group $i$. A…

Machine Learning · Statistics 2019-05-14 Matthäus Kleindessner , Pranjal Awasthi , Jamie Morgenstern