English
Related papers

Related papers: Dual-tree $k$-means with bounded iteration runtime

200 papers

Random Indexing (RI) K-tree is the combination of two algorithms for clustering. Many large scale problems exist in document clustering. RI K-tree scales well with large inputs due to its low complexity. It also exhibits features that are…

Information Retrieval · Computer Science 2010-02-02 Christopher M. De Vries , Lance De Vine , Shlomo Geva

In this paper, we analyze the classical $K$-means alternating-minimization algorithm, also known as Lloyd's algorithm (Lloyd, 1956), for a mixture of Gaussians in a data-distributed setting that incorporates local iteration steps. Assuming…

Machine Learning · Statistics 2025-05-27 Harsh Vardhan , Heng Zhu , Avishek Ghosh , Arya Mazumdar

We show that the popular k-means clustering algorithm (Lloyd's heuristic), used for a variety of scientific data, can result in outcomes that are unfavorable to subgroups of data (e.g., demographic groups). Such biased clusterings can have…

Machine Learning · Computer Science 2020-10-30 Mehrdad Ghadiri , Samira Samadi , Santosh Vempala

Mining clusters from data is an important endeavor in many applications. The $k$-means method is a popular, efficient, and distribution-free approach for clustering numerical-valued data, but does not apply for categorical-valued…

Methodology · Statistics 2021-08-24 Karin S. Dorman , Ranjan Maitra

K-means -- and the celebrated Lloyd algorithm -- is more than the clustering method it was originally designed to be. It has indeed proven pivotal to help increase the speed of many machine learning and data analysis techniques such as…

Machine Learning · Computer Science 2019-08-26 Luc Giffon , Valentin Emiya , Liva Ralaivola , Hachem Kadri

Consider the following generalization of the classic binary search problem: a searcher is required to find a hidden vertex $x$ in a tree $T$. To do so, they iteratively perform queries to an oracle, each about a chosen vertex $v$. After…

Data Structures and Algorithms · Computer Science 2025-10-01 Michał Szyfelbein

Using a trimming approach, we investigate a k-means type method based on Bregman divergences for clustering data possibly corrupted with clutter noise. The main interest of Bregman divergences is that the standard Lloyd algorithm adapts to…

Statistics Theory · Mathematics 2020-09-10 Aurélie Fischer , Clément Levrard , Claire Brécheteau

We consider $K$-means clustering in networked environments (e.g., internet of things (IoT) and sensor networks) where data is inherently distributed across nodes and processing power at each node may be limited. We consider a clustering…

Machine Learning · Computer Science 2019-01-03 Soummya Kar , Brian Swenson

We consider online algorithms for the $k$-server problem on trees. There is a $k$-competitive algorithm for this problem, and it is the best competitive ratio. M. Chrobak and L. Larmore provided it. At the same time, the existing…

Data Structures and Algorithms · Computer Science 2022-05-02 Kamil Khadiev , Maxim Yagafarov

$k$-means clustering is a well-studied problem due to its wide applicability. Unfortunately, there exist strong theoretical limits on the performance of any algorithm for the $k$-means problem on worst-case inputs. To overcome this barrier,…

Machine Learning · Computer Science 2022-03-22 Jon C. Ergun , Zhili Feng , Sandeep Silwal , David P. Woodruff , Samson Zhou

Lloyd's k-means algorithm is one of the most widely used clustering methods. We prove that in high-dimensional, high-noise settings, the algorithm exhibits catastrophic failure: with high probability, essentially every partition of the data…

Machine Learning · Statistics 2026-02-11 Roy R. Lederman , David Silva-Sánchez , Ziling Chen , Gilles Mordant , Amnon Balanov , Tamir Bendory

We consider the problem of explainable $k$-medians and $k$-means introduced by Dasgupta, Frost, Moshkovitz, and Rashtchian~(ICML 2020). In this problem, our goal is to find a threshold decision tree that partitions data into $k$ clusters…

Data Structures and Algorithms · Computer Science 2021-08-04 Konstantin Makarychev , Liren Shan

Clustering plays a crucial role in computer science, facilitating data analysis and problem-solving across numerous fields. By partitioning large datasets into meaningful groups, clustering reveals hidden structures and relationships within…

Databases · Computer Science 2026-02-19 Aryan Esmailpour , Stavros Sintos

We revisit the \textsc{$k$-Secluded Tree} problem. Given a vertex-weighted undirected graph $G$, its objective is to find a maximum-weight induced subtree $T$ whose open neighborhood has size at most $k$. We present a fixed-parameter…

Data Structures and Algorithms · Computer Science 2022-06-27 Huib Donkers , Bart M. P. Jansen , Jari J. H. de Kroon

$k$-center is one of the most popular clustering models. While it admits a simple 2-approximation in polynomial time in general metrics, the Euclidean version is NP-hard to approximate within a factor of 1.93, even in the plane, if one…

Data Structures and Algorithms · Computer Science 2021-12-21 Sayan Bandyapadhyay , Zachary Friggstad , Ramin Mousavi

The k-means method is a widely used clustering algorithm. One of its distinguished features is its speed in practice. Its worst-case running-time, however, is exponential, leaving a gap between practical and theoretical performance. Arthur…

Data Structures and Algorithms · Computer Science 2008-09-11 Bodo Manthey , Heiko Röglin

The invention of the transformer architecture has revolutionized Artificial Intelligence (AI), yielding unprecedented success in areas such as natural language processing, computer vision, and multimodal reasoning. Despite these advances,…

Machine Learning · Computer Science 2025-06-25 Kenneth L. Clarkson , Lior Horesh , Takuya Ito , Charlotte Park , Parikshit Ram

We give a polynomial-time approximation algorithm for the (not necessarily metric) $k$-Median problem. The algorithm is an $\alpha$-size-approximation algorithm for $\alpha < 1 + 2 \ln(n/k)$. That is, it guarantees a solution having size at…

Data Structures and Algorithms · Computer Science 2025-11-18 Neal E. Young

K-means is one of the most widely used algorithms for clustering in Data Mining applications, which attempts to minimize the sum of the square of the Euclidean distance of the points in the clusters from the respective means of the…

Machine Learning · Computer Science 2016-11-01 Sayantan Dasgupta

Polytrees are a subclass of Bayesian networks that seek to capture the conditional dependencies between a set of $n$ variables as a directed forest and are motivated by their more efficient inference and improved interpretability. Since the…

Data Structures and Algorithms · Computer Science 2026-05-06 Juha Harviainen , Frank Sommer , Manuel Sorge