中文
相关论文

相关论文: Statistical and Computational Guarantees of Lloyd'…

200 篇论文

We study a recently proposed large-scale distributed learning paradigm, namely Federated Learning, where the worker machines are end users' own devices. Statistical and computational challenges arise in Federated Learning particularly in…

机器学习 · 计算机科学 2019-10-11 Avishek Ghosh , Justin Hong , Dong Yin , Kannan Ramchandran

Clustering large, mixed data is a central problem in data mining. Many approaches adopt the idea of k-means, and hence are sensitive to initialisation, detect only spherical clusters, and require a priori the unknown number of clusters. We…

机器学习 · 统计学 2020-11-13 Joshua Tobin , Mimi Zhang

Consensus clustering aggregates partitions in order to find a better fit by reconciling clustering results from different sources/executions. In practice, there exist noise and outliers in clustering task, which, however, may significantly…

机器学习 · 计算机科学 2023-01-03 Deguang Kong , Miao Lu , Konstantin Shmakov , Jian Yang

Clustering problems have numerous applications and are becoming more challenging as the size of the data increases. In this paper, we consider designing clustering algorithms that can be used in MapReduce, the most popular programming…

分布式、并行与集群计算 · 计算机科学 2011-09-09 Alina Ene , Sungjin Im , Benjamin Moseley

Graph clustering has many important applications in computing, but due to the increasing sizes of graphs, even traditionally fast clustering methods can be computationally expensive for real-world graphs of interest. Scalability problems…

社会与信息网络 · 计算机科学 2018-10-18 Kimon Fountoulakis , David F. Gleich , Michael W. Mahoney

We consider the semi-supervised clustering problem where crowdsourcing provides noisy information about the pairwise comparisons on a small subset of data, i.e., whether a sample pair is in the same cluster. We propose a new approach that…

机器学习 · 统计学 2018-10-30 Yucen Luo , Tian Tian , Jiaxin Shi , Jun Zhu , Bo Zhang

The problem of clustering is considered, for the case when each data point is a sample generated by a stationary ergodic process. We propose a very natural asymptotic notion of consistency, and show that simple consistent algorithms exist,…

机器学习 · 计算机科学 2013-05-01 Daniil Ryabko

The problem of clustering is considered, for the case when each data point is a sample generated by a stationary ergodic process. We propose a very natural asymptotic notion of consistency, and show that simple consistent algorithms exist,…

机器学习 · 计算机科学 2010-05-31 Daniil Ryabko

Mixture model-based frameworks are very popular for statistical inference in clustering. While convenient for producing probabilistic estimates of cluster assignments and uncertainty, they are prone to misspecification, which can lead to…

统计理论 · 数学 2026-05-15 Yu Zheng , Leo L. Duan , Arkaprava Roy

In many modern applications, there is interest in analyzing enormous data sets that cannot be easily moved across computers or loaded into memory on a single computer. In such settings, it is very common to be interested in clustering.…

统计计算 · 统计学 2020-05-15 Hanyu Song , Yingjian Wang , David B. Dunson

In this article, we develop a clique-based method for social network clustering. We introduce a new index to evaluate the quality of clustering results, and propose an efficient algorithm based on recursive bipartition to maximize an…

社会与信息网络 · 计算机科学 2018-05-11 Guang Ouyang , Dipak K. Dey , Panpan Zhang

Bayesian clustering typically relies on mixture models, with each component interpreted as a different cluster. After defining a prior for the component parameters and weights, Markov chain Monte Carlo (MCMC) algorithms are commonly used to…

统计方法学 · 统计学 2024-07-30 Alexander Dombowsky , David B. Dunson

We study the clustering problem for mixtures of bounded covariance distributions, under a fine-grained separation assumption. Specifically, given samples from a $k$-component mixture distribution $D = \sum_{i =1}^k w_i P_i$, where each $w_i…

机器学习 · 计算机科学 2023-12-20 Ilias Diakonikolas , Daniel M. Kane , Jasper C. H. Lee , Thanasis Pittas

K-Means clustering still plays an important role in many computer vision problems. While the conventional Lloyd method, which alternates between centroid update and cluster assignment, is primarily used in practice, it may converge to a…

计算机视觉与模式识别 · 计算机科学 2018-10-30 Huu Le , Anders Eriksson , Thanh-Toan Do , Michael Milford

Lloyd's k-means algorithm is one of the most widely used clustering methods. We prove that in high-dimensional, high-noise settings, the algorithm exhibits catastrophic failure: with high probability, essentially every partition of the data…

We propose a new analysis framework for clustering $M$ items into an unknown number of $K$ distinct groups using noisy and actively collected responses. At each time step, an agent is allowed to query pairs of items and observe bandit…

机器学习 · 计算机科学 2026-02-06 Rachel S. Y. Teo , P. N. Karthik , Ramya Korlakai Vinayak , Vincent Y. F. Tan

The Euclidean k-means problem is arguably the most widely-studied clustering problem in machine learning. While the k-means objective is NP-hard in the worst-case, practitioners have enjoyed remarkable success in applying heuristics like…

机器学习 · 计算机科学 2017-12-05 Abhratanu Dutta , Aravindan Vijayaraghavan , Alex Wang

This paper considers the clustering problem for large data sets. We propose an approach based on distributed optimization. The clustering problem is formulated as an optimization problem of maximizing the classification gain. We show that…

机器学习 · 计算机科学 2010-12-10 Xudong Ma

The filtering-clustering models, including trend filtering and convex clustering, have become an important source of ideas and modeling tools in machine learning and related fields. The statistical guarantee of optimal solutions in these…

机器学习 · 统计学 2022-01-26 Nhat Ho , Tianyi Lin , Michael I. Jordan

The community structure of complex networks reveals both their organization and hidden relationships among their constituents. Most community detection methods currently available are not deterministic, and their results typically depend on…

物理与社会 · 物理学 2012-03-29 Andrea Lancichinetti , Santo Fortunato