English
Related papers

Related papers: A Performance Guarantee for Spectral Clustering

200 papers

We revisit the problem of spectral clustering in multimodal settings, where each data modality is encoded as a graph Laplacian. While classical approaches--including joint diagonalization, spectral co-regularization, and multiview…

Numerical Analysis · Mathematics 2025-09-16 Haoze He , Artemis Pados , Daniel Kressner

Let \phi(G) be the minimum conductance of an undirected graph G, and let 0=\lambda_1 <= \lambda_2 <=... <= \lambda_n <= 2 be the eigenvalues of the normalized Laplacian matrix of G. We prove that for any graph G and any k >= 2, \phi(G) =…

Data Structures and Algorithms · Computer Science 2013-01-24 Tsz Chiu Kwok , Lap Chi Lau , Yin Tat Lee , Shayan Oveis Gharan , Luca Trevisan

We propose a novel distributed algorithm to cluster graphs. The algorithm recovers the solution obtained from spectral clustering without the need for expensive eigenvalue/vector computations. We prove that, by propagating waves through the…

Discrete Mathematics · Computer Science 2015-03-13 Tuhin Sahai , Alberto Speranzon , Andrzej Banaszuk

This letter presents a new spectral-clustering-based approach to the subspace clustering problem. Underpinning the proposed method is a convex program for optimal direction search, which for each data point d finds an optimal direction in…

Computer Vision and Pattern Recognition · Computer Science 2017-11-28 Mostafa Rahmani , George Atia

The theoretical analysis of spectral clustering mainly focuses on consistency, while there is relatively little research on its generalization performance. In this paper, we study the excess risk bounds of the popular spectral clustering…

Machine Learning · Computer Science 2022-07-19 Shaojie Li , Sheng Ouyang , Yong Liu

In this paper, we analyse classical variants of the Spectral Clustering (SC) algorithm in the Dynamic Stochastic Block Model (DSBM). Existing results show that, in the relatively sparse case where the expected degree grows logarithmically…

Machine Learning · Statistics 2020-02-11 Nicolas Keriven , Samuel Vaiter

This work studies the classical spectral clustering algorithm which embeds the vertices of some graph $G=(V_G, E_G)$ into $\mathbb{R}^k$ using $k$ eigenvectors of some matrix of $G$, and applies $k$-means to partition $V_G$ into $k$…

Data Structures and Algorithms · Computer Science 2022-08-04 Peter Macgregor , He Sun

Graph-based multi-view spectral clustering methods have achieved notable progress recently, yet they often fall short in either oversimplifying pairwise relationships or struggling with inefficient spectral decompositions in…

Machine Learning · Computer Science 2025-11-14 Murong Yang , Shihui Ying , Xin-Jian Xu , Yue Gao

Subspace clustering (SC) refers to the problem of clustering high-dimensional data into a union of low-dimensional subspaces. Based on spectral clustering, state-of-the-art approaches solve SC problem within a two-stage framework. In the…

Machine Learning · Computer Science 2019-05-06 Shuai Yang , Wenqi Zhu , Yuesheng Zhu

Spectral clustering is one of the most popular clustering algorithms that has stood the test of time. It is simple to describe, can be implemented using standard linear algebra, and often finds better clusters than traditional clustering…

Machine Learning · Computer Science 2023-05-12 Timothy Chu , Gary Miller , Noel Walkington

Spectral clustering, as a popular tool for data clustering, requires an eigen-decomposition step on a given affinity to obtain the spectral embedding. Nevertheless, such a step suffers from the lack of generalizability and scalability.…

Machine Learning · Computer Science 2025-03-13 Wei He , Shangzhi Zhang , Chun-Guang Li , Xianbiao Qi , Rong Xiao , Jun Guo

Graph construction is a crucial step in spectral clustering (SC) and graph-based semi-supervised learning (SSL). Spectral methods applied on standard graphs such as full-RBF, $\epsilon$-graphs and $k$-NN graphs can lead to poor performance…

Machine Learning · Statistics 2012-05-09 Jing Qian , Venkatesh Saligrama , Manqi Zhao

The community detection problem for graphs asks one to partition the n vertices V of a graph G into k communities, or clusters, such that there are many intracluster edges and few intercluster edges. Of course this is equivalent to finding…

Information Theory · Computer Science 2018-08-21 Ming-Jun Lai , Daniel Mckenzie

The present paper is devoted to clustering geometric graphs. While the standard spectral clustering is often not effective for geometric graphs, we present an effective generalization, which we call higher-order spectral clustering. It…

Machine Learning · Computer Science 2021-03-16 Konstantin Avrachenkov , Andrei Bobu , Maximilien Dreveton

Among community detection methods, spectral clustering enjoys two desirable properties: computational efficiency and theoretical guarantees of consistency. Most studies of spectral clustering consider only the edges of a network as input to…

Machine Learning · Statistics 2022-05-18 Jonathan Hehir , Xiaoyue Niu , Aleksandra Slavkovic

Unsupervised clustering of scattered, noisy and high-dimensional data points is an important and difficult problem. Tight continuous relaxations of balanced cut problems have recently been shown to provide excellent clustering results. In…

Optimization and Control · Mathematics 2012-05-01 Xavier Bresson , Thomas Laurent , David Uminsky , James H. von Brecht

We are interested in multilayer graph clustering, which aims at dividing the graph nodes into categories or communities. To do so, we propose to learn a clustering-friendly embedding of the graph nodes by solving an optimization problem…

Machine Learning · Computer Science 2021-03-31 Mireille El Gheche , Pascal Frossard

Clustering is a NP-hard problem. Thus, no optimal algorithm exists, heuristics are applied to cluster the data. Heuristics can be very resource-intensive, if not applied properly. For substantially large data sets computational efficiencies…

Databases · Computer Science 2020-03-11 Mujahid Sultan

We propose an efficient approach to semidefinite spectral clustering (SSC), which addresses the Frobenius normalization with the positive semidefinite (p.s.d.) constraint for spectral clustering. Compared with the original Frobenius norm…

Machine Learning · Computer Science 2014-02-25 Yan Yan , Chunhua Shen , Hanzi Wang

Spectral clustering (SC) and graph-based semi-supervised learning (SSL) algorithms are sensitive to how graphs are constructed from data. In particular if the data has proximal and unbalanced clusters these algorithms can lead to poor…

Machine Learning · Statistics 2013-02-22 Jing Qian , Venkatesh Saligrama