English
Related papers

Related papers: Consistency of spectral clustering

200 papers

Clustering of data sets is a standard problem in many areas of science and engineering. The method of spectral clustering is based on embedding the data set using a kernel function, and using the top eigenvectors of the normalized Laplacian…

Statistics Theory · Mathematics 2015-04-08 Geoffrey Schiebinger , Martin J. Wainwright , Bin Yu

The spectral clustering algorithm is often used as a binary clustering method for unclassified data by applying the principal component analysis. To study theoretical properties of the algorithm, the assumption of conditional…

Statistics Theory · Mathematics 2025-05-27 Kohei Kawamoto , Yuichi Goto , Koji Tsukuda

We study random graphs with possibly different edge probabilities in the challenging sparse regime of bounded expected degrees. Unlike in the dense case, neither the graph adjacency matrix nor its Laplacian concentrate around their…

Statistics Theory · Mathematics 2015-04-24 Can M. Le , Elizaveta Levina , Roman Vershynin

We build upon recent advances in graph signal processing to propose a faster spectral clustering algorithm. Indeed, classical spectral clustering is based on the computation of the first k eigenvectors of the similarity matrix' Laplacian,…

Social and Information Networks · Computer Science 2015-09-30 Nicolas Tremblay , Gilles Puy , Pierre Borgnat , Remi Gribonval , Pierre Vandergheynst

In this paper, we study the convergence of the spectral embeddings obtained from the leading eigenvectors of certain similarity matrices to their population counterparts. We opt to study this convergence in a uniform (instead of average)…

Statistics Theory · Mathematics 2023-04-26 Ruofei Zhao , Songkai Xue , Yuekai Sun

Spectral clustering is a powerful unsupervised machine learning algorithm for clustering data with non convex or nested structures. With roots in graph theory, it uses the spectral properties of the Laplacian matrix to project the data in a…

Quantum Physics · Physics 2021-06-15 Iordanis Kerenidis , Jonas Landman

Spectral clustering is discussed from many perspectives, by extending it to rectangular arrays and discrepancy minimization too. Near optimal clusters are obtained with singular value decomposition and with the weighted $k$-means algorithm.…

Combinatorics · Mathematics 2022-01-06 Marianna Bolla , Vilas Winstein , Tao You , Frank Seidl , Fatma Abdelkhalek

Cluster structure detection is a fundamental task for the analysis of graphs, in order to understand and to visualize their functional characteristics. Among the different cluster structure detection methods, spectral clustering is…

Machine Learning · Statistics 2020-04-09 Camille Champion , Blazère Mélanie , Burcelin Rémy , Loubes Jean-Michel , Risser Laurent

Spectral clustering is widely used to partition graphs into distinct modules or communities. Existing methods for spectral clustering use the eigenvalues and eigenvectors of the graph Laplacian, an operator that is closely associated with…

Social and Information Networks · Computer Science 2015-06-15 Laura M. Smith , Kristina Lerman , Cristina Garcia-Cardona , Allon G. Percus , Rumi Ghosh

Spectral clustering has become one of the most widely used clustering techniques when the structure of the individual clusters is non-convex or highly anisotropic. Yet, despite its immense popularity, there exists fairly little theory about…

Machine Learning · Statistics 2019-04-16 Shuyang Ling , Thomas Strohmer

Spectral clustering is a popular method for community detection in network graphs: starting from a matrix representation of the graph, the nodes are clustered on a low dimensional projection obtained from a truncated spectral decomposition…

Machine Learning · Statistics 2022-08-10 Francesco Sanna Passino , Nicholas A. Heard , Patrick Rubin-Delanchy

Observational data usually comes with a multimodal nature, which means that it can be naturally represented by a multi-layer graph whose layers share the same set of vertices (users) with different edges (pairwise relationships). In this…

Machine Learning · Computer Science 2015-08-31 Xiaowen Dong , Pascal Frossard , Pierre Vandergheynst , Nikolai Nefedov

Semi-supervised Laplacian regularization, a standard graph-based approach for learning from both labelled and unlabelled data, was recently demonstrated to have an insignificant high dimensional learning efficiency with respect to…

Machine Learning · Computer Science 2020-06-16 Xiaoyi Mai , Romain Couillet

Spectral clustering is a leading and popular technique in unsupervised data analysis. Two of its major limitations are scalability and generalization of the spectral embedding (i.e., out-of-sample-extension). In this paper we introduce a…

Machine Learning · Statistics 2024-11-06 Uri Shaham , Kelly Stanton , Henry Li , Boaz Nadler , Ronen Basri , Yuval Kluger

Synchronization is an important and prevalent phenomenon in natural and engineered systems. In many dynamical networks, the coupling is balanced or adjusted in order to admit global synchronization, a condition called Laplacian coupling.…

The rich spectral information of the graph Laplacian has been instrumental in graph theory, machine learning, and graph signal processing for applications such as graph classification, clustering, or eigenmode analysis. Recently, the Hodge…

Algebraic Topology · Mathematics 2024-03-27 Vincent P. Grande , Michael T. Schaub

Spectral clustering is a popular and effective algorithm designed to find $k$ clusters in a graph $G$. In the classical spectral clustering algorithm, the vertices of $G$ are embedded into $\mathbb{R}^k$ using $k$ eigenvectors of the graph…

Data Structures and Algorithms · Computer Science 2023-10-18 Peter Macgregor

The performance of spectral clustering relies on the fluctuations of the entries of the eigenvectors of a similarity matrix, which has been left uncharacterized until now. In this letter, it is shown that the signal $+$ noise structure of a…

Machine Learning · Statistics 2024-05-28 Hugo Lebeau , Florent Chatelain , Romain Couillet

Spectral clustering has been widely used for community detection in network sciences. While its empirical successes are well-documented, a clear theoretical understanding, particularly for sparse networks where degrees are much smaller than…

Statistics Theory · Mathematics 2024-05-13 Anderson Ye Zhang

The problem of clustering is considered, for the case when each data point is a sample generated by a stationary ergodic process. We propose a very natural asymptotic notion of consistency, and show that simple consistent algorithms exist,…

Machine Learning · Computer Science 2013-05-01 Daniil Ryabko