English
Related papers

Related papers: Connecting Spectral Clustering to Maximum Margins …

200 papers

The theoretical analysis of spectral clustering mainly focuses on consistency, while there is relatively little research on its generalization performance. In this paper, we study the excess risk bounds of the popular spectral clustering…

Machine Learning · Computer Science 2022-07-19 Shaojie Li , Sheng Ouyang , Yong Liu

Spectral clustering has become one of the most widely used clustering techniques when the structure of the individual clusters is non-convex or highly anisotropic. Yet, despite its immense popularity, there exists fairly little theory about…

Machine Learning · Statistics 2019-04-16 Shuyang Ling , Thomas Strohmer

Spectral clustering has been one of the widely used methods for community detection in networks. However, large-scale networks bring computational challenges to the eigenvalue decomposition therein. In this paper, we study the spectral…

Social and Information Networks · Computer Science 2022-01-07 Hai Zhang , Xiao Guo , Xiangyu Chang

Spectral clustering is a novel clustering method which can detect complex shapes of data clusters. However, it requires the eigen decomposition of the graph Laplacian matrix, which is proportion to $O(n^3)$ and thus is not suitable for…

Machine Learning · Computer Science 2013-07-02 Nguyen Lu Dang Khoa , Sanjay Chawla

Spectral clustering refers to a family of unsupervised learning algorithms that compute a spectral embedding of the original data based on the eigenvectors of a similarity graph. This non-linear transformation of the data is both the key of…

Machine Learning · Computer Science 2019-01-30 Nicolas Tremblay , Andreas Loukas

We revisit the theoretical performances of Spectral Clustering, a classical algorithm for graph partitioning that relies on the eigenvectors of a matrix representation of the graph. Informally, we show that Spectral Clustering works well as…

Machine Learning · Computer Science 2025-12-01 George Tyler , Luca Zanetti

Networks or graphs can easily represent a diverse set of data sources that are characterized by interacting units or actors. Social networks, representing people who communicate with each other, are one example. Communities or clusters of…

Machine Learning · Statistics 2011-12-14 Karl Rohe , Sourav Chatterjee , Bin Yu

The problem of clustering noisy and incompletely observed high-dimensional data points into a union of low-dimensional subspaces and a set of outliers is considered. The number of subspaces, their dimensions, and their orientations are…

Machine Learning · Statistics 2015-08-24 Reinhard Heckel , Helmut Bölcskei

In this paper we prove the strong consistency of several methods based on the spectral clustering techniques that are widely used to study the community detection problem in stochastic block models (SBMs). We show that under some weak…

Methodology · Statistics 2019-05-16 Liangjun Su , Wuyi Wang , Yichong Zhang

Spectral clustering techniques are valuable tools in signal processing and machine learning for partitioning complex data sets. The effectiveness of spectral clustering stems from constructing a non-linear embedding based on creating a…

Machine Learning · Computer Science 2021-02-02 Farhad Pourkamali-Anaraki

The two-step spectral clustering method, which consists of the Laplacian eigenmap and a rounding step, is a widely used method for graph partitioning. It can be seen as a natural relaxation to the NP-hard minimum ratio cut problem. In this…

Machine Learning · Statistics 2020-07-14 March Boedihardjo , Shaofeng Deng , Thomas Strohmer

We take an image science perspective on the problem of determining brain network connectivity given functional activity. But adapting the concept of image resolution to this problem, we provide a new perspective on network partitioning for…

Neurons and Cognition · Quantitative Biology 2020-02-14 Keith Dillon , Yu-Ping Wang

Graph clustering is a fundamental task in unsupervised learning with broad real-world applications. While spectral clustering methods for undirected graphs are well-established and guided by a minimum cut optimization consensus, their…

Machine Learning · Statistics 2025-06-04 Ning Zhang , Xiaowen Dong , Mihai Cucuringu

Spectral clustering is a popular algorithm that clusters points using the eigenvalues and eigenvectors of Laplacian matrices derived from the data. For years, spectral clustering has been working mysteriously. This paper explains spectral…

Machine Learning · Statistics 2021-03-02 T Shen

We consider a random geometric graph with vertices sampled from a probability measure supported on $\mathbb R^d$, and study its connectivity. We show the graph is typically disconnected, unless the sampling density has superexponential…

Probability · Mathematics 2021-04-07 Henry-Louis de Kergorlay

Spectral clustering is one of the most important algorithms in data mining and machine intelligence; however, its computational complexity limits its application to truly large scale data analysis. The computational bottleneck in spectral…

Machine Learning · Computer Science 2015-05-13 Christos Boutsidis , Alex Gittens , Prabhanjan Kambadur

Spectral clustering has become a popular technique due to its high performance in many contexts. It comprises three main steps: create a similarity graph between N objects to cluster, compute the first k eigenvectors of its Laplacian matrix…

Data Structures and Algorithms · Computer Science 2016-05-24 Nicolas Tremblay , Gilles Puy , Remi Gribonval , Pierre Vandergheynst

This paper establishes the consistency of spectral approaches to data clustering. We consider clustering of point clouds obtained as samples of a ground-truth measure. A graph representing the point cloud is obtained by assigning weights to…

Statistics Theory · Mathematics 2015-08-11 Nicolás García Trillos , Dejan Slepčev

We consider the problem of clustering a set of high-dimensional data points into sets of low-dimensional linear subspaces. The number of subspaces, their dimensions, and their orientations are unknown. We propose a simple and low-complexity…

Information Theory · Computer Science 2013-03-18 Reinhard Heckel , Helmut Bölcskei

We analyze the performance of spectral clustering for community extraction in stochastic block models. We show that, under mild conditions, spectral clustering applied to the adjacency matrix of the network can consistently recover hidden…

Statistics Theory · Mathematics 2014-12-31 Jing Lei , Alessandro Rinaldo