English
Related papers

Related papers: Connecting Spectral Clustering to Maximum Margins …

200 papers

Spectral clustering is a celebrated algorithm that partitions objects based on pairwise similarity information. While this approach has been successfully applied to a variety of domains, it comes with limitations. The reason is that there…

Statistics Theory · Mathematics 2018-05-24 Kwangjun Ahn , Kangwook Lee , Changho Suh

As a result of the recent popularity of social networks and the increase in the number of research papers published across all fields, attributed networks consisting of relationships between objects, such as humans and the papers, that have…

Social and Information Networks · Computer Science 2020-10-15 Yuta Yajima , Akihiro Inokuchi

Spectral clustering is a powerful unsupervised machine learning algorithm for clustering data with non convex or nested structures. With roots in graph theory, it uses the spectral properties of the Laplacian matrix to project the data in a…

Quantum Physics · Physics 2021-06-15 Iordanis Kerenidis , Jonas Landman

Spectral clustering methods are known for their ability to represent clusters of diverse shapes, densities etc. However, results of such algorithms, when applied e.g. to text documents, are hard to explain to the user, especially due to…

Machine Learning · Computer Science 2023-08-02 Bartłomiej Starosta , Mieczysław A. Kłopotek , Sławomir T. Wierzchoń

This paper establishes the theoretical limits of graph clustering under the Popularity-Adjusted Block Model (PABM), addressing limitations of existing models. In contrast to the Stochastic Block Model (SBM), which assumes uniform vertex…

Machine Learning · Computer Science 2025-10-27 Maximilien Dreveton , Elaine Siyu Liu , Matthias Grossglauser , Patrick Thiran

We generalize finite-sample bounds for convex clustering to the setting where affinity weights appearing in the objective correspond to a general connected graph. These bounds and their analysis lead to a better understanding of clustering…

Machine Learning · Statistics 2026-05-26 Sam Rosen , Jason Xu

Spectral clustering is one of the most popular algorithms for community detection in network analysis. Based on this rationale, in this paper we give the convergence rate of eigenvectors for the adjacency matrix in the $l_\infty$ norm,…

Statistics Theory · Mathematics 2019-06-18 Yan Liu , Zhiqiang Hou , Zhigang Yao , Zhidong Bai , Jiang Hu , Shurong Zheng

Typically, graph structures are represented by one of three different matrices: the adjacency matrix, the unnormalised and the normalised graph Laplacian matrices. The spectral (eigenvalue) properties of these different matrices are…

Methodology · Statistics 2020-01-27 J. F. Lutzeyer , A. T. Walden

Spectral clustering is a powerful method for finding structure in a dataset through the eigenvectors of a similarity matrix. It often outperforms traditional clustering algorithms such as $k$-means when the structure of the individual…

Numerical Analysis · Mathematics 2019-04-26 Paola Favati , Grazia Lotti , Ornella Menchi , Francesco Romani

While several papers have investigated computationally and statistically efficient methods for learning Gaussian mixtures, precise minimax bounds for their statistical performance as well as fundamental limits in high-dimensional settings…

Machine Learning · Statistics 2013-06-11 Martin Azizyan , Aarti Singh , Larry Wasserman

In this work we study statistical properties of graph-based algorithms for multi-manifold clustering (MMC). In MMC the goal is to retrieve the multi-manifold structure underlying a given Euclidean data set when this one is assumed to be…

Machine Learning · Computer Science 2022-11-14 Nicolas Garcia Trillos , Pengfei He , Chenghui Li

This study presents a novel approach utilizing cluster means to address the non-differentiability issue arising from multiple eigenvalues in eigenfrequency and bandgap optimization. By constructing symmetric functions of repeated…

Computational Engineering, Finance, and Science · Computer Science 2025-01-28 Shiyao Sun , Kapil Khandelwal

Self-supervised heterogeneous graph learning (SHGL) has shown promising potential in diverse scenarios. However, while existing SHGL methods share a similar essential with clustering approaches, they encounter two significant limitations:…

Artificial Intelligence · Computer Science 2024-12-03 Yujie Mo , Zhihe Lu , Runpeng Yu , Xiaofeng Zhu , Xinchao Wang

The recent development of spectral method has been praised for its high-order convergence in simulating complex physical problems. The combination of embedded boundary method and spectral method becomes a mainstream way to tackle…

Numerical Analysis · Mathematics 2018-03-08 Po-Yi Wu , Cheng-Hong Robert Kao , Tony Wen-Hann Sheu

The high dimensionality of hyperspectral images often results in the degradation of clustering performance. Due to the powerful ability of deep feature extraction and non-linear feature representation, the clustering algorithm based on deep…

Machine Learning · Computer Science 2019-04-02 Jinguang Sun , Wanli Wang , Xian Wei , Li Fang , Xiaoliang Tang , Yusheng Xu , Hui Yu , Wei Yao

Spectral clustering is a popular clustering method. It first maps data into the spectral embedding space and then uses Kmeans to find clusters. However, the two decoupled steps prohibit joint optimization for the optimal solution. In…

Machine Learning · Computer Science 2024-12-17 Wengang Guo , Wei Ye

We propose a novel approach to the problem of multilevel clustering, which aims to simultaneously partition data in each group and discover grouping patterns among groups in a potentially large hierarchically structured corpus of data. Our…

Machine Learning · Statistics 2017-06-14 Nhat Ho , XuanLong Nguyen , Mikhail Yurochkin , Hung Hai Bui , Viet Huynh , Dinh Phung

How does coarsening affect the spectrum of a general graph? We provide conditions such that the principal eigenvalues and eigenspaces of a coarsened and original graph Laplacian matrices are close. The achieved approximation is shown to…

Machine Learning · Computer Science 2018-02-22 Andreas Loukas , Pierre Vandergheynst

We study the problem of applying spectral clustering to cluster multi-scale data, which is data whose clusters are of various sizes and densities. Traditional spectral clustering techniques discover clusters by processing a similarity…

Machine Learning · Computer Science 2020-06-09 Xiang Li , Ben Kao , Caihua Shan , Dawei Yin , Martin Ester

Investigating the performance of different methods is a fundamental problem in graph partitioning. In this paper, we estimate the so-called detectability threshold for the spectral method with both unnormalized and normalized Laplacians in…

Social and Information Networks · Computer Science 2015-06-10 Tatsuro Kawamoto , Yoshiyuki Kabashima