English
Related papers

Related papers: Mini-Batch Spectral Clustering

200 papers

In this paper, we propose a scalable algorithm for spectral embedding. The latter is a standard tool for graph clustering. However, its computational bottleneck is the eigendecomposition of the graph Laplacian matrix, which prevents its…

Machine Learning · Computer Science 2019-04-12 Mireille El Gheche , Giovanni Chierchia , Pascal Frossard

In recent years, spectral clustering has become one of the most popular modern clustering algorithms. It is simple to implement, can be solved efficiently by standard linear algebra software, and very often outperforms traditional…

Data Structures and Algorithms · Computer Science 2007-11-02 Ulrike von Luxburg

Clustering of data sets is a standard problem in many areas of science and engineering. The method of spectral clustering is based on embedding the data set using a kernel function, and using the top eigenvectors of the normalized Laplacian…

Statistics Theory · Mathematics 2015-04-08 Geoffrey Schiebinger , Martin J. Wainwright , Bin Yu

In this paper we study variants of the widely used spectral clustering that partitions a graph into k clusters by (1) embedding the vertices of a graph into a low-dimensional space using the bottom eigenvectors of the Laplacian matrix, and…

Data Structures and Algorithms · Computer Science 2017-02-01 Richard Peng , He Sun , Luca Zanetti

Graph-Laplacians and their spectral embeddings play an important role in multiple areas of machine learning. This paper is focused on graph-Laplacian dimension reduction for the spectral clustering of data as a primary application. Spectral…

Machine Learning · Computer Science 2021-09-08 Vladimir Druskin , Alexander V. Mamonov , Mikhail Zaslavsky

Constrained clustering has been well-studied for algorithms such as $K$-means and hierarchical clustering. However, how to satisfy many constraints in these algorithmic settings has been shown to be intractable. One alternative to encode…

Machine Learning · Computer Science 2012-09-24 Xiang Wang , Buyue Qian , Ian Davidson

In spectral clustering, one defines a similarity matrix for a collection of data points, transforms the matrix to get the Laplacian matrix, finds the eigenvectors of the Laplacian matrix, and obtains a partition of the data using the…

Machine Learning · Computer Science 2012-10-19 Leonard K. M. Poon , April H. Liu , Tengfei Liu , Nevin Lianwen Zhang

Multi-view spectral clustering can effectively reveal the intrinsic cluster structure among data by performing clustering on the learned optimal embedding across views. Though demonstrating promising performance in various applications,…

Machine Learning · Computer Science 2020-09-01 Weixuan Liang , Sihang Zhou , Jian Xiong , Xinwang Liu , Siwei Wang , En Zhu , Zhiping Cai , Xin Xu

This article considers spectral community detection in the regime of sparse networks with heterogeneous degree distributions, for which we devise an algorithm to efficiently retrieve communities. Specifically, we demonstrate that a…

Machine Learning · Statistics 2021-10-12 Lorenzo Dall'Amico , Romain Couillet , Nicolas Tremblay

The smallest eigenvalues and the associated eigenvectors (i.e., eigenpairs) of a graph Laplacian matrix have been widely used for spectral clustering and community detection. However, in real-life applications the number of clusters or…

Social and Information Networks · Computer Science 2018-01-24 Pin-Yu Chen , Baichuan Zhang , Mohammad Al Hasan , Alfred O. Hero

Clustering short text embeddings is a foundational task in natural language processing, yet remains challenging due to the need to specify the number of clusters in advance. We introduce a scalable spectral method that estimates the number…

Machine Learning · Computer Science 2025-11-26 Nikita Neveditsin , Pawan Lingras , Vijay Mago

Spectral clustering is a standard approach to label nodes on a graph by studying the (largest or lowest) eigenvalues of a symmetric real matrix such as e.g. the adjacency or the Laplacian. Recently, it has been argued that using instead a…

Disordered Systems and Neural Networks · Physics 2015-04-30 Alaa Saade , Florent Krzakala , Lenka Zdeborová

Spectral clustering has found extensive use in many areas. Most traditional spectral clustering algorithms work in three separate steps: similarity graph construction; continuous labels learning; discretizing the learned labels by k-means…

Machine Learning · Computer Science 2017-11-15 Zhao Kang , Chong Peng , Qiang Cheng , Zenglin Xu

Spectral clustering has become one of the most popular algorithms in data clustering and community detection. We study the performance of classical two-step spectral clustering via the graph Laplacian to learn the stochastic block model.…

Machine Learning · Statistics 2020-04-22 Shaofeng Deng , Shuyang Ling , Thomas Strohmer

In this paper, we introduce an algorithm for performing spectral clustering efficiently. Spectral clustering is a powerful clustering algorithm that suffers from high computational complexity, due to eigen decomposition. In this work, we…

Machine Learning · Computer Science 2017-04-11 Ershad Banijamali , Ali Ghodsi

Spectral clustering is a popular and effective algorithm designed to find $k$ clusters in a graph $G$. In the classical spectral clustering algorithm, the vertices of $G$ are embedded into $\mathbb{R}^k$ using $k$ eigenvectors of the graph…

Data Structures and Algorithms · Computer Science 2023-10-18 Peter Macgregor

Spectral clustering is a popular method for effectively clustering nonlinearly separable data. However, computational limitations, memory requirements, and the inability to perform incremental learning challenge its widespread application.…

Machine Learning · Computer Science 2023-11-15 Jo-Chun Chen , Hung-Hsuan Chen

Spectral clustering is a broad class of clustering procedures in which an intractable combinatorial optimization formulation of clustering is "relaxed" into a tractable eigenvector problem, and in which the relaxed solution is subsequently…

Methodology · Statistics 2011-02-21 Zhihua Zhang , Michael I. Jordan

One of the fundamental problems in network analysis is detecting community structure in multi-layer networks, of which each layer represents one type of edge information among the nodes. We propose integrative spectral clustering approaches…

Machine Learning · Statistics 2022-10-07 Sihan Huang , Haolei Weng , Yang Feng

We analyze the performance of spectral clustering for community extraction in stochastic block models. We show that, under mild conditions, spectral clustering applied to the adjacency matrix of the network can consistently recover hidden…

Statistics Theory · Mathematics 2014-12-31 Jing Lei , Alessandro Rinaldo