English
Related papers

Related papers: Spectral Clustering via the Power Method -- Provab…

200 papers

Clustering is one of the most crucial problems in unsupervised learning, and the well-known $k$-means clustering algorithm has been shown to be implementable on a quantum computer with a significant speedup. However, many clustering…

Quantum Physics · Physics 2023-01-03 Qingyu Li , Yuhan Huang , Shan Jin , Xiaokai Hou , Xiaoting Wang

The smallest eigenvalues and the associated eigenvectors (i.e., eigenpairs) of a graph Laplacian matrix have been widely used for spectral clustering and community detection. However, in real-life applications the number of clusters or…

Social and Information Networks · Computer Science 2018-01-24 Pin-Yu Chen , Baichuan Zhang , Mohammad Al Hasan , Alfred O. Hero

Consistency is a key property of all statistical procedures analyzing randomly sampled data. Surprisingly, despite decades of work, little is known about consistency of most clustering algorithms. In this paper we investigate consistency of…

Statistics Theory · Mathematics 2008-12-18 Ulrike von Luxburg , Mikhail Belkin , Olivier Bousquet

Spectral clustering has been widely used for community detection in network sciences. While its empirical successes are well-documented, a clear theoretical understanding, particularly for sparse networks where degrees are much smaller than…

Statistics Theory · Mathematics 2024-05-13 Anderson Ye Zhang

Spectral clustering is a technique that clusters elements using the top few eigenvectors of their (possibly normalized) similarity matrix. The quality of spectral clustering is closely tied to the convergence properties of these principal…

Machine Learning · Statistics 2017-09-05 Purnamrita Sarkar , Peter J. Bickel

Our previous experiments demonstrated that subsets collections of (short) documents (with several hundred entries) share a common normalized in some way eigenvalue spectrum of combinatorial Laplacian. Based on this insight, we propose a…

Machine Learning · Computer Science 2023-08-23 Mieczysław A. Kłopotek , Bartłmiej Starosta , Sławomir T. Wierzchoń

The two-step spectral clustering method, which consists of the Laplacian eigenmap and a rounding step, is a widely used method for graph partitioning. It can be seen as a natural relaxation to the NP-hard minimum ratio cut problem. In this…

Machine Learning · Statistics 2020-07-14 March Boedihardjo , Shaofeng Deng , Thomas Strohmer

Spectral clustering is one of the most effective clustering approaches that capture hidden cluster structures in the data. However, it does not scale well to large-scale problems due to its quadratic complexity in constructing similarity…

Machine Learning · Computer Science 2019-11-26 Lingfei Wu , Pin-Yu Chen , Ian En-Hsu Yen , Fangli Xu , Yinglong Xia , Charu Aggarwal

Spectral clustering is a popular method for effectively clustering nonlinearly separable data. However, computational limitations, memory requirements, and the inability to perform incremental learning challenge its widespread application.…

Machine Learning · Computer Science 2023-11-15 Jo-Chun Chen , Hung-Hsuan Chen

Spectral clustering techniques are valuable tools in signal processing and machine learning for partitioning complex data sets. The effectiveness of spectral clustering stems from constructing a non-linear embedding based on creating a…

Machine Learning · Computer Science 2021-02-02 Farhad Pourkamali-Anaraki

Spectral clustering requires the time-consuming decomposition of the Laplacian matrix of the similarity graph, thus limiting its applicability to large datasets. To improve the efficiency of spectral clustering, a top-down approach was…

Machine Learning · Computer Science 2024-12-19 Zhichang Xu , Zhiguo Long , Hua Meng

Spectral clustering is a widely studied problem, yet its complexity is prohibitive for dynamic graphs of even modest size. We claim that it is possible to reuse information of past cluster assignments to expedite computation. Our approach…

Machine Learning · Statistics 2017-06-13 Lionel Martin , Andreas Loukas , Pierre Vandergheynst

Spectral clustering is a popular clustering method. It first maps data into the spectral embedding space and then uses Kmeans to find clusters. However, the two decoupled steps prohibit joint optimization for the optimal solution. In…

Machine Learning · Computer Science 2024-12-17 Wengang Guo , Wei Ye

Spectral clustering has found extensive use in many areas. Most traditional spectral clustering algorithms work in three separate steps: similarity graph construction; continuous labels learning; discretizing the learned labels by k-means…

Machine Learning · Computer Science 2017-11-15 Zhao Kang , Chong Peng , Qiang Cheng , Zenglin Xu

Fairness of decision-making algorithms is an increasingly important issue. In this paper, we focus on spectral clustering with group fairness constraints, where every demographic group is represented in each cluster proportionally as in the…

Machine Learning · Computer Science 2025-06-11 Francesco Tonin , Alex Lambert , Johan A. K. Suykens , Volkan Cevher

We present a principled spectral approach to the well-studied constrained clustering problem. It reduces clustering to a generalized eigenvalue problem on Laplacians. The method works in nearly-linear time and provides concrete guarantees…

Social and Information Networks · Computer Science 2016-01-20 Mihai Cucuringu , Ioannis Koutis , Sanjay Chawla

In this paper we prove the strong consistency of several methods based on the spectral clustering techniques that are widely used to study the community detection problem in stochastic block models (SBMs). We show that under some weak…

Methodology · Statistics 2019-05-16 Liangjun Su , Wuyi Wang , Yichong Zhang

Clustering in image analysis is a central technique that allows to classify elements of an image. We describe a simple clustering technique that uses the method of similarity matrices. We expand upon recent results in spectral analysis for…

Statistics Theory · Mathematics 2022-03-23 Denis Gaidashev , Ralf Pihlström , Martin Ryner

Spectral clustering is a popular method for community detection in network graphs: starting from a matrix representation of the graph, the nodes are clustered on a low dimensional projection obtained from a truncated spectral decomposition…

Machine Learning · Statistics 2022-08-10 Francesco Sanna Passino , Nicholas A. Heard , Patrick Rubin-Delanchy

A basic problem in spectral clustering is the following. If a solution obtained from the spectral relaxation is close to an integral solution, is it possible to find this integral solution even though they might be in completely different…

Data Structures and Algorithms · Computer Science 2015-10-20 Ali Kemal Sinop