English
Related papers

Related papers: Eigenvalue-based Incremental Spectral Clustering

200 papers

Many state-of-the-art subspace clustering methods follow a two-step process by first constructing an affinity matrix between data points and then applying spectral clustering to this affinity. Most of the research into these methods focuses…

Machine Learning · Computer Science 2021-04-21 Derek Lim , René Vidal , Benjamin D. Haeffele

Spectral clustering techniques are valuable tools in signal processing and machine learning for partitioning complex data sets. The effectiveness of spectral clustering stems from constructing a non-linear embedding based on creating a…

Machine Learning · Computer Science 2021-02-02 Farhad Pourkamali-Anaraki

Spectral clustering is one of the most popular clustering methods for finding clusters in a graph, which has found many applications in data mining. However, the input graph in those applications may have many missing edges due to error in…

Data Structures and Algorithms · Computer Science 2020-06-09 Pan Peng , Yuichi Yoshida

Irregular features disrupt the desired classification. In this paper, we consider aggressively modifying scales of features in the original space according to the label information to form well-separated clusters in low-dimensional space.…

Machine Learning · Computer Science 2019-10-17 Momo Matsuda , Keiichi Morikuni , Akira Imakura , Xiucai Ye , Tetsuya Sakurai

This paper introduces a simple variant of the power method. It is shown analytically and numerically to accelerate convergence to the dominant eigenvalue/eigenvector pair; and, it is particularly effective for problems featuring a small…

Numerical Analysis · Mathematics 2020-09-01 Nilima Nigam , Sara Pollock

Spectral clustering is a powerful method for finding structure in a dataset through the eigenvectors of a similarity matrix. It often outperforms traditional clustering algorithms such as $k$-means when the structure of the individual…

Numerical Analysis · Mathematics 2019-04-26 Paola Favati , Grazia Lotti , Ornella Menchi , Francesco Romani

Spectral clustering is a popular clustering method. It first maps data into the spectral embedding space and then uses Kmeans to find clusters. However, the two decoupled steps prohibit joint optimization for the optimal solution. In…

Machine Learning · Computer Science 2024-12-17 Wengang Guo , Wei Ye

The performance of spectral clustering heavily relies on the quality of affinity matrix. A variety of affinity-matrix-construction (AMC) methods have been proposed but they have hyperparameters to determine beforehand, which requires strong…

Machine Learning · Computer Science 2023-02-07 Jicong Fan , Yiheng Tu , Zhao Zhang , Mingbo Zhao , Haijun Zhang

We develop a distributed Block Chebyshev-Davidson algorithm to solve large-scale leading eigenvalue problems for spectral analysis in spectral clustering. First, the efficiency of the Chebyshev-Davidson algorithm relies on the prior…

Machine Learning · Computer Science 2024-01-08 Qiyuan Pang , Haizhao Yang

Multi-view spectral clustering can effectively reveal the intrinsic cluster structure among data by performing clustering on the learned optimal embedding across views. Though demonstrating promising performance in various applications,…

Machine Learning · Computer Science 2020-09-01 Weixuan Liang , Sihang Zhou , Jian Xiong , Xinwang Liu , Siwei Wang , En Zhu , Zhiping Cai , Xin Xu

The two-step spectral clustering method, which consists of the Laplacian eigenmap and a rounding step, is a widely used method for graph partitioning. It can be seen as a natural relaxation to the NP-hard minimum ratio cut problem. In this…

Machine Learning · Statistics 2020-07-14 March Boedihardjo , Shaofeng Deng , Thomas Strohmer

Spectral clustering is one of the most effective clustering approaches that capture hidden cluster structures in the data. However, it does not scale well to large-scale problems due to its quadratic complexity in constructing similarity…

Machine Learning · Computer Science 2019-11-26 Lingfei Wu , Pin-Yu Chen , Ian En-Hsu Yen , Fangli Xu , Yinglong Xia , Charu Aggarwal

Clustering short text embeddings is a foundational task in natural language processing, yet remains challenging due to the need to specify the number of clusters in advance. We introduce a scalable spectral method that estimates the number…

Machine Learning · Computer Science 2025-11-26 Nikita Neveditsin , Pawan Lingras , Vijay Mago

This paper focuses on obtaining clustering information about a distribution from its i.i.d. samples. We develop theoretical results to understand and use clustering information contained in the eigenvectors of data adjacency matrices based…

Machine Learning · Statistics 2009-11-20 Tao Shi , Mikhail Belkin , Bin Yu

Spectral clustering is discussed from many perspectives, by extending it to rectangular arrays and discrepancy minimization too. Near optimal clusters are obtained with singular value decomposition and with the weighted $k$-means algorithm.…

Combinatorics · Mathematics 2022-01-06 Marianna Bolla , Vilas Winstein , Tao You , Frank Seidl , Fatma Abdelkhalek

Constrained clustering has been well-studied for algorithms such as $K$-means and hierarchical clustering. However, how to satisfy many constraints in these algorithmic settings has been shown to be intractable. One alternative to encode…

Machine Learning · Computer Science 2012-09-24 Xiang Wang , Buyue Qian , Ian Davidson

Large graphs commonly appear in social networks, knowledge graphs, recommender systems, life sciences, and decision making problems. Summarizing large graphs by their high level properties is helpful in solving problems in these settings.…

Machine Learning · Statistics 2022-08-01 Elise van der Pol , Ian Gemp , Yoram Bachrach , Richard Everett

Laplacian Eigenvectors of the graph constructed from a data set are used in many spectral manifold learning algorithms such as diffusion maps and spectral clustering. Given a graph constructed from a random sample of a $d$-dimensional…

Machine Learning · Statistics 2015-10-29 Xu Wang

Clustering data objects into homogeneous groups is one of the most important tasks in data mining. Spectral clustering is arguably one of the most important algorithms for clustering, as it is appealing for its theoretical soundness and is…

Machine Learning · Statistics 2024-03-12 Dylan Soemitro , Jeova Farias Sales Rocha Neto

Spectral clustering is a technique that clusters elements using the top few eigenvectors of their (possibly normalized) similarity matrix. The quality of spectral clustering is closely tied to the convergence properties of these principal…

Machine Learning · Statistics 2017-09-05 Purnamrita Sarkar , Peter J. Bickel