English
Related papers

Related papers: Robust spectral clustering with rank statistics

200 papers

In this paper, we present and analyze a simple and robust spectral algorithm for the stochastic block model with $k$ blocks, for any $k$ fixed. Our algorithm works with graphs having constant edge density, under an optimal condition on the…

Data Structures and Algorithms · Computer Science 2015-06-25 Peter Chin , Anup Rao , Van Vu

We focus on spectral clustering of unlabeled graphs and review some results on clustering methods which achieve weak or strong consistent identification in data generated by such models. We also present a new algorithm which appears to…

Statistics Theory · Mathematics 2015-08-11 Sharmodeep Bhattacharyya , Peter J. Bickel

Spectral clustering is a leading and popular technique in unsupervised data analysis. Two of its major limitations are scalability and generalization of the spectral embedding (i.e., out-of-sample-extension). In this paper we introduce a…

Machine Learning · Statistics 2024-11-06 Uri Shaham , Kelly Stanton , Henry Li , Boaz Nadler , Ronen Basri , Yuval Kluger

Spectral clustering is a novel clustering method which can detect complex shapes of data clusters. However, it requires the eigen decomposition of the graph Laplacian matrix, which is proportion to $O(n^3)$ and thus is not suitable for…

Machine Learning · Computer Science 2013-07-02 Nguyen Lu Dang Khoa , Sanjay Chawla

Samples from intimate (non-linear) mixtures are generally modeled as being drawn from a smooth manifold. Scenarios where the data contains multiple intimate mixtures with some constituent materials in common can be thought of as manifolds…

Computer Vision and Pattern Recognition · Computer Science 2017-08-15 Arun M. Saranathan , Mario Parente

We study the high-dimensional inference of a rank-one signal corrupted by sparse noise. The noise is modelled as the adjacency matrix of a weighted undirected graph with finite average connectivity in the large size limit. Using the replica…

Machine Learning · Statistics 2025-11-18 Urte Adomaityte , Gabriele Sicuro , Pierpaolo Vivo

This paper studies the statistical and computational limits of high-order clustering with planted structures. We focus on two clustering models, constant high-order clustering (CHC) and rank-one higher-order clustering (ROHC), and study the…

Statistics Theory · Mathematics 2023-10-04 Yuetian Luo , Anru R. Zhang

Multidimensional scaling is an important dimension reduction tool in statistics and machine learning. Yet few theoretical results characterizing its statistical performance exist, not to mention any in high dimensions. By considering a…

Methodology · Statistics 2022-03-30 Xiucai Ding , Qiang Sun

Spectral clustering is widely used to partition graphs into distinct modules or communities. Existing methods for spectral clustering use the eigenvalues and eigenvectors of the graph Laplacian, an operator that is closely associated with…

Social and Information Networks · Computer Science 2015-06-15 Laura M. Smith , Kristina Lerman , Cristina Garcia-Cardona , Allon G. Percus , Rumi Ghosh

This work studies the classical spectral clustering algorithm which embeds the vertices of some graph $G=(V_G, E_G)$ into $\mathbb{R}^k$ using $k$ eigenvectors of some matrix of $G$, and applies $k$-means to partition $V_G$ into $k$…

Data Structures and Algorithms · Computer Science 2022-08-04 Peter Macgregor , He Sun

We extend the latent position random graph model to the line graph of a random graph, which is formed by creating a vertex for each edge in the original random graph, and connecting each pair of edges incident to a common vertex in the…

Social and Information Networks · Computer Science 2024-02-27 Zachary Lubberts , Avanti Athreya , Youngser Park , Carey E. Priebe

Spectral clustering methods are widely used for detecting clusters in networks for community detection, while a small change on the graph Laplacian matrix could bring a dramatic improvement. In this paper, we propose a dual regularized…

Machine Learning · Statistics 2020-11-10 Huan Qing , Jingli Wang

Reconstruction based subspace clustering methods compute a self reconstruction matrix over the samples and use it for spectral clustering to obtain the final clustering result. Their success largely relies on the assumption that the…

Machine Learning · Computer Science 2012-06-22 Ruijiang Li , Bin Li , Ke Zhang , Cheng Jin , Xiangyang Xue

The Lanczos method is a fast and memory-efficient algorithm for solving large-scale symmetric eigenvalue problems. However, its rapid convergence can deteriorate significantly when computing clustered eigenvalues due to a lack of cluster…

Numerical Analysis · Mathematics 2025-07-15 Nian Shao

The extraction of clusters from a dataset which includes multiple clusters and a significant background component is a non-trivial task of practical importance. In image analysis this manifests for example in anomaly detection and target…

Machine Learning · Computer Science 2019-08-26 Xiuyuan Cheng , Gal Mishne

Spectral clustering techniques are valuable tools in signal processing and machine learning for partitioning complex data sets. The effectiveness of spectral clustering stems from constructing a non-linear embedding based on creating a…

Machine Learning · Computer Science 2021-02-02 Farhad Pourkamali-Anaraki

Community detection in the stochastic block model is one of the central problems of graph clustering. Since its introduction, many subsequent papers have made great strides in solving and understanding this model. In this setup, spectral…

Combinatorics · Mathematics 2022-11-09 Chandra Sekhar Mukherjee , Jiapeng Zhang

In recent years, spectral clustering has become a standard method for data analysis used in a broad range of applications. In this paper we propose a new class of algorithms for multiway spectral clustering based on optimization of a…

Machine Learning · Computer Science 2016-05-05 James Voss , Mikhail Belkin , Luis Rademacher

Spectral clustering is one of the most popular clustering methods. However, the high computational cost due to the involved eigen-decomposition procedure can immediately hinder its applications in large-scale tasks. In this paper we use…

Machine Learning · Computer Science 2023-01-24 Yongyu Wang

We consider community detection in Degree-Corrected Stochastic Block Models (DC-SBM). We propose a spectral clustering algorithm based on a suitably normalized adjacency matrix. We show that this algorithm consistently recovers the…

Probability · Mathematics 2017-02-09 Lennart Gulikers , Marc Lelarge , Laurent Massoulié