English
Related papers

Related papers: Diffusion Maps, Spectral Clustering and Eigenfunct…

200 papers

We introduce a novel diffusion-based spectral algorithm to tackle regression analysis on high-dimensional data, particularly data embedded within lower-dimensional manifolds. Traditional spectral algorithms often fall short in such…

Machine Learning · Statistics 2024-10-21 Weichun Xia , Jiaxin Jiang , Lei Shi

In this paper, we introduce an algorithm for performing spectral clustering efficiently. Spectral clustering is a powerful clustering algorithm that suffers from high computational complexity, due to eigen decomposition. In this work, we…

Machine Learning · Computer Science 2017-04-11 Ershad Banijamali , Ali Ghodsi

Spectral clustering is one of the most important algorithms in data mining and machine intelligence; however, its computational complexity limits its application to truly large scale data analysis. The computational bottleneck in spectral…

Machine Learning · Computer Science 2015-05-13 Christos Boutsidis , Alex Gittens , Prabhanjan Kambadur

We build upon recent advances in graph signal processing to propose a faster spectral clustering algorithm. Indeed, classical spectral clustering is based on the computation of the first k eigenvectors of the similarity matrix' Laplacian,…

Social and Information Networks · Computer Science 2015-09-30 Nicolas Tremblay , Gilles Puy , Pierre Borgnat , Remi Gribonval , Pierre Vandergheynst

We propose a novel distributed algorithm to cluster graphs. The algorithm recovers the solution obtained from spectral clustering without the need for expensive eigenvalue/vector computations. We prove that, by propagating waves through the…

Discrete Mathematics · Computer Science 2015-03-13 Tuhin Sahai , Alberto Speranzon , Andrzej Banaszuk

We study the task of clustering in directed networks. We show that using the eigenvalue/eigenvector decomposition of the adjacency matrix is simpler than all common methods which are based on a combination of data regularization and SVD…

Machine Learning · Computer Science 2021-02-08 Simon Coste , Ludovic Stephan

Spectral clustering has become a popular technique due to its high performance in many contexts. It comprises three main steps: create a similarity graph between N objects to cluster, compute the first k eigenvectors of its Laplacian matrix…

Data Structures and Algorithms · Computer Science 2016-05-24 Nicolas Tremblay , Gilles Puy , Remi Gribonval , Pierre Vandergheynst

We present multiscale graph-based reduction algorithms for upscaling heterogeneous and anisotropic diffusion problems. The proposed coarsening approaches begin by constructing a partitioning of the computational domain into a set of…

Numerical Analysis · Mathematics 2025-10-14 Maria Vasilyeva , James Brannick , Ben S. Southworth

In this paper, we apply the ideas of the matrix column based diffusion approach to define a new eigenvector computation algorithm of a stationary probability of a Markov chain.

Numerical Analysis · Computer Science 2012-06-15 Dohy Hong , Philippe Jacquet

Spectral clustering is a fast and popular algorithm for finding clusters in networks. Recently, Chaudhuri et al. (2012) and Amini et al.(2012) proposed inspired variations on the algorithm that artificially inflate the node degrees for…

Machine Learning · Statistics 2013-09-18 Tai Qin , Karl Rohe

We study spectral properties of the Fokker-Planck operator that describes particles diffusing in a quenched random velocity field. This random operator is non-Hermitian and has eigenvalues occupying a finite area in the complex plane. We…

Disordered Systems and Neural Networks · Physics 2011-08-05 J. T. Chalker , Z. Jane Wang

The existing research on spectral algorithms, applied within a Reproducing Kernel Hilbert Space (RKHS), has primarily focused on general kernel functions, often neglecting the inherent structure of the input feature space. Our paper…

Machine Learning · Statistics 2024-03-08 Weichun Xia , Lei Shi

In this paper, we study the spectrum and the eigenvectors of radial kernels for mixtures of distributions in $\mathbb{R}^n$. Our approach focuses on high dimensions and relies solely on the concentration properties of the components in the…

Machine Learning · Statistics 2020-01-07 David Cohen-Steiner , Alba Chiara de Vitis

How does coarsening affect the spectrum of a general graph? We provide conditions such that the principal eigenvalues and eigenspaces of a coarsened and original graph Laplacian matrices are close. The achieved approximation is shown to…

Machine Learning · Computer Science 2018-02-22 Andreas Loukas , Pierre Vandergheynst

Graph-Laplacians and their spectral embeddings play an important role in multiple areas of machine learning. This paper is focused on graph-Laplacian dimension reduction for the spectral clustering of data as a primary application. Spectral…

Machine Learning · Computer Science 2021-09-08 Vladimir Druskin , Alexander V. Mamonov , Mikhail Zaslavsky

This article proposes a first analysis of kernel spectral clustering methods in the regime where the dimension $p$ of the data vectors to be clustered and their number $n$ grow large at the same rate. We demonstrate, under a $k$-class…

Statistics Theory · Mathematics 2016-04-22 Romain Couillet , Florent Benaych-Georges

The Diffusion Map is a nonlinear dimensionality reduction technique used to analyze high-dimensional data, with recent applications extending to datasets from the social sciences. Previous research has given little attention to how the…

Physics and Society · Physics 2025-08-28 Sönke Beier

In this paper, we extend the diffusion maps algorithm on a family of heat kernels that are either local (having exponential decay) or nonlocal (having polynomial decay), arising in various applications. For example, these kernels have been…

Classical Analysis and ODEs · Mathematics 2020-07-28 Harbir Antil , Tyrus Berry , John Harlim

Clustering algorithms partition a dataset into groups of similar points. The primary contribution of this article is the Multiscale Spatially-Regularized Diffusion Learning (M-SRDL) clustering algorithm, which uses spatially-regularized…

Machine Learning · Computer Science 2022-04-08 Sam L. Polk , James M. Murphy

The smallest eigenvalues and the associated eigenvectors (i.e., eigenpairs) of a graph Laplacian matrix have been widely used for spectral clustering and community detection. However, in real-life applications the number of clusters or…

Social and Information Networks · Computer Science 2018-01-24 Pin-Yu Chen , Baichuan Zhang , Mohammad Al Hasan , Alfred O. Hero