English
Related papers

Related papers: Kernelized Diffusion maps

200 papers

Laplacian Eigenvectors of the graph constructed from a data set are used in many spectral manifold learning algorithms such as diffusion maps and spectral clustering. Given a graph constructed from a random sample of a $d$-dimensional…

Machine Learning · Statistics 2015-10-29 Xu Wang

We study kernel functions, and associated reproducing kernel Hilbert spaces $\mathscr{H}$ over infinite, discrete and countable sets $V$. Numerical analysis builds discrete models (e.g., finite element) for the purpose of finding…

Functional Analysis · Mathematics 2015-08-17 Palle Jorgensen , Feng Tian

A central problem in data analysis is the low dimensional representation of high dimensional data, and the concise description of its underlying geometry and density. In the analysis of large scale simulations of complex dynamical systems,…

Numerical Analysis · Mathematics 2007-05-23 Boaz Nadler , Stephane Lafon , Ronald R. Coifman , Ioannis G. Kevrekidis

Spectral clustering is widely used to partition graphs into distinct modules or communities. Existing methods for spectral clustering use the eigenvalues and eigenvectors of the graph Laplacian, an operator that is closely associated with…

Social and Information Networks · Computer Science 2015-06-15 Laura M. Smith , Kristina Lerman , Cristina Garcia-Cardona , Allon G. Percus , Rumi Ghosh

Graph-Laplacians and their spectral embeddings play an important role in multiple areas of machine learning. This paper is focused on graph-Laplacian dimension reduction for the spectral clustering of data as a primary application. Spectral…

Machine Learning · Computer Science 2021-09-08 Vladimir Druskin , Alexander V. Mamonov , Mikhail Zaslavsky

Diffusion Maps framework is a kernel based method for manifold learning and data analysis that defines diffusion similarities by imposing a Markovian process on the given dataset. Analysis by this process uncovers the intrinsic geometric…

Machine Learning · Statistics 2015-11-20 Moshe Salhov , Amit Bermanis , Guy Wolf , Amir Averbuch

Spectral clustering is a popular algorithm that clusters points using the eigenvalues and eigenvectors of Laplacian matrices derived from the data. For years, spectral clustering has been working mysteriously. This paper explains spectral…

Machine Learning · Statistics 2021-03-02 T Shen

We present multiscale graph-based reduction algorithms for upscaling heterogeneous and anisotropic diffusion problems. The proposed coarsening approaches begin by constructing a partitioning of the computational domain into a set of…

Numerical Analysis · Mathematics 2025-10-14 Maria Vasilyeva , James Brannick , Ben S. Southworth

Two ubiquitous aspects of large-scale data analysis are that the data often have heavy-tailed properties and that diffusion-based or spectral-based methods are often used to identify and extract structure of interest. Perhaps surprisingly,…

Machine Learning · Computer Science 2010-05-11 Michael W. Mahoney , Hariharan Narayanan

Practical applications of kernel methods often use variable bandwidth kernels, also known as self-tuning kernels, however much of the current theory of kernel based techniques is only applicable to fixed bandwidth kernels. In this paper, we…

Spectral Theory · Mathematics 2015-01-15 Tyrus Berry , John Harlim

An unsupervised learning algorithm to cluster hyperspectral image (HSI) data is proposed that exploits spatially-regularized random walks. Markov diffusions are defined on the space of HSI spectra with transitions constrained to near…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 James M. Murphy , Mauro Maggioni

Kernel spectral clustering corresponds to a weighted kernel principal component analysis problem in a constrained optimization framework. The primal formulation leads to an eigen-decomposition of a centered Laplacian matrix at the dual…

Social and Information Networks · Computer Science 2014-12-03 Raghvendra Mall , Rocco Langone , Johan A. K. Suykens

Kernel mean embeddings are a popular tool that consists in representing probability measures by their infinite-dimensional mean embeddings in a reproducing kernel Hilbert space. When the kernel is characteristic, mean embeddings can be used…

Machine Learning · Computer Science 2021-06-29 Boris Muzellec , Francis Bach , Alessandro Rudi

Hyperspectral images, which store a hundred or more spectral bands of reflectance, have become an important data source in natural and social sciences. Hyperspectral images are often generated in large quantities at a relatively coarse…

Computer Vision and Pattern Recognition · Computer Science 2022-04-29 Kangning Cui , Ruoning Li , Sam L. Polk , James M. Murphy , Robert J. Plemmons , Raymond H. Chan

Non-linear systems of differential equations have attracted the interest in fields like system biology, ecology or biochemistry, due to their flexibility and their ability to describe dynamical systems. Despite the importance of such models…

Methodology · Statistics 2014-05-09 Javier González , Ivan Vujačić , Ernst Wit

Many estimation problems in astrophysics are highly complex, with high-dimensional, non-standard data objects (e.g., images, spectra, entire distributions, etc.) that are not amenable to formal statistical analysis. To utilize such data and…

Applications · Statistics 2011-11-04 Ann B. Lee , Peter E. Freeman

Factor modeling is a powerful statistical technique that permits to capture the common dynamics in a large panel of data with a few latent variables, or factors, thus alleviating the curse of dimensionality. Despite its popularity and…

Econometrics · Economics 2021-03-03 Varlam Kutateladze

Spectral clustering has become a popular technique due to its high performance in many contexts. It comprises three main steps: create a similarity graph between N objects to cluster, compute the first k eigenvectors of its Laplacian matrix…

Data Structures and Algorithms · Computer Science 2016-05-24 Nicolas Tremblay , Gilles Puy , Remi Gribonval , Pierre Vandergheynst

This paper proposes a variant of the normalized cut algorithm for spectral clustering. Although the normalized cut algorithm applies the K-means algorithm to the eigenvectors of a normalized graph Laplacian for finding clusters, our…

Computer Vision and Pattern Recognition · Computer Science 2015-03-06 Tomohiko Mizutani

Commonly-used clustering algorithms usually find ellipsoidal, spherical or other regular-structured clusters, but are more challenged when the underlying groups lack formal structure or definition. Syncytial clustering is the name that we…

Methodology · Statistics 2020-07-30 Israel Almodóvar-Rivera , Ranjan Maitra