English
Related papers

Related papers: Improved convergence rate of kNN graph Laplacians:…

200 papers

Kernelized Gram matrix $W$ constructed from data points $\{x_i\}_{i=1}^N$ as $W_{ij}= k_0( \frac{ \| x_i - x_j \|^2} {\sigma^2} )$ is widely used in graph-based geometric data analysis and unsupervised learning. An important question is how…

Statistics Theory · Mathematics 2021-02-11 Xiuyuan Cheng , Hau-Tieng Wu

This work studies the spectral convergence of graph Laplacian to the Laplace-Beltrami operator when the graph affinity matrix is constructed from $N$ random samples on a $d$-dimensional manifold embedded in a possibly high dimensional…

Statistics Theory · Mathematics 2025-09-16 Xiuyuan Cheng , Nan Wu

The k-nearest neighbors (kNN) algorithm is a cornerstone of non-parametric classification in artificial intelligence, yet its deployment in large-scale applications is persistently constrained by the computational trade-off between…

Machine Learning · Computer Science 2026-01-26 Jiaye Li , Gang Chen , Hang Xu , Shichao Zhang

A Shared Nearest Neighbor (SNN) graph is a type of graph construction using shared nearest neighbor information, which is a secondary similarity measure based on the rankings induced by a primary $k$-nearest neighbor ($k$-NN) measure. SNN…

Machine Learning · Statistics 2023-04-04 A. Martina Neuman

In this paper we improve the spectral convergence rates for graph-based approximations of Laplace-Beltrami operators constructed from random data. We utilize regularity of the continuum eigenfunctions and strong pointwise consistency…

Probability · Mathematics 2020-06-30 Jeff Calder , Nicolas Garcia Trillos

Bi-stochastic normalization provides an alternative normalization of graph Laplacians in graph-based data analysis and can be computed efficiently by Sinkhorn-Knopp (SK) iterations. This paper proves the convergence of bi-stochastically…

Statistics Theory · Mathematics 2024-07-19 Xiuyuan Cheng , Boris Landa

Graph neural networks (GNNs) have demonstrated great success in representation learning for graph-structured data. The layer-wise graph convolution in GNNs is shown to be powerful at capturing graph topology. During this process, GNNs are…

Machine Learning · Computer Science 2021-12-10 Mingxuan Ju , Shifu Hou , Yujie Fan , Jianan Zhao , Liang Zhao , Yanfang Ye

Existing approaches to analyzing the asymptotics of graph Laplacians typically assume a well-behaved kernel function with smoothness assumptions. We remove the smoothness assumption and generalize the analysis of graph Laplacians to include…

Machine Learning · Statistics 2011-01-31 Daniel Ting , Ling Huang , Michael Jordan

For data sampled from an arbitrary density on a manifold embedded in Euclidean space, the Continuous k-Nearest Neighbors (CkNN) graph construction is introduced. It is shown that CkNN is geometrically consistent in the sense that under…

Classical Analysis and ODEs · Mathematics 2019-02-26 Tyrus Berry , Timothy Sauer

Motivated by the problem of understanding theoretical bounds for the performance of the Belkin-Niyogi Laplacian eigencoordinate approach to dimension reduction in machine learning problems, we consider the convergence of random graph…

Functional Analysis · Mathematics 2025-03-10 Bernard Akwei , Luke Rogers , Alexander Teplyaev

This short note aims at (re)proving that the symmetrically normalized graph Laplacian $L=\Id - D^{-1/2}WD^{-1/2}$ (from a graph defined from a Gaussian weighting kernel on a sampled smooth manifold) converges towards the continuous Manifold…

Differential Geometry · Mathematics 2011-01-10 Laurent Jacques

Given a sample from a probability measure with support on a submanifold in Euclidean space one can construct a neighborhood graph which can be seen as an approximation of the submanifold. The graph Laplacian of such a graph is used in…

Statistics Theory · Mathematics 2007-06-27 Matthias Hein , Jean-Yves Audibert , Ulrike von Luxburg

Nearest neighbour graphs are widely used to capture the geometry or topology of a dataset. One of the most common strategies to construct such a graph is based on selecting a fixed number k of nearest neighbours (kNN) for each point.…

Machine Learning · Statistics 2022-08-02 Tetsuya Matsumoto , Stephen Zhang , Geoffrey Schiebinger

$k$ Nearest Neighbors ($k$NN) is one of the most widely used supervised learning algorithms to classify Gaussian distributed data, but it does not achieve good results when it is applied to nonlinear manifold distributed data, especially…

Machine Learning · Computer Science 2016-06-06 Enmei Tu , Yaqian Zhang , Lin Zhu , Jie Yang , Nikola Kasabov

In graph motivated learning, label propagation largely depends on data affinity represented as edges between connected data points. The affinity assignment implicitly assumes even distribution of data on the manifold. This assumption may…

Machine Learning · Computer Science 2021-01-01 Abhishek , Shekhar Verma

In this paper, we consider the weighted graph matching problem with partially disclosed correspondences between a number of anchor nodes. Our construction exploits recently introduced node signatures based on graph Laplacians, namely the…

Computer Vision and Pattern Recognition · Computer Science 2018-04-12 Nan Hu , Raif M. Rustamov , Leonidas Guibas

We consider graph diffusion processes constructed from finite i.i.d. samples drawn from an unknown manifold embedded in ambient Euclidean space, where the graph affinity is defined by an ambient Gaussian kernel matrix. We show that the…

Machine Learning · Statistics 2026-05-26 Xiuyuan Cheng , Nan Wu

In this paper, we propose a method, based on graph signal processing, to optimize the choice of $k$ in $k$-nearest neighbor graphs ($k$NNGs). $k$NN is one of the most popular approaches and is widely used in machine learning and signal…

Machine Learning · Computer Science 2024-01-17 Asuka Tamaru , Junya Hara , Hiroshi Higashi , Yuichi Tanaka , Antonio Ortega

In the $k$-nearest neighborhood model ($k$-NN), we are given a set of points $P$, and we shall answer queries $q$ by returning the $k$ nearest neighbors of $q$ in $P$ according to some metric. This concept is crucial in many areas of data…

Machine Learning · Computer Science 2018-12-03 Hendrik Fichtenberger , Dennis Rohde

We study the discrete-to-continuum consistency of the training of shallow graph convolutional neural networks (GCNNs) on proximity graphs of sampled point clouds under a manifold assumption. Graph convolution is defined spectrally via the…

Machine Learning · Statistics 2026-01-12 Johanna Tengler , Christoph Brune , José A. Iglesias
‹ Prev 1 2 3 10 Next ›