English
Related papers

Related papers: Sketching the Heat Kernel: Using Gaussian Processe…

200 papers

This paper introduces an approach for detecting differences in the first-order structures of spatial point patterns. The proposed approach leverages the kernel mean embedding in a novel way by introducing its approximate version tailored to…

Methodology · Statistics 2020-06-15 Raif M. Rustamov , James T. Klosowski

In this article, we prove a general and rather flexible upper bound for the heat kernel of a weighted heat operator on a closed manifold evolving by an intrinsic geometric flow. The proof is based on logarithmic Sobolev inequalities and…

Differential Geometry · Mathematics 2020-07-15 Reto Buzano , Louis Yudowitz

Gaussian processes are used in many machine learning applications that rely on uncertainty quantification. Recently, computational tools for working with these models in geometric settings, such as when inputs lie on a Riemannian manifold,…

Machine Learning · Statistics 2023-10-31 Paul Rosa , Viacheslav Borovitskiy , Alexander Terenin , Judith Rousseau

Computing a consensus object from a set of given objects is a core problem in machine learning and pattern recognition. One popular approach is to formulate it as an optimization problem using the generalized median. Previous methods like…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Andreas Nienkötter , Xiaoyi Jiang

Gaussian processes are widely employed as versatile modelling and predictive tools in spatial statistics, functional data analysis, computer modelling and diverse applications of machine learning. They have been widely studied over…

Statistics Theory · Mathematics 2023-03-28 Didong Li , Wenpin Tang , Sudipto Banerjee

Fisher's linear discriminant analysis is a classical method for classification, yet it is limited to capturing linear features only. Kernel discriminant analysis as an extension is known to successfully alleviate the limitation through a…

Machine Learning · Statistics 2022-07-29 Jiae Kim , Yoonkyung Lee , Zhiyu Liang

A reproducing kernel can define an embedding of a data point into an infinite dimensional reproducing kernel Hilbert space (RKHS). The norm in this space describes a distance, which we call the kernel distance. The random Fourier features…

Machine Learning · Computer Science 2026-03-24 Di Chen , Jeff M. Phillips

Blood flow reconstruction in the vasculature is important for many clinical applications. However, in clinical settings, the available data are often quite limited. For instance, Transcranial Doppler ultrasound (TCD) is a noninvasive…

Image and Video Processing · Electrical Eng. & Systems 2024-03-18 Shaghayegh Z. Ashtiani , Mohammad Sarabian , Kaveh Laksari , Hessam Babaee

We present a theoretically grounded Gaussian process framework that leverages neural feature maps to construct expressive kernels. We show that the learned feature map can be interpreted as an optimal low-rank approximation to a Gram matrix…

Machine Learning · Statistics 2026-05-12 Anthony Stephenson

The existing research on spectral algorithms, applied within a Reproducing Kernel Hilbert Space (RKHS), has primarily focused on general kernel functions, often neglecting the inherent structure of the input feature space. Our paper…

Machine Learning · Statistics 2024-03-08 Weichun Xia , Lei Shi

A fundamental drawback of kernel-based statistical models is their limited scalability to large data sets, which requires resorting to approximations. In this work, we focus on the popular Gaussian kernel and on techniques to linearize…

Machine Learning · Statistics 2022-04-13 Jonas Wacker , Maurizio Filippone

The high efficiency of a recently proposed method for computing with Gaussian processes relies on expanding a (translationally invariant) covariance kernel into complex exponentials, with frequencies lying on a Cartesian equispaced grid.…

Numerical Analysis · Mathematics 2023-05-19 Alex Barnett , Philip Greengard , Manas Rachh

This work discusses tensor network embeddings, which are random matrices ($S$) with tensor network structure. These embeddings have been used to perform dimensionality reduction of tensor network structured inputs $x$ and accelerate…

Numerical Analysis · Mathematics 2022-05-27 Linjian Ma , Edgar Solomonik

Kernel techniques are among the most popular and flexible approaches in data science allowing to represent probability measures without loss of information under mild conditions. The resulting mapping called mean embedding gives rise to a…

Machine Learning · Statistics 2024-11-27 Linda Chamakh , Zoltan Szabo

To accelerate kernel methods, we propose a near input sparsity time algorithm for sampling the high-dimensional feature space implicitly defined by a kernel transformation. Our main contribution is an importance sampling method for…

Data Structures and Algorithms · Computer Science 2020-07-15 David P. Woodruff , Amir Zandieh

We study query time bounds for the fundamental problem of estimating the kernel mean $\frac1{|X|}\sum_{x\in X}\mathbf{k}(x,y)$ of a query $y$ in a finite dataset $X\subset\mathbb{R}^d$ up to a prescribed additive error $\varepsilon$. The…

Data Structures and Algorithms · Computer Science 2026-05-05 Tal Wagner

Gaussian processes are rich distributions over functions, which provide a Bayesian nonparametric approach to smoothing and interpolation. We introduce simple closed form kernels that can be used with Gaussian processes to discover patterns…

Machine Learning · Statistics 2014-01-03 Andrew Gordon Wilson , Ryan Prescott Adams

We show that Gaussian process regression (GPR) allows representing multivariate functions with low-dimensional terms via kernel design. When using a kernel built with HDMR (High-dimensional model representation), one obtains a similar type…

Numerical Analysis · Mathematics 2023-01-27 Eita Sasaki , Manabu Ihara , Sergei Manzhos

In this paper, we develop a novel method for fast geodesic distance queries. The key idea is to embed the mesh into a high-dimensional space, such that the Euclidean distance in the high-dimensional space can induce the geodesic distance in…

Graphics · Computer Science 2021-09-02 Qianwei Xia , Juyong Zhang , Zheng Fang , Jin Li , Mingyue Zhang , Bailin Deng , Ying He

This article focuses on drawing computationally-efficient predictive inference from Gaussian process (GP) regressions with a large number of features when the response is conditionally independent of the features given the projection to a…

Methodology · Statistics 2024-09-27 Samuel Gailliot , Rajarshi Guhaniyogi , Roger D. Peng