English
Related papers

Related papers: Gaussian kernel quadrature at scaled Gauss-Hermite…

200 papers

Kernel based methods have shown effective performance in many remote sensing classification tasks. However their performance significantly depend on its hyper-parameters. The conventional technique to estimate the parameter comes with high…

Machine Learning · Statistics 2018-04-17 Bharath Bhushan Damodaran

We construct the multilevel correlation kernel for the rising GUE eigenvalue process starting from a fixed initial configuration $x^{(m)}$, and show that it converges on short time scales (as quickly as $\text{polylog}(m)$) to the extended…

Probability · Mathematics 2026-05-01 Zoe Himwich

We consider $\mathbb{L}_2$-approximation of elements of a Hermite space of analytic functions over $\mathbb{R}^s$. The Hermite space is a weighted reproducing kernel Hilbert space of real valued functions for which the Hermite coefficients…

Numerical Analysis · Mathematics 2015-10-09 Christian Irrgeher , Peter Kritzer , Friedrich Pillichshammer , Henryk Wozniakowski

In supervised learning using kernel methods, we often encounter a large-scale finite-sum minimization over a reproducing kernel Hilbert space (RKHS). Large-scale finite-sum problems can be solved using efficient variants of Newton method,…

Machine Learning · Computer Science 2022-06-07 Ting-Jui Chang , Shahin Shahrampour

Excellent variational approximations to Gaussian process posteriors have been developed which avoid the $\mathcal{O}\left(N^3\right)$ scaling with dataset size $N$. They reduce the computational cost to $\mathcal{O}\left(NM^2\right)$, with…

Machine Learning · Statistics 2019-09-05 David R. Burt , Carl E. Rasmussen , Mark van der Wilk

We present a novel kernel over the space of probability measures based on the dual formulation of optimal regularized transport. We propose an Hilbertian embedding of the space of probabilities using their Sinkhorn potentials, which are…

Machine Learning · Statistics 2022-10-14 François Bachoc , Louis Béthune , Alberto Gonzalez-Sanz , Jean-Michel Loubes

We study a class of Gaussian processes for which the posterior mean, for a particular choice of data, replicates a truncated Taylor expansion of any order. The data consist of derivative evaluations at the expansion point and the prior…

Machine Learning · Computer Science 2023-08-29 Toni Karvonen , Jon Cockayne , Filip Tronarp , Simo Särkkä

We consider the problem of improving kernel approximation via randomized feature maps. These maps arise as Monte Carlo approximation to integral representations of kernel functions and scale up kernel methods for larger datasets. Based on…

Machine Learning · Computer Science 2018-10-31 Marina Munkhoeva , Yermek Kapushev , Evgeny Burnaev , Ivan Oseledets

Sub-Bergman Hilbert spaces are analogues of de Branges-Rovnyak spaces in the Bergman space setting. They are reproducing kernel Hilbert spaces contractively contained in the Bergman space of the unit disk. K. Zhu analyzed sub-Bergman…

Functional Analysis · Mathematics 2018-11-16 Cheng Chu

We study embeddings and norm estimates for tensor products of weighted reproducing kernel Hilbert spaces. These results lead to a transfer principle that is directly applicable to tractability studies of multivariate problems as integration…

Numerical Analysis · Mathematics 2021-09-21 Michael Gnewuch , Mario Hefter , Aicke Hinrichs , Klaus Ritter

This paper conducts a comprehensive study of the learning curves of kernel ridge regression (KRR) under minimal assumptions. Our contributions are three-fold: 1) we analyze the role of key properties of the kernel, such as its spectral…

Machine Learning · Computer Science 2024-10-24 Tin Sum Cheng , Aurelien Lucchi , Anastasis Kratsios , David Belius

Gaussian processes regression models are an appealing machine learning method as they learn expressive non-linear models from exemplar data with minimal parameter tuning and estimate both the mean and covariance of unseen points. However,…

Machine Learning · Computer Science 2020-08-25 Vladimir Joukov , Dana Kulić

In this study, a numerical quadrature for the generalized inverse Gaussian distribution is derived from the Gauss-Hermite quadrature by exploiting its relationship with the normal distribution. The proposed quadrature is not Gaussian, but…

Computation · Statistics 2020-12-16 Jaehyuk Choi , Yeda Du , Qingshuo Song

This paper proposes a novel scheme for reduced-rank Gaussian process regression. The method is based on an approximate series expansion of the covariance function in terms of an eigenfunction expansion of the Laplace operator in a compact…

Machine Learning · Statistics 2020-06-26 Arno Solin , Simo Särkkä

There has been a recent surge of interest in modeling neural networks (NNs) as Gaussian processes. In the limit of a NN of infinite width the NN becomes equivalent to a Gaussian process. Here we demonstrate that for an ensemble of large,…

Machine Learning · Computer Science 2019-08-28 Joseph M. Antognini

Quantum kernel methods leverage a kernel function computed by embedding input information into the Hilbert space of a quantum system. However, large Hilbert spaces can hinder generalization capability, and the scalability of quantum kernels…

Quantum Physics · Physics 2024-04-16 Rodrigo Martínez-Peña , Miguel C. Soriano , Roberta Zambrini

We show that certain solutions to the linearized Einstein equation can---by the application of a particular type of linearized gauge transformation---be straightforwardly transformed into solutions of the exact Einstein equation. In cases…

General Relativity and Quantum Cosmology · Physics 2017-04-14 Abraham I. Harte , Justin Vines

Random features have been introduced to scale up kernel methods via randomization techniques. In particular, random Fourier features and orthogonal random features were used to approximate the popular Gaussian kernel. Random Fourier…

Machine Learning · Computer Science 2024-10-22 Nizar Demni , Hachem Kadri

The sample complexity of estimating or maximising an unknown function in a reproducing kernel Hilbert space is known to be linked to both the effective dimension and the information gain associated with the kernel. While the information…

Machine Learning · Statistics 2026-01-16 Hamish Flynn

Motivated by questions in quantum theory, we study Hilbert space valued Gaussian processes, and operator-valued kernels, i.e., kernels taking values in B(H) (= all bounded linear operators in a fixed Hilbert space H). We begin with a…

Functional Analysis · Mathematics 2024-08-21 Palle E. T. Jorgensen , James Tian