English
Related papers

Related papers: Expansions for Gaussian processes and Parseval fra…

200 papers

K. It\^{o} characterised in \cite{ito} zero-mean stationary Gauss Markov-processes evolving on a class of infinite-dimensional spaces. In this work we extend the work of It\^{o} in the case of Hilbert spaces: Gauss-Markov families that are…

Probability · Mathematics 2013-07-11 Ben Goldys , Szymon Peszat , Jerzy Zabczyk

We introduce a framework to derive quantitative central limit theorems in the context of non-linear approximation of Gaussian random variables taking values in a separable Hilbert space. In particular, our method provides an alternative to…

Probability · Mathematics 2020-11-25 Solesne Bourguin , Simon Campese

The correlation length-scale next to the noise variance are the most used hyperparameters for the Gaussian processes. Typically, stationary covariance functions are used, which are only dependent on the distances between input points and…

Machine Learning · Computer Science 2017-10-30 Kevin Cremanns , Dirk Roos

In this paper, we discuss vector-valued Gaussian processes for the approximation of divergence- or rotation-free functions. We establish the theory for such Gaussian processes, then link the theory to multivariate approximation theory, and…

Numerical Analysis · Mathematics 2025-11-18 Quoc Thong Le Gia , Ian Hugh Sloan , Holger Wendland

This article gives a new proof that fully connected neural networks with random weights and biases converge to Gaussian processes in the regime where the input dimension, output dimension, and depth are kept fixed, while the hidden layer…

Probability · Mathematics 2021-07-06 Boris Hanin

The Rosenblatt distribution plays a key role in the limit theorems for non-linear functionals of stationary Gaussian processes with long-range dependence. We derive new expressions for the characteristic function of the Rosenblatt…

Statistics Theory · Mathematics 2025-07-01 Nikolai N. Leonenko , Andrey Pepelyshev

Bayesian optimisation is a popular technique for hyperparameter learning but typically requires initial exploration even in cases where similar prior tasks have been solved. We propose to transfer information across tasks using learnt…

Machine Learning · Statistics 2019-05-28 Ho Chung Leon Law , Peilin Zhao , Lucian Chan , Junzhou Huang , Dino Sejdinovic

We derive Onsager-Machlup functionals for countable product measures on weighted $\ell^p$ subspaces of the sequence space $\mathbb{R}^{\mathbb{N}}$. Each measure in the product is a shifted and scaled copy of a reference probability measure…

Statistics Theory · Mathematics 2022-01-10 Birzhan Ayanbayev , Ilja Klebanov , Han Cheng Lie , T. J. Sullivan

Modern datasets across many disciplines increasingly consist of time-evolving, potentially infinite-dimensional random objects, such as dynamic functional data, which are naturally modeled in Hilbert spaces. In these settings,…

Machine Learning · Statistics 2026-05-08 Daniel López-Montero , Antonio Álvarez-López , Marcos Matabuena

Spatial processes observed in various fields, such as climate and environmental science, often occur on a large scale and demonstrate spatial nonstationarity. Fitting a Gaussian process with a nonstationary Mat\'ern covariance is…

Machine Learning · Statistics 2023-06-21 Pratik Nag , Yiping Hong , Sameh Abdulah , Ghulam A. Qadir , Marc G. Genton , Ying Sun

Deep Gaussian Processes learn probabilistic data representations for supervised learning by cascading multiple Gaussian Processes. While this model family promises flexible predictive distributions, exact inference is not tractable.…

Machine Learning · Statistics 2020-10-23 Jakob Lindinger , David Reeb , Christoph Lippert , Barbara Rakitsch

The analytic inference, e.g. predictive distribution being in closed form, may be an appealing benefit for machine learning practitioners when they treat wide neural networks as Gaussian process in Bayesian setting. The realistic widths,…

Disordered Systems and Neural Networks · Physics 2023-08-01 Chi-Ken Lu

We introduce a new approach to the spectral equivalence of Gaussian processes and fields, based on the methods of operator theory in Hilbert space. Besides several new results including identities in law of quadratic norms for integrated…

Probability · Mathematics 2021-08-17 A. I. Nazarov , Ya. Yu. Nikitin

Many applications of Gaussian random fields and Gaussian random processes are limited by the computational complexity of evaluating the probability density function, which involves inverting the relevant covariance matrix. In this work, we…

Cosmology and Nongalactic Astrophysics · Physics 2018-12-26 Theodor Bjorkmo , M. C. David Marsh

In this note we extend kernel function approximation results for neural networks with Gaussian-distributed weights to single-layer networks initialized using Haar-distributed random orthogonal matrices (with possible rescaling). This is…

Machine Learning · Computer Science 2021-04-14 James Martens

Gaussian processes (GPs) with derivatives are useful in many applications, including Bayesian optimization, implicit surface reconstruction, and terrain reconstruction. Fitting a GP to function values and derivatives at $n$ points in $d$…

Machine Learning · Computer Science 2018-10-30 David Eriksson , Kun Dong , Eric Hans Lee , David Bindel , Andrew Gordon Wilson

This paper has been withdrawn from the arXiv. It is now published by Elsevier in the Journal of Statistical Planning and Inference, under the modified title "Convergence properties of the expected improvement algorithm with fixed mean and…

Computation · Statistics 2010-06-15 Emmanuel Vazquez , Julien Bect

We study a statistical model for infinite dimensional Gaussian random variables with unknown parameters. For this model we derive linear estimators for the mean and the variance of the Gaussian distribution. Furthermore, we construct…

Statistics Theory · Mathematics 2025-11-21 Stefan Tappe

We investigate the sparsity of Wiener polynomial chaos expansions of holomorphic maps $\mathcal{G}$ on Gaussian Hilbert spaces, as arise in the coefficient-to-solution maps of linear, second order, divergence-form elliptic PDEs with…

Numerical Analysis · Mathematics 2025-05-01 Carlo Marcati , Christoph Schwab , Jakob Zech

This paper presents a new variable selection approach integrated with Gaussian process (GP) regression. We consider a sparse projection of input variables and a general stationary covariance model that depends on the Euclidean distance…

Machine Learning · Computer Science 2020-08-26 Chiwoo Park , David J. Borth , Nicholas S. Wilson , Chad N. Hunter