English
Related papers

Related papers: Band-Limited Gaussian Processes: The Sinc Kernel

200 papers

Surrogate modeling based on Gaussian processes (GPs) has received increasing attention in the analysis of complex problems in science and engineering. Despite extensive studies on GP modeling, the developments for functional inputs are…

Methodology · Statistics 2023-01-04 Chih-Li Sung , Wenjia Wang , Fioralba Cakoni , Isaac Harris , Ying Hung

The successes of modern deep machine learning methods are founded on their ability to transform inputs across multiple layers to build good high-level representations. It is therefore critical to understand this process of representation…

Machine Learning · Statistics 2023-05-26 Adam X. Yang , Maxime Robeyns , Edward Milsom , Ben Anson , Nandi Schoots , Laurence Aitchison

Gaussian process (GP) regression provides a flexible, nonparametric framework for probabilistic modeling, yet remains computationally demanding in large-scale applications. For one-dimensional data, state space (SS) models achieve…

Machine Learning · Statistics 2025-11-07 Liang Ding , Rui Tuo , Lu Zhou

Multi-output Gaussian processes (MOGPs) are an extension of Gaussian Processes (GPs) for predicting multiple output variables (also called channels, tasks) simultaneously. In this paper we use the convolution theorem to design a new kernel…

Machine Learning · Computer Science 2021-10-11 Kai Chen , Twan van Laarhoven , Perry Groot , Jinsong Chen , Elena Marchiori

A method to perform unfolding with Gaussian processes (GPs) is presented. Using Bayesian regression, we define an estimator for the underlying truth distribution as the mode of the posterior. We show that in the case where the bin contents…

Data Analysis, Statistics and Probability · Physics 2018-11-07 Adam Bozson , Glen Cowan , Francesco Spanò

Gaussian processes (GPs) are powerful and widely used probabilistic regression models, but their effectiveness in practice is often limited by the choice of kernel function. This kernel function is typically handcrafted from a small set of…

Machine Learning · Computer Science 2026-02-13 Jihao Andreas Lin , Sebastian Ament , Louis C. Tiao , David Eriksson , Maximilian Balandat , Eytan Bakshy

In this note, we introduce a family of "power sum" kernels and the corresponding Gaussian processes on symmetric groups $\mathrm{S}_n$. Such processes are bi-invariant: the action of $\mathrm{S}_n$ on itself from both sides does not change…

Methodology · Statistics 2022-11-29 Iskander Azangulov , Viacheslav Borovitskiy , Andrei Smolensky

Gaussian Process (GP) models are often used as mathematical approximations of computationally expensive experiments. Provided that its kernel is suitably chosen and that enough data is available to obtain a reasonable fit of the simulator,…

Machine Learning · Statistics 2011-03-22 Nicolas Durrande , David Ginsbourger , Olivier Roustant

In this paper, we study random subsampling of Gaussian process regression, one of the simplest approximation baselines, from a theoretical perspective. Although subsampling discards a large part of training data, we show provable guarantees…

Machine Learning · Statistics 2019-01-29 Kohei Hayashi , Masaaki Imaizumi , Yuichi Yoshida

Despite a large corpus of recent work on scaling up Gaussian processes, a stubborn trade-off between computational speed, prediction and uncertainty quantification accuracy, and customizability persists. This is because the vast majority of…

Machine Learning · Computer Science 2025-12-09 Marcus M. Noack , Mark D. Risser , Hengrui Luo , Vardaan Tekriwal , Ronald J. Pandolfi

We show that the output of a (residual) convolutional neural network (CNN) with an appropriate prior over the weights and biases is a Gaussian process (GP) in the limit of infinitely many convolutional filters, extending similar results for…

Machine Learning · Statistics 2019-05-07 Adrià Garriga-Alonso , Carl Edward Rasmussen , Laurence Aitchison

We survey a new paradigm in signal processing known as "compressive sensing". Contrary to old practices of data acquisition and reconstruction based on the Shannon-Nyquist sampling principle, the new theory shows that it is possible to…

History and Overview · Mathematics 2009-03-13 Olga Holtz

A device called a 'Gaussian Boson Sampler' has initially been proposed as a near-term demonstration of classically intractable quantum computation. As recently shown, it can also be used to decide whether two graphs are isomorphic. Based on…

Quantum Physics · Physics 2020-03-18 Maria Schuld , Kamil Brádler , Robert Israel , Daiqin Su , Brajesh Gupt

The present paper proposes generalized Gaussian kernel adaptive filtering, where the kernel parameters are adaptive and data-driven. The Gaussian kernel is parametrized by a center vector and a symmetric positive definite (SPD) precision…

Machine Learning · Computer Science 2021-05-20 Tomoya Wada , Kosuke Fukumori , Toshihisa Tanaka , Simone Fiori

We present a new smooth, Gaussian-like kernel that allows the kernel density estimate for an angular distribution to be exactly represented by a finite number of its Fourier series coefficients. Distributions of angular quantities, such as…

Computer Vision and Pattern Recognition · Computer Science 2016-06-10 Michael T. McCann , Matthew Fickus , Jelena Kovacevic

The kernel function and its hyperparameters are the central model selection choice in a Gaussian proces (Rasmussen and Williams, 2006). Typically, the hyperparameters of the kernel are chosen by maximising the marginal likelihood, an…

Machine Learning · Statistics 2022-11-07 Vidhi Lalchand , Wessel P. Bruinsma , David R. Burt , Carl E. Rasmussen

This paper presents an approach for constrained Gaussian Process (GP) regression where we assume that a set of linear transformations of the process are bounded. It is motivated by machine learning applications for high-consequence…

Machine Learning · Statistics 2019-09-12 Christian Agrell

Gaussian processes (GPs) are widely-used tools in spatial statistics and machine learning and the formulae for the mean function and covariance kernel of a GP $T u$ that is the image of another GP $u$ under a linear transformation $T$…

Probability · Mathematics 2024-10-08 Tadashi Matsumoto , T. J. Sullivan

In the univariate setting, using the kernel spectral representation is an appealing approach for generating stationary covariance functions. However, performing the same task for multiple-output Gaussian processes is substantially more…

Machine Learning · Statistics 2021-03-15 Fergus Simpson , Alexis Boukouvalas , Vaclav Cadek , Elvijs Sarkans , Nicolas Durrande

A recurrent theme in functional analysis is the interplay between the theory of positive definite functions, and their reproducing kernels, on the one hand, and Gaussian stochastic processes, on the other. This central theme is motivated by…

Functional Analysis · Mathematics 2012-08-15 Daniel Alpay , Palle Jorgensen