English
Related papers

Related papers: Gaussian Process Regression under Computational an…

200 papers

Gaussian process (GP) is a Bayesian model which provides several advantages for regression tasks in machine learning such as reliable quantitation of uncertainty and improved interpretability. Their adoption has been precluded by their…

Machine Learning · Computer Science 2023-06-26 Jonathan Parkinson , Wei Wang

In many real-world applications we are interested in approximating costly functions that are analytically unknown, e.g. complex computer codes. An emulator provides a fast approximation of such functions relying on a limited number of…

Methodology · Statistics 2020-10-02 Hossein Mohammadi , Peter Challenor , Marc Goodfellow , Daniel Williamson

This paper is concerned with the problem of how to speed up computation for Gaussian process models trained on autocorrelated data. The Gaussian process model is a powerful tool commonly used in nonlinear regression applications. Standard…

Machine Learning · Computer Science 2025-12-03 Ahmadreza Chokhachian , Matthias Katzfuss , Yu Ding

This paper presents a method for building a preconditioner for a kernel ridge regression problem, where the preconditioner is not only effective in its ability to reduce the condition number substantially, but also efficient in its…

Numerical Analysis · Mathematics 2021-04-07 Gil Shabat , Era Choshen , Dvir Ben Or , Nadav Carmel

Kernel methods on discrete domains have shown great promise for many challenging data types, for instance, biological sequence data and molecular structure data. Scalable kernel methods like Support Vector Machines may offer good predictive…

Machine Learning · Statistics 2021-05-27 Vincent Fortuin , Gideon Dresdner , Heiko Strathmann , Gunnar Rätsch

Bayesian optimization with Gaussian process as surrogate model has been successfully applied to analog circuit synthesis. In the traditional Gaussian process regression model, the kernel functions are defined explicitly. The computational…

Machine Learning · Computer Science 2019-12-03 Shuhan Zhang , Wenlong Lyu , Fan Yang , Changhao Yan , Dian Zhou , Xuan Zeng

Approximation algorithms are widely used in many engineering problems. To obtain a data set for approximation a factorial design of experiments is often used. In such case the size of the data set can be very large. Therefore, one of the…

Methodology · Statistics 2014-07-04 Mikhail Belyaev , Evgeny Burnaev , Yermek Kapushev

Gaussian Process Regression (GPR) is a Bayesian method for inferring profiles based on input data. The technique is increasing in popularity in the fusion community due to its many advantages over traditional fitting techniques including…

Methodology · Statistics 2022-09-07 Jarrod Leddy , Sandeep Madireddy , Eric Howell , Scott Kruger

Gaussian processes are used in machine learning to learn input-output mappings from observed data. Gaussian process regression is based on imposing a Gaussian process prior on the unknown regressor function and statistically conditioning it…

Machine Learning · Statistics 2019-07-16 Simo Särkkä

Gaussian process regression techniques have been used in fluid mechanics for the reconstruction of flow fields from a reduction-of-dimension perspective. A main ingredient in this setting is the construction of adapted covariance functions,…

Fluid Dynamics · Physics 2026-01-13 Adrian Padilla-Segarra , Pascal Noble , Olivier Roustant , Éric Savin

The state-of-the-art linked Gaussian process offers a way to build analytical emulators for systems of computer models. We generalize the closed form expressions for the linked Gaussian process under the squared exponential kernel to a…

Methodology · Statistics 2021-02-09 Deyu Ming , Serge Guillas

Gaussian processes (GP) are a widely used model for regression problems in supervised machine learning. Implementation of GP regression typically requires $O(n^3)$ logic gates. We show that the quantum linear systems algorithm [Harrow et…

Quantum Physics · Physics 2019-05-29 Zhikuan Zhao , Jack K. Fitzsimons , Joseph F. Fitzsimons

Gaussian random field is a ubiquitous model for spatial phenomena in diverse scientific disciplines. Its approximation is often crucial for computational feasibility in simulation, inference, and uncertainty quantification. The…

Computation · Statistics 2026-01-23 Joaquin Cavieres , Sebastian Krumscheid

We study pathwise invariances of centred random fields that can be controlled through the covariance. A result involving composition operators is obtained in second-order settings, and we show that various path properties including…

Statistics Theory · Mathematics 2013-08-07 David Ginsbourger , Olivier Roustant , Nicolas Durrande

This paper presents an efficient variational inference framework for deriving a family of structured gaussian process regression network (SGPRN) models. The key idea is to incorporate auxiliary inducing variables in latent functions and…

Machine Learning · Computer Science 2021-11-19 Rui Meng , Herbie Lee , Kristofer Bouchard

Gaussian processes (GPs) are powerful and widely used probabilistic regression models, but their effectiveness in practice is often limited by the choice of kernel function. This kernel function is typically handcrafted from a small set of…

Machine Learning · Computer Science 2026-02-13 Jihao Andreas Lin , Sebastian Ament , Louis C. Tiao , David Eriksson , Maximilian Balandat , Eytan Bakshy

Recently nonparametric functional model with functional responses has been proposed within the functional reproducing kernel Hilbert spaces (fRKHS) framework. Motivated by its superior performance and also its limitations, we propose a…

Methodology · Statistics 2010-08-11 Heng Lian

Statistical physics approaches can be used to derive accurate predictions for the performance of inference methods learning from potentially noisy data, as quantified by the learning curve defined as the average error versus number of…

Machine Learning · Statistics 2012-11-07 Matthew J. Urry , Peter Sollich

We provide guarantees for approximate Gaussian Process (GP) regression resulting from two common low-rank kernel approximations: based on random Fourier features, and based on truncating the kernel's Mercer expansion. In particular, we…

Machine Learning · Statistics 2022-02-22 Constantinos Daskalakis , Petros Dellaportas , Aristeidis Panos

We provide guarantees for approximate Gaussian Process (GP) regression resulting from two common low-rank kernel approximations: based on random Fourier features, and based on truncating the kernel's Mercer expansion. In particular, we…

Machine Learning · Statistics 2021-12-16 Constantinos Daskalakis , Petros Dellaportas , Aristeidis Panos