English
Related papers

Related papers: Gaussian Process Regression constrained by Boundar…

200 papers

Gaussian processes (GP) are a widely used model for regression problems in supervised machine learning. Implementation of GP regression typically requires $O(n^3)$ logic gates. We show that the quantum linear systems algorithm [Harrow et…

Quantum Physics · Physics 2019-05-29 Zhikuan Zhao , Jack K. Fitzsimons , Joseph F. Fitzsimons

Gaussian processes (GPs) are widely used in nonparametric regression, classification and spatio-temporal modeling, motivated in part by a rich literature on theoretical properties. However, a well known drawback of GPs that limits their use…

Methodology · Statistics 2011-06-29 Anjishnu Banerjee , David Dunson , Surya Tokdar

We introduce a novel rule-based approach for handling regression problems. The new methodology carries elements from two frameworks: (i) it provides information about the uncertainty of the parameters of interest using Bayesian inference,…

Machine Learning · Statistics 2021-10-11 Themistoklis Botsas , Lachlan R. Mason , Indranil Pan

Gaussian process regression (GPR) has been a well-known machine learning method for various applications such as uncertainty quantifications (UQ). However, GPR is inherently a data-driven method, which requires sufficiently large dataset.…

Machine Learning · Computer Science 2023-05-03 Cheng Chang , Tieyong Zeng

Gaussian processes are a natural way of defining prior distributions over functions of one or more input variables. In a simple nonparametric regression problem, where such a function gives the mean of a Gaussian distribution for an…

Data Analysis, Statistics and Probability · Physics 2008-02-03 Radford M. Neal

Differential Equation (DE) is a commonly used modeling method in various scientific subjects such as finance and biology. The parameters in DE models often have interesting scientific interpretations, but their values are often unknown and…

Computation · Statistics 2020-11-24 Ying Zhou , Hongqiao Wang

Gaussian process is one of the most popular non-parametric Bayesian methodologies for modeling the regression problem. It is completely determined by its mean and covariance functions. And its linear property makes it relatively…

Machine Learning · Statistics 2020-06-16 Wenqi Fang , Huiyun Li , Hui Huang , Shaobo Dang , Zhejun Huang , Zheng Wang

This paper presents an efficient variational inference framework for deriving a family of structured gaussian process regression network (SGPRN) models. The key idea is to incorporate auxiliary inducing variables in latent functions and…

Machine Learning · Computer Science 2021-11-19 Rui Meng , Herbie Lee , Kristofer Bouchard

We introduce a new regression framework, Gaussian process regression networks (GPRN), which combines the structural properties of Bayesian neural networks with the non-parametric flexibility of Gaussian processes. This model accommodates…

Machine Learning · Statistics 2011-10-21 Andrew Gordon Wilson , David A. Knowles , Zoubin Ghahramani

In this paper we propose a novel Bayesian solution for nonlinear regression in complex fields. Previous solutions for kernels methods usually assume a complexification approach, where the real-valued kernel is replaced by a complex-valued…

Machine Learning · Computer Science 2018-03-02 Rafael Boloix-Tortosa , Eva Arias-de-Reyna , F. Javier Payan-Somet , Juan J. Murillo-Fuentes

When constructing a Bayesian Machine Learning model, we might be faced with multiple different prior distributions and thus are required to properly consider them in a sensible manner in our model. While this situation is reasonably well…

Machine Learning · Computer Science 2021-04-20 Sarem Seitz

In this paper, we introduce the notion of Gaussian processes indexed by probability density functions for extending the Mat\'ern family of covariance functions. We use some tools from information geometry to improve the efficiency and the…

Methodology · Statistics 2020-11-09 A. Fradi , Y. Feunteun , C. Samir , M. Baklouti , F. Bachoc , J-M. Loubes

Gaussian processes (GPs) are ubiquitous tools for modeling and predicting continuous processes in physical and engineering sciences. This is partly due to the fact that one may employ a Gaussian process as an interpolator while facilitating…

Statistics Theory · Mathematics 2025-12-16 D. Andrew Brown , Peter Kiessler , John Nicholson

Gaussian processes have become a popular tool for nonparametric regression because of their flexibility and uncertainty quantification. However, they often use stationary kernels, which limit the expressiveness of the model and may be…

Machine Learning · Computer Science 2025-07-17 Zachary James , Joseph Guinness

Gaussian processes are powerful, yet analytically tractable models for supervised learning. A Gaussian process is characterized by a mean function and a covariance function (kernel), which are determined by a model selection criterion. The…

Machine Learning · Statistics 2016-10-05 Benjamin Fischer , Nico Gorbach , Stefan Bauer , Yatao Bian , Joachim M. Buhmann

Gaussian process is a theoretically appealing model for nonparametric analysis, but its computational cumbersomeness hinders its use in large scale and the existing reduced-rank solutions are usually heuristic. In this work, we propose a…

Machine Learning · Statistics 2015-11-25 Leo L. Duan , Xia Wang , Rhonda D. Szczesniak

This paper introduces a new sparse spatio-temporal structured Gaussian process regression framework for online and offline Bayesian inference. This is the first framework that gives a time-evolving representation of the interdependencies…

Machine Learning · Statistics 2018-08-01 Danil Kuzin , Olga Isupova , Lyudmila Mihaylova

Probabilistic machine learning models are distinguished by their ability to integrate prior knowledge of noise statistics, smoothness parameters, and training data uncertainty. A common approach involves modeling data with Gaussian…

Computation · Statistics 2025-07-31 Cristian A. Galvis-Florez , Ahmad Farooq , Simo Särkkä

We consider the problem of estimating the parameters of the covariance function of a Gaussian process by cross-validation. We suggest using new cross-validation criteria derived from the literature of scoring rules. We also provide an…

Computation · Statistics 2020-08-07 Sébastien Petit , Julien Bect , Sébastien da Veiga , Paul Feliot , Emmanuel Vazquez

Gaussian processes (GPs) are an important tool in machine learning and statistics with applications ranging from social and natural science through engineering. They constitute a powerful kernelized non-parametric method with…

Machine Learning · Statistics 2021-12-20 Manuel Schürch , Dario Azzimonti , Alessio Benavoli , Marco Zaffalon