English
Related papers

Related papers: Going With the Flow: Normalizing Flows for Gaussia…

200 papers

Gaussian Processes (GPs) can be used as flexible, non-parametric function priors. Inspired by the growing body of work on Normalizing Flows, we enlarge this class of priors through a parametric invertible transformation that can be made…

Machine Learning · Computer Science 2021-02-26 Juan Maroñas , Oliver Hamelijnck , Jeremias Knoblauch , Theodoros Damoulas

The performance of Gaussian Process (GP) regression is often hampered by the curse of dimensionality, which inflates computational cost and reduces predictive power in high-dimensional problems. Variable selection is thus crucial for…

Methodology · Statistics 2025-11-24 Minshen Xu , Shiwei Lan , Lulu Kang

Gaussian Process Regression (GPR) is widely used for inferring functions from noisy data. GPR crucially relies on the choice of a kernel, which might be specified in terms of a collection of hyperparameters that must be chosen or learned.…

Numerical Analysis · Mathematics 2025-06-16 P. Michael Kielstra , Michael Lindsey

Gaussian process regression (GPR) is a powerful machine learning method which has recently enjoyed wider use, in particular in physical sciences. In its original formulation, GPR uses a square matrix of covariances among training data and…

Numerical Analysis · Mathematics 2023-09-08 Sergei Manzhos , Manabu Ihara

Gaussian process regression (GPR) is a popular nonparametric Bayesian method that provides predictive uncertainty estimates and is widely used in safety-critical applications. While prior research has introduced various uncertainty bounds,…

Machine Learning · Computer Science 2025-12-05 Junyi Liu , Stanley Kok

We study the performance of nonparametric Bayes procedures for one-dimensional diffusions with periodic drift. We improve existing convergence rate results for Gaussian process (GP) priors with fixed hyper parameters. Moreover, we exhibit…

Statistics Theory · Mathematics 2017-06-15 Jan van Waaij , Harry van Zanten

Gaussian processes (GPs) have gained popularity as flexible machine learning models for regression and function approximation with an in-built method for uncertainty quantification. However, GPs suffer when the amount of training data is…

Machine Learning · Statistics 2025-11-26 Jonas Latz , Aretha L. Teckentrup , Simon Urbainczyk

Bayesian inference with computationally expensive likelihood evaluations remains a significant challenge in many scientific domains. We propose normalizing flow regression (NFR), a novel offline inference method for approximating posterior…

Machine Learning · Statistics 2025-04-17 Chengkun Li , Bobby Huggins , Petrus Mikkola , Luigi Acerbi

Gaussian Process Regression (GPR) is a nonparametric supervised learning method, widely valued for its ability to quantify uncertainty. Despite its advantages and broad applications, classical GPR implementations face significant…

Quantum Physics · Physics 2025-03-25 Junpeng Hu , Jinglai Li , Lei Zhang , Shi Jin

Deep Gaussian processes (DGPs), a hierarchical composition of GP models, have successfully boosted the expressive power of their single-layer counterpart. However, it is impossible to perform exact inference in DGPs, which has motivated the…

Machine Learning · Computer Science 2021-05-27 Haibin Yu , Dapeng Liu , Yizhou Chen , Bryan Kian Hsiang Low , Patrick Jaillet

This paper presents a novel variational inference framework for deriving a family of Bayesian sparse Gaussian process regression (SGPR) models whose approximations are variationally optimal with respect to the full-rank GPR model enriched…

Machine Learning · Computer Science 2019-03-25 Haibin Yu , Trong Nghia Hoang , Kian Hsiang Low , Patrick Jaillet

Gaussian processes are a flexible Bayesian nonparametric modelling approach that has been widely applied but poses computational challenges. To address the poor scaling of exact inference methods, approximation methods based on sparse…

Machine Learning · Statistics 2021-06-01 Rui Meng , Herbert Lee , Soper Braden , Priyadip Ray

Identifying dynamical system (DS) is a vital task in science and engineering. Traditional methods require numerous calls to the DS solver, rendering likelihood-based or least-squares inference frameworks impractical. For efficient parameter…

Computation · Statistics 2024-09-19 Ying Zhou , Jinglai Li , Xiang Zhou , Hongqiao Wang

We propose a novel sparse spectrum approximation of Gaussian process (GP) tailored for Bayesian optimization. Whilst the current sparse spectrum methods provide desired approximations for regression problems, it is observed that this…

Machine Learning · Computer Science 2020-06-09 Ang Yang , Cheng Li , Santu Rana , Sunil Gupta , Svetha Venkatesh

Gaussian process regression (GPR) is a non-parametric Bayesian technique for interpolating or fitting data. The main barrier to further uptake of this powerful tool rests in the computational costs associated with the matrices which arise…

Machine Learning · Statistics 2016-05-16 Christopher J. Moore , Alvin J. K. Chua , Christopher P. L. Berry , Jonathan R. Gair

Learning in Gaussian Process models occurs through the adaptation of hyperparameters of the mean and the covariance function. The classical approach entails maximizing the marginal likelihood yielding fixed point estimates (an approach…

Machine Learning · Statistics 2020-04-07 Vidhi Lalchand , Carl Edward Rasmussen

Gaussian process regression (GPR) is a fundamental model used in machine learning. Owing to its accurate prediction with uncertainty and versatility in handling various data structures via kernels, GPR has been successfully used in various…

Machine Learning · Computer Science 2021-12-16 Yuya Yoshikawa , Tomoharu Iwata

In this work, we study scaling limits of shallow Bayesian neural networks (BNNs) via their connection to Gaussian processes (GPs), with an emphasis on statistical modeling, identifiability, and scalable inference. We first establish a…

Machine Learning · Statistics 2026-02-27 Gracielle Antunes de Araújo , Flávio B. Gonçalves

We present a computational framework for efficient learning, sampling, and distribution of general Bayesian posterior distributions. The framework leverages a machine learning approach for the construction of normalizing flows for the…

Nuclear Theory · Physics 2023-10-10 Yukari Yamauchi , Landon Buskirk , Pablo Giuliani , Kyle Godbey

Gaussian process regression has proven very powerful in statistics, machine learning and inverse problems. A crucial aspect of the success of this methodology, in a wide range of applications to complex and real-world problems, is…

Statistics Theory · Mathematics 2021-03-18 Yifan Chen , Houman Owhadi , Andrew M. Stuart
‹ Prev 1 2 3 10 Next ›