English
Related papers

Related papers: Scalable Gaussian-process regression and variable …

200 papers

Gaussian processes (GPs) are versatile tools that have been successfully employed to solve nonlinear estimation problems in machine learning, but that are rarely used in signal processing. In this tutorial, we present GPs for regression as…

We here consider the subset simulation method which approaches a failure event using a decreasing sequence of nested intermediate failure events. The method resembles importance sampling, which actively explores a probability space by…

Computation · Statistics 2020-03-16 Kenan Šehić , Mirza Karamehmedović

Gaussian processes (GPs) are generally regarded as the gold standard surrogate model for emulating computationally expensive computer-based simulators. However, the problem of training GPs as accurately as possible with a minimum number of…

Methodology · Statistics 2024-11-26 Hossein Mohammadi , Peter Challenor

Accurate human motion prediction with well-calibrated uncertainty is critical for safe human-robot collaboration (HRC), where robots must anticipate and react to human movements in real time. We propose a structured multitask variational…

Robotics · Computer Science 2026-03-10 Jinger Chong , Xiaotong Zhang , Kamal Youcef-Toumi

Many computer simulations are stochastic and exhibit input dependent noise. In such situations, heteroskedastic Gaussian processes (hetGPs) make ideal surrogates as they estimate a latent, non-constant variance. However, existing hetGP…

Methodology · Statistics 2026-03-03 Parul V. Patil , Robert B. Gramacy , Cayelan C. Carey , R. Quinn Thomas

This work introduces the concept of parametric Gaussian processes (PGPs), which is built upon the seemingly self-contradictory idea of making Gaussian processes parametric. Parametric Gaussian processes, by construction, are designed to…

Machine Learning · Statistics 2017-05-08 Maziar Raissi

Exact Gaussian Process (GP) regression has O(N^3) runtime for data size N, making it intractable for large N. Many algorithms for improving GP scaling approximate the covariance with lower rank matrices. Other work has exploited structure…

Machine Learning · Statistics 2012-09-24 Elad Gilboa , Yunus Saatçi , John P. Cunningham

Gaussian processes (GPs) are a Bayesian machine learning approach widely used to construct surrogate models for the uncertainty quantification of computer simulation codes in industrial applications. It provides both a mean predictor and an…

In this work, we study scaling limits of shallow Bayesian neural networks (BNNs) via their connection to Gaussian processes (GPs), with an emphasis on statistical modeling, identifiability, and scalable inference. We first establish a…

Machine Learning · Statistics 2026-02-27 Gracielle Antunes de Araújo , Flávio B. Gonçalves

Gaussian processes (GPs) are powerful non-parametric function estimators. However, their applications are largely limited by the expensive computational cost of the inference procedures. Existing stochastic or distributed synchronous…

Machine Learning · Statistics 2017-06-14 Hao Peng , Shandian Zhe , Yuan Qi

Gaussian process models are flexible, Bayesian non-parametric approaches to regression. Properties of multivariate Gaussians mean that they can be combined linearly in the manner of additive models and via a link function (like in…

Machine Learning · Statistics 2016-04-19 Alan D. Saul , James Hensman , Aki Vehtari , Neil D. Lawrence

Gaussian process regression is a popular method for non-parametric probabilistic modeling of functions. The Gaussian process prior is characterized by so-called hyperparameters, which often have a large influence on the posterior model and…

Machine Learning · Statistics 2016-11-18 Andreas Svensson , Johan Dahlin , Thomas B. Schön

We introduce stochastic variational inference for Gaussian process models. This enables the application of Gaussian process (GP) models to data sets containing millions of data points. We show how GPs can be vari- ationally decomposed to…

Machine Learning · Computer Science 2013-09-27 James Hensman , Nicolo Fusi , Neil D. Lawrence

The application of Gaussian processes (GPs) to large data sets is limited due to heavy memory and computational requirements. A variety of methods has been proposed to enable scalability, one of which is to exploit structure in the kernel…

Machine Learning · Computer Science 2019-12-30 Jan Graßhoff , Alexandra Jankowski , Philipp Rostalski

Inference for GP models with non-Gaussian noises is computationally expensive when dealing with large datasets. Many recent inference methods approximate the posterior distribution with a simpler distribution defined on a small number of…

Machine Learning · Computer Science 2018-09-11 Linfeng Liu , Liping Liu

Gaussian Processes (GPs) have been widely used in machine learning to model distributions over functions, with applications including multi-modal regression, time-series prediction, and few-shot learning. GPs are particularly useful in the…

The Gaussian process (GP) regression model is a widely employed surrogate modeling technique for computer experiments, offering precise predictions and statistical inference for the computer simulators that generate experimental data.…

Methodology · Statistics 2024-04-02 Lulu Kang , Yuanxing Cheng , Yiwei Wang , Chun Liu

This paper proposes a new algorithm for Gaussian process classification based on posterior linearisation (PL). In PL, a Gaussian approximation to the posterior density is obtained iteratively using the best possible linearisation of the…

Machine Learning · Computer Science 2019-04-19 Ángel F. García-Fernández , Filip Tronarp , Simo Särkkä

This paper presents a new approach to a robust Gaussian process (GP) regression. Most existing approaches replace an outlier-prone Gaussian likelihood with a non-Gaussian likelihood induced from a heavy tail distribution, such as the…

Machine Learning · Computer Science 2020-01-15 Chiwoo Park , David J. Borth , Nicholas S. Wilson , Chad N. Hunter , Fritz J. Friedersdorf

For a learning task, Gaussian process (GP) is interested in learning the statistical relationship between inputs and outputs, since it offers not only the prediction mean but also the associated variability. The vanilla GP however struggles…

Machine Learning · Statistics 2020-09-01 Haitao Liu , Yew-Soon Ong , Xiaomo Jiang , Xiaofang Wang