English
Related papers

Related papers: Scalable mixed-domain Gaussian process modeling an…

200 papers

Gaussian process (GP) regression has been widely used in supervised machine learning due to its flexibility and inherent ability to describe uncertainty in function estimation. In the context of control, it is seeing increasing use for…

Systems and Control · Computer Science 2020-01-01 Lukas Hewing , Juraj Kabzan , Melanie N. Zeilinger

Gaussian Processes (GPs) are Bayesian models that provide uncertainty estimates associated to the predictions made. They are also very flexible due to their non-parametric nature. Nevertheless, GPs suffer from poor scalability as the number…

Machine Learning · Computer Science 2021-07-16 Bahram Jafrasteh , Carlos Villacampa-Calvo , Daniel Hernández-Lobato

Nonstationary non-Gaussian spatial data are common in many disciplines, including climate science, ecology, epidemiology, and social sciences. Examples include count data on disease incidence and binary satellite data on cloud mask…

Computation · Statistics 2020-11-30 Benjamin Seiyon Lee , Jaewoo Park

The sparse pseudo-input Gaussian process (SPGP) is a new approximation method for speeding up GP regression in the case of a large number of data points N. The approximation is controlled by the gradient optimization of a small set of M…

Machine Learning · Computer Science 2012-07-02 Edward Snelson , Zoubin Ghahramani

Bayesian optimization is an effective methodology for the global optimization of functions with expensive evaluations. It relies on querying a distribution over functions defined by a relatively cheap surrogate model. An accurate model for…

Gaussian processes (GPs) are sophisticated distributions to model functional data. Whilst theoretically appealing, they are computationally cumbersome except for small datasets. We implement two methods for scaling GP inference in Stan:…

Methodology · Statistics 2024-01-11 Till Hoffmann , Jukka-Pekka Onnela

Deep Gaussian processes (DGP) have appealing Bayesian properties, can handle variable-sized data, and learn deep features. Their limitation is that they do not scale well with the size of the data. Existing approaches address this using a…

Machine Learning · Computer Science 2019-05-20 Issam H. Laradji , Mark Schmidt , Vladimir Pavlovic , Minyoung Kim

Data-driven Model Predictive Control (MPC), where the system model is learned from data with machine learning, has recently gained increasing interests in the control community. Gaussian Processes (GP), as a type of statistical models, are…

Systems and Control · Computer Science 2019-10-03 Truong X. Nghiem

This paper presents an approach for constrained Gaussian Process (GP) regression where we assume that a set of linear transformations of the process are bounded. It is motivated by machine learning applications for high-consequence…

Machine Learning · Statistics 2019-09-12 Christian Agrell

Nonstationary Gaussian processes (GPs) are essential for modeling complex, locally heterogeneous spatial data. A common modeling approach is the spatial deformation method that warps the domain to recover isotropy. However, this static…

Machine Learning · Computer Science 2026-05-01 Minghao Gu , Weizhi Lin , Qiang Huang

Gaussian processes (GPs) provide a probabilistic nonparametric representation of functions in regression, classification, and other problems. Unfortunately, exact learning with GPs is intractable for large datasets. A variety of approximate…

Machine Learning · Computer Science 2012-03-19 Yuan , Qi , Ahmed H. Abdel-Gawad , Thomas P. Minka

By enabling constraint-aware online model adaptation, model predictive control using Gaussian process (GP) regression has exhibited impressive performance in real-world applications and received considerable attention in the learning-based…

Optimization and Control · Mathematics 2024-09-17 Amon Lahr , Andrea Zanelli , Andrea Carron , Melanie N. Zeilinger

This research proposes a flexible Bayesian extension of the composite Gaussian process (CGP) model of Ba and Joseph (2012) for predicting (stationary or) non-stationary $y(\mathbf{x})$. The CGP generalizes the regression plus stationary…

Methodology · Statistics 2019-06-27 Casey B. Davis , Christopher M. Hans , Thomas J. Santner

Gaussian Processes (\textbf{GPs}) are flexible non-parametric models with strong probabilistic interpretation. While being a standard choice for performing inference on time series, GPs have few techniques to work in a streaming setting.…

Machine Learning · Statistics 2021-07-22 Théo Galy-Fajou , Manfred Opper

Gaussian Processes (GPs) are widely used for regression and system identification due to their flexibility and ability to quantify uncertainty. However, their computational complexity limits their applicability to small datasets. Moreover…

Machine Learning · Computer Science 2025-08-27 Thore Wietzke , Knut Graichen

Inference for GP models with non-Gaussian noises is computationally expensive when dealing with large datasets. Many recent inference methods approximate the posterior distribution with a simpler distribution defined on a small number of…

Machine Learning · Computer Science 2018-09-11 Linfeng Liu , Liping Liu

Gaussian Processes (GP) have become popular machine-learning methods for kernel-based learning on datasets with complicated covariance structures. In this paper, we present a novel extension to the GP framework using a contaminated normal…

Machine Learning · Computer Science 2024-07-03 Daniel Iong , Matthew McAnear , Yuezhou Qu , Shasha Zou , Gabor Toth , Yang Chen

While Gaussian processes (GPs) are the method of choice for regression tasks, they also come with practical difficulties, as inference cost scales cubic in time and quadratic in memory. In this paper, we introduce a natural and expressive…

Machine Learning · Computer Science 2018-09-13 Martin Trapp , Robert Peharz , Carl E. Rasmussen , Franz Pernkopf

In this work, we propose a novel framework for large-scale Gaussian process (GP) modeling. Contrary to the global, and local approximations proposed in the literature to address the computational bottleneck with exact GP modeling, we employ…

Machine Learning · Statistics 2023-12-19 Akhil Vakayil , Roshan Joseph

Gaussian Processes (GPs) offer an attractive method for regression over small, structured and correlated datasets. However, their deployment is hindered by computational costs and limited guidelines on how to apply GPs beyond simple…

Machine Learning · Computer Science 2023-07-18 Kenza Tazi , Jihao Andreas Lin , Ross Viljoen , Alex Gardner , ST John , Hong Ge , Richard E. Turner