English
Related papers

Related papers: Recurrent Memory for Online Interdomain Gaussian P…

200 papers

Gaussian processes (GPs) provide a nonparametric representation of functions. However, classical GP inference suffers from high computational cost for big data. In this paper, we propose a new Bayesian approach, EigenGP, that learns both…

Machine Learning · Computer Science 2015-07-14 Hao Peng , Yuan Qi

By enabling constraint-aware online model adaptation, model predictive control using Gaussian process (GP) regression has exhibited impressive performance in real-world applications and received considerable attention in the learning-based…

Optimization and Control · Mathematics 2024-09-17 Amon Lahr , Andrea Zanelli , Andrea Carron , Melanie N. Zeilinger

Deep Gaussian Processes (DGPs) are multi-layer, flexible extensions of Gaussian processes but their training remains challenging. Sparse approximations simplify the training but often require optimization over a large number of inducing…

Machine Learning · Statistics 2021-07-20 Ayush Jain , P. K. Srijith , Mohammad Emtiyaz Khan

Scientific and engineering problems often require the use of artificial intelligence to aid understanding and the search for promising designs. While Gaussian processes (GP) stand out as easy-to-use and interpretable learners, they have…

Machine Learning · Computer Science 2021-07-01 Liwei Wang , Suraj Yerramilli , Akshay Iyer , Daniel Apley , Ping Zhu , Wei Chen

Heteroscedastic regression considering the varying noises among observations has many applications in the fields like machine learning and statistics. Here we focus on the heteroscedastic Gaussian process (HGP) regression which integrates…

Machine Learning · Statistics 2020-01-22 Haitao Liu , Yew-Soon Ong , Jianfei Cai

Multi-output Gaussian process (MGP) is commonly used as a transfer learning method to leverage information among multiple outputs. A key advantage of MGP is providing uncertainty quantification for prediction, which is highly important for…

Machine Learning · Statistics 2024-09-06 Wang Xinming , Li Yongxiang , Yue Xiaowei , Wu Jianguo

Gaussian processes (GPs) are a powerful tool for probabilistic inference over functions. They have been applied to both regression and non-linear dimensionality reduction, and offer desirable properties such as uncertainty estimates,…

Machine Learning · Statistics 2014-10-01 Yarin Gal , Mark van der Wilk , Carl E. Rasmussen

We propose a method (TT-GP) for approximate inference in Gaussian Process (GP) models. We build on previous scalable GP research including stochastic variational inference based on inducing inputs, kernel interpolation, and structure…

Machine Learning · Computer Science 2018-01-18 Pavel Izmailov , Alexander Novikov , Dmitry Kropotov

The next generation of Department of Energy supercomputers will be capable of exascale computation. For these machines, far more computation will be possible than that which can be saved to disk. As a result, users will be unable to rely on…

Machine Learning · Computer Science 2025-07-23 Michael Grosskopf , Kellin Rumsey , Ayan Biswas , Earl Lawrence

Gaussian processes (GPs) are powerful but computationally expensive machine learning models, requiring an estimate of the kernel covariance matrix for every prediction. In large and complex domains, such as graphs, sets, or images, the…

Machine Learning · Computer Science 2022-04-22 Alessandro Tibo , Thomas Dyhre Nielsen

We propose DistGP: a multi-robot learning method for collaborative learning of a global function using only local experience and computation. We utilise a sparse Gaussian process (GP) model with a factorisation that mirrors the multi-robot…

Robotics · Computer Science 2026-03-10 Seth Nabarro , Mark van der Wilk , Andrew J. Davison

Training and inference in Gaussian processes (GPs) require solving linear systems with $n\times n$ kernel matrices. To address the prohibitive $\mathcal{O}(n^3)$ time complexity, recent work has employed fast iterative methods, like…

Machine Learning · Computer Science 2024-03-12 Kaiwen Wu , Jonathan Wenger , Haydn Jones , Geoff Pleiss , Jacob R. Gardner

Gaussian processes (GPs) are powerful non-parametric function estimators. However, their applications are largely limited by the expensive computational cost of the inference procedures. Existing stochastic or distributed synchronous…

Machine Learning · Statistics 2017-06-14 Hao Peng , Shandian Zhe , Yuan Qi

Multi-task Gaussian process (MTGP) is a well-known non-parametric Bayesian model for learning correlated tasks effectively by transferring knowledge across tasks. But current MTGPs are usually limited to the multi-task scenario defined in…

Machine Learning · Statistics 2024-10-28 Haitao Liu , Kai Wu , Yew-Soon Ong , Chao Bian , Xiaomo Jiang , Xiaofang Wang

This paper introduces a new sparse spatio-temporal structured Gaussian process regression framework for online and offline Bayesian inference. This is the first framework that gives a time-evolving representation of the interdependencies…

Machine Learning · Statistics 2018-08-01 Danil Kuzin , Olga Isupova , Lyudmila Mihaylova

Gaussian Processes (GPs) are widely used for regression and system identification due to their flexibility and ability to quantify uncertainty. However, their computational complexity limits their applicability to small datasets. Moreover…

Machine Learning · Computer Science 2025-08-27 Thore Wietzke , Knut Graichen

Deep Gaussian Processes (DGPs) are hierarchical generalizations of Gaussian Processes that combine well calibrated uncertainty estimates with the high flexibility of multilayer models. One of the biggest challenges with these models is that…

Machine Learning · Statistics 2018-11-13 Marton Havasi , José Miguel Hernández-Lobato , Juan José Murillo-Fuentes

The Gaussian process (GP) is a Bayesian nonparametric paradigm that is widely adopted for uncertainty quantification (UQ) in a number of safety-critical applications, including robotics, healthcare, as well as surveillance. The consistency…

Machine Learning · Computer Science 2024-10-10 Jinwen Xu , Qin Lu , Georgios B. Giannakis

Many applications in speech, robotics, finance, and biology deal with sequential data, where ordering matters and recurrent structures are common. However, this structure cannot be easily captured by standard kernel functions. To model such…

Machine Learning · Computer Science 2017-10-06 Maruan Al-Shedivat , Andrew Gordon Wilson , Yunus Saatchi , Zhiting Hu , Eric P. Xing

A key challenge with controlling complex dynamical systems is to accurately model them. However, this requirement is very hard to satisfy in practice. Data-driven approaches such as Gaussian processes (GPs) have proved quite effective by…

Robotics · Computer Science 2022-03-08 Mouhyemen Khan , Akash Patel , Abhijit Chatterjee