English
Related papers

Related papers: Variational Inducing Kernels for Sparse Convolved …

200 papers

This paper examines experimental design procedures used to develop surrogates of computational models, exploring the interplay between experimental designs and approximation algorithms. We focus on two widely used approximation approaches,…

Numerical Analysis · Computer Science 2016-05-02 Alex A. Gorodetsky , Youssef M. Marzouk

We consider a Gaussian process formulation of the multiple kernel learning problem. The goal is to select the convex combination of kernel matrices that best explains the data and by doing so improve the generalisation on unseen data.…

Machine Learning · Statistics 2011-10-25 Cedric Archambeau , Francis Bach

Recently there has been an increasing interest in methods that deal with multiple outputs. This has been motivated partly by frameworks like multitask learning, multisensor networks or structured output data. From a Gaussian processes…

Machine Learning · Statistics 2009-11-30 Mauricio A. Álvarez , Neil D. Lawrence

Large-scale Gaussian process inference has long faced practical challenges due to time and space complexity that is superlinear in dataset size. While sparse variational Gaussian process models are capable of learning from large-scale data,…

Machine Learning · Statistics 2018-01-23 Ching-An Cheng , Byron Boots

Early approaches to multiple-output Gaussian processes (MOGPs) relied on linear combinations of independent, latent, single-output Gaussian processes (GPs). This resulted in cross-covariance functions with limited parametric interpretation,…

Machine Learning · Statistics 2017-11-07 Gabriel Parra , Felipe Tobar

Kernel methods are among the most popular techniques in machine learning. From a frequentist/discriminative perspective they play a central role in regularization theory as they provide a natural choice for the hypotheses space and the…

Machine Learning · Statistics 2012-04-17 Mauricio A. Alvarez , Lorenzo Rosasco , Neil D. Lawrence

Kernel methods have revolutionized the fields of pattern recognition and machine learning. Their success, however, critically depends on the choice of kernel parameters. Using Gaussian process (GP) classification as a working example, this…

Methodology · Statistics 2014-05-27 Maurizio Filippone

We study learning problems in which the conditional distribution of the output given the input varies as a function of additional task variables. In varying-coefficient models with Gaussian process priors, a Gaussian process generates the…

Machine Learning · Computer Science 2015-10-15 Matthias Bussas , Christoph Sawade , Tobias Scheffer , Niels Landwehr

Multi-output Gaussian processes (MOGPs) are an extension of Gaussian Processes (GPs) for predicting multiple output variables (also called channels, tasks) simultaneously. In this paper we use the convolution theorem to design a new kernel…

Machine Learning · Computer Science 2021-10-11 Kai Chen , Twan van Laarhoven , Perry Groot , Jinsong Chen , Elena Marchiori

This work brings together two powerful concepts in Gaussian processes: the variational approach to sparse approximation and the spectral representation of Gaussian processes. This gives rise to an approximation that inherits the benefits of…

Machine Learning · Statistics 2017-11-09 James Hensman , Nicolas Durrande , Arno Solin

The kernel function and its hyperparameters are the central model selection choice in a Gaussian proces (Rasmussen and Williams, 2006). Typically, the hyperparameters of the kernel are chosen by maximising the marginal likelihood, an…

Machine Learning · Statistics 2022-11-07 Vidhi Lalchand , Wessel P. Bruinsma , David R. Burt , Carl E. Rasmussen

We propose a method (TT-GP) for approximate inference in Gaussian Process (GP) models. We build on previous scalable GP research including stochastic variational inference based on inducing inputs, kernel interpolation, and structure…

Machine Learning · Computer Science 2018-01-18 Pavel Izmailov , Alexander Novikov , Dmitry Kropotov

Gaussian processes regression models are an appealing machine learning method as they learn expressive non-linear models from exemplar data with minimal parameter tuning and estimate both the mean and covariance of unseen points. However,…

Machine Learning · Computer Science 2020-08-25 Vladimir Joukov , Dana Kulić

In decision-making systems, it is important to have classifiers that have calibrated uncertainties, with an optimisation objective that can be used for automated model selection and training. Gaussian processes (GPs) provide uncertainty…

Machine Learning · Statistics 2020-03-05 Vincent Dutordoir , Mark van der Wilk , Artem Artemev , James Hensman

Gaussian processes (GPs) have gained popularity as flexible machine learning models for regression and function approximation with an in-built method for uncertainty quantification. However, GPs suffer when the amount of training data is…

Machine Learning · Statistics 2025-11-26 Jonas Latz , Aretha L. Teckentrup , Simon Urbainczyk

Gaussian process regression is a classical kernel method for function estimation and data interpolation. In large data applications, computational costs can be reduced using low-rank or sparse approximations of the kernel. This paper…

Numerical Analysis · Mathematics 2024-10-04 Daniel Sanz-Alonso , Ruiyi Yang

The Multi-Output Gaussian Process is is a popular tool for modelling data from multiple sources. A typical choice to build a covariance function for a MOGP is the Linear Model of Coregionalization (LMC) which parametrically models the…

Machine Learning · Computer Science 2025-06-13 Xiaoyu Jiang , Sokratia Georgaka , Magnus Rattray , Mauricio A. Álvarez

Multi-output Gaussian processes (MOGPs) have been introduced to deal with multiple tasks by exploiting the correlations between different outputs. Generally, MOGPs models assume a flat correlation structure between the outputs. However,…

Machine Learning · Computer Science 2023-09-01 Chunchao Ma , Arthur Leroy , Mauricio Alvarez

Deep kernel learning combines the non-parametric flexibility of kernel methods with the inductive biases of deep learning architectures. We propose a novel deep kernel learning model and stochastic variational inference procedure which…

Machine Learning · Statistics 2016-11-03 Andrew Gordon Wilson , Zhiting Hu , Ruslan Salakhutdinov , Eric P. Xing

Recent work shows that inference for Gaussian processes can be performed efficiently using iterative methods that rely only on matrix-vector multiplications (MVMs). Structured Kernel Interpolation (SKI) exploits these techniques by deriving…

Machine Learning · Computer Science 2018-02-27 Jacob R. Gardner , Geoff Pleiss , Ruihan Wu , Kilian Q. Weinberger , Andrew Gordon Wilson
‹ Prev 1 2 3 10 Next ›