English

Learning Integral Representations of Gaussian Processes

Machine Learning 2019-03-08 v4 Machine Learning

Abstract

We propose a representation of Gaussian processes (GPs) based on powers of the integral operator defined by a kernel function, we call these stochastic processes integral Gaussian processes (IGPs). Sample paths from IGPs are functions contained within the reproducing kernel Hilbert space (RKHS) defined by the kernel function, in contrast sample paths from the standard GP are not functions within the RKHS. We develop computationally efficient non-parametric regression models based on IGPs. The main innovation in our regression algorithm is the construction of a low dimensional subspace that captures the information most relevant to explaining variation in the response. We use ideas from supervised dimension reduction to compute this subspace. The result of using the construction we propose involves significant improvements in the computational complexity of estimating kernel hyper-parameters as well as reducing the prediction variance.

Keywords

Cite

@article{arxiv.1802.07528,
  title  = {Learning Integral Representations of Gaussian Processes},
  author = {Zilong Tan and Sayan Mukherjee},
  journal= {arXiv preprint arXiv:1802.07528},
  year   = {2019}
}
R2 v1 2026-06-23T00:28:42.986Z