English
Related papers

Related papers: Hilbert space methods for approximating multi-outp…

200 papers

Gaussian processes (GPs) provide a nonparametric representation of functions. However, classical GP inference suffers from high computational cost for big data. In this paper, we propose a new Bayesian approach, EigenGP, that learns both…

Machine Learning · Computer Science 2015-07-14 Hao Peng , Yuan Qi

We analyze the dynamics of an algorithm for approximate inference with large Gaussian latent variable models in a student-teacher scenario. To model nontrivial dependencies between the latent variables, we assume random covariance matrices…

Machine Learning · Computer Science 2020-08-26 Burak Çakmak , Manfred Opper

Gaussian processes are the gold standard for many real-world modeling problems, especially in cases where a model's success hinges upon its ability to faithfully represent predictive uncertainty. These problems typically exist as parts of…

We introduce the concept of numerical Gaussian processes, which we define as Gaussian processes with covariance functions resulting from temporal discretization of time-dependent partial differential equations. Numerical Gaussian processes,…

Machine Learning · Statistics 2017-03-31 Maziar Raissi , Paris Perdikaris , George Em Karniadakis

Latent variable models for ordinal data represent a useful tool in different fields of research in which the constructs of interest are not directly observable. In such models, problems related to the integration of the likelihood function…

Methodology · Statistics 2012-06-26 Silvia Bianconcini , Silvia Cagnone

Non-Gaussian observations such as binary responses are common in some computer experiments. Motivated by the analysis of a class of cell adhesion experiments, we introduce a generalized Gaussian process model for binary responses, which…

Methodology · Statistics 2018-09-26 Chih-Li Sung , Ying Hung , William Rittase , Cheng Zhu , C. F. Jeff Wu

Current methods for stochastic hyperparameter learning in Gaussian Processes (GPs) rely on approximations, such as computing biased stochastic gradients or using inducing points in stochastic variational inference. However, when using such…

Machine Learning · Computer Science 2025-08-29 Neta Shoham , Haim Avron

The Mat\'ern covariance function is a popular choice for modeling dependence in spatial environmental data. Standard Mat\'ern covariance models are, however, often computationally infeasible for large data sets. In this work, recent results…

Computation · Statistics 2015-03-19 David Bolin , Finn Lindgren

Multifidelity models integrate data from multiple sources to produce a single approximator for the underlying process. Dense low-fidelity samples are used to reduce interpolation error, while sparse high-fidelity samples are used to…

Machine Learning · Statistics 2024-02-27 Viv Bone , Chris van der Heide , Kieran Mackle , Ingo H. J. Jahn , Peter M. Dower , Chris Manzie

In this paper, we introduce the notion of Gaussian processes indexed by probability density functions for extending the Mat\'ern family of covariance functions. We use some tools from information geometry to improve the efficiency and the…

Methodology · Statistics 2020-11-09 A. Fradi , Y. Feunteun , C. Samir , M. Baklouti , F. Bachoc , J-M. Loubes

Gaussian Processes (GPs) are a generic modelling tool for supervised learning. While they have been successfully applied on large datasets, their use in safety-critical applications is hindered by the lack of good performance guarantees. To…

Machine Learning · Statistics 2019-08-27 David Reeb , Andreas Doerr , Sebastian Gerwinn , Barbara Rakitsch

This article considers linear processes with values in a separable Hilbert space exhibiting long-range dependence. The scaling limits for the sample autocovariance operators at different time lags are investigated in the topology of their…

Probability · Mathematics 2025-06-23 Marie-Christine Düker , Pavlos Zoubouloglou

The Gaussian process is an indispensable tool for spatial data analysts. The onset of the "big data" era, however, has lead to the traditional Gaussian process being computationally infeasible for modern spatial data. As such, various…

Non-Gaussian likelihoods are essential for modelling complex real-world observations but pose significant computational challenges in learning and inference. Even with Gaussian priors, non-Gaussian likelihoods often lead to analytically…

Machine Learning · Statistics 2024-10-29 Thang D. Bui

This work is concerned with the convergence of Gaussian process regression. A particular focus is on hierarchical Gaussian process regression, where hyper-parameters appearing in the mean and covariance structure of the Gaussian process…

Numerical Analysis · Mathematics 2020-07-20 Aretha L Teckentrup

We develop a functional Stein-Malliavin method in a non-diffusive Poissonian setting, thus obtaining a) quantitative central limit theorems for approximation of arbitrary non-degenerate Gaussian random elements taking values in a separable…

Probability · Mathematics 2023-04-17 Solesne Bourguin , Simon Campese , Thanh Dang

Gaussian process (GP) regression with 1D inputs can often be performed in linear time via a stochastic differential equation formulation. However, for non-Gaussian likelihoods, this requires application of approximate inference methods…

Machine Learning · Computer Science 2020-07-20 Paul E. Chang , William J. Wilkinson , Mohammad Emtiyaz Khan , Arno Solin

The accuracy of Bayesian inference can be negatively affected by the use of inaccurate forward models. In the case of gravitational-wave inference, accurate but computationally expensive waveform models are sometimes substituted with faster…

Instrumentation and Methods for Astrophysics · Physics 2024-04-02 Miaoxin Liu , Xiao-Dong Li , Alvin J. K. Chua

Investigating uncertainties in computer simulations can be prohibitive in terms of computational costs, since the simulator needs to be run over a large number of input values. Building an emulator, i.e. a statistical surrogate model of the…

Methodology · Statistics 2022-10-18 Ayao Ehara , Serge Guillas

Examples with bound information on the regression function and density abound in many real applications. We propose a novel approach for estimating such functions by incorporating the prior knowledge on the bounds. Specially, a Gaussian…

Methodology · Statistics 2018-10-30 Jize Zhang , Lizhen Lin