English
Related papers

Related papers: Heterogeneous Multi-output Gaussian Process Predic…

200 papers

Gaussian process regression is a popular Bayesian framework for surrogate modeling of expensive data sources. As part of a broader effort in scientific machine learning, many recent works have incorporated physical constraints or other a…

Machine Learning · Computer Science 2021-01-07 Laura Swiler , Mamikon Gulian , Ari Frankel , Cosmin Safta , John Jakeman

We introduce a Bayesian Gaussian process latent variable model that explicitly captures spatial correlations in data using a parameterized spatial kernel and leveraging structure-exploiting algebra on the model covariance matrices for…

Machine Learning · Statistics 2018-05-23 Steven Atkinson , Nicholas Zabaras

One goal in Bayesian machine learning is to encode prior knowledge into prior distributions, to model data efficiently. We consider prior knowledge from systems of linear partial differential equations together with their boundary…

Machine Learning · Computer Science 2021-02-16 Markus Lange-Hegermann

Often in machine learning, data are collected as a combination of multiple conditions, e.g., the voice recordings of multiple persons, each labeled with an ID. How could we build a model that captures the latent information related to these…

Machine Learning · Statistics 2017-05-30 Zhenwen Dai , Mauricio A. Álvarez , Neil D. Lawrence

This research proposes a flexible Bayesian extension of the composite Gaussian process (CGP) model of Ba and Joseph (2012) for predicting (stationary or) non-stationary $y(\mathbf{x})$. The CGP generalizes the regression plus stationary…

Methodology · Statistics 2019-06-27 Casey B. Davis , Christopher M. Hans , Thomas J. Santner

We introduce a new regression framework, Gaussian process regression networks (GPRN), which combines the structural properties of Bayesian neural networks with the non-parametric flexibility of Gaussian processes. This model accommodates…

Machine Learning · Statistics 2011-10-21 Andrew Gordon Wilson , David A. Knowles , Zoubin Ghahramani

We introduce a random partition model for Bayesian nonparametric regression. The model is based on infinitely-many disjoint regions of the range of a latent covariate-dependent Gaussian process. Given a realization of the process, the…

Methodology · Statistics 2013-01-04 George Karabatsos , Stephen G. Walker

Graphical models express conditional independence relationships among variables. Although methods for vector-valued data are well established, functional data graphical models remain underdeveloped. We introduce a notion of conditional…

Methodology · Statistics 2016-01-06 Hongxiao Zhu , Nate Strawn , David B. Dunson

Gaussian processes constitute a very powerful and well-understood method for non-parametric regression and classification. In the classical framework, the training data consists of deterministic vector-valued inputs and the corresponding…

Systems and Control · Computer Science 2018-09-26 Maxim Dolgov , Uwe D. Hanebeck

Multi-output Gaussian process (MOGP) regression allows modelling dependencies among multiple correlated response variables. Similarly to standard Gaussian processes, MOGPs are sensitive to model misspecification and outliers, which can…

Complex-valued Gaussian processes are used in Bayesian frequency-domain system identification as prior models for regression. If each realization of such a process were an $H_\infty$ function with probability one, then the same model could…

Systems and Control · Electrical Eng. & Systems 2022-11-30 Alex Devonport , Peter Seiler , Murat Arcak

We apply Gaussian process (GP) regression, which provides a powerful non-parametric probabilistic method of relating inputs to outputs, to survival data consisting of time-to-event and covariate measurements. In this context, the covariates…

Statistics Theory · Mathematics 2014-09-08 James E. Barrett , Anthony C. C. Coolen

Surrogate models are often used to replace costly-to-evaluate complex coastal codes to achieve substantial computational savings. In many of those models, the hydrometeorological forcing conditions (inputs) or flood events (outputs) are…

Machine Learning · Statistics 2021-11-04 A. F. López-Lopera , D. Idier , J. Rohmer , F. Bachoc

Clinical patient records are an example of high-dimensional data that is typically collected from disparate sources and comprises of multiple likelihoods with noisy as well as missing values. In this work, we propose an unsupervised…

Machine Learning · Statistics 2021-04-21 Siddharth Ramchandran , Miika Koskinen , Harri Lähdesmäki

This paper presents an efficient variational inference framework for deriving a family of structured gaussian process regression network (SGPRN) models. The key idea is to incorporate auxiliary inducing variables in latent functions and…

Machine Learning · Computer Science 2021-11-19 Rui Meng , Herbie Lee , Kristofer Bouchard

Multivariate categorical data occur in many applications of machine learning. One of the main difficulties with these vectors of categorical variables is sparsity. The number of possible observations grows exponentially with vector length,…

Machine Learning · Statistics 2015-03-10 Yarin Gal , Yutian Chen , Zoubin Ghahramani

We consider covariance parameter estimation for a Gaussian process under inequality constraints (boundedness, monotonicity or convexity) in fixed-domain asymptotics. We address the estimation of the variance parameter and the estimation of…

Statistics Theory · Mathematics 2021-11-04 François Bachoc , Agnès Lagnoux , Andrés F. López-Lopera

Gaussian process state-space model (GPSSM) is a fully probabilistic state-space model that has attracted much attention over the past decade. However, the outputs of the transition function in the existing GPSSMs are assumed to be…

Machine Learning · Computer Science 2022-12-16 Zhidi Lin , Lei Cheng , Feng Yin , Lexi Xu , Shuguang Cui

Models for heteroskedastic data are relevant in a wide variety of applications ranging from financial time series to environmental statistics. However, the topic of modeling the variance function conditionally has not seen near as much…

Methodology · Statistics 2020-09-30 Paul A. Parker , Scott H. Holan , Skye A. Wills

This chapter presents specific aspects of Gaussian process modeling in the presence of complex noise. Starting from the standard homoscedastic model, various generalizations from the literature are presented: input varying noise variance,…

Optimization and Control · Mathematics 2024-12-11 Mickael Binois , Arindam Fadikar , Abby Stevens