English
Related papers

Related papers: Multivariate Gaussian Process Regression for Multi…

200 papers

We develop a framework for Gaussian processes regression constrained by boundary value problems. The framework may be applied to infer the solution of a well-posed boundary value problem with a known second-order differential operator and…

Machine Learning · Computer Science 2020-12-23 Mamikon Gulian , Ari Frankel , Laura Swiler

Many techniques for data science and uncertainty quantification demand efficient tools to handle Gaussian random fields, which are defined in terms of their mean functions and covariance operators. Recently, parameterized Gaussian random…

Numerical Analysis · Mathematics 2021-05-11 Daniel Kressner , Jonas Latz , Stefano Massei , Elisabeth Ullmann

We propose a data fusion method based on multi-fidelity Gaussian process regression (GPR) framework. This method combines available data of the quantity of interest (QoI) and its gradients with different fidelity levels, namely, it is a…

Computational Engineering, Finance, and Science · Computer Science 2020-12-30 Yixiang Deng , Guang Lin , Xiu Yang

Multi-fidelity models are of great importance due to their capability of fusing information coming from different numerical simulations, surrogates, and sensors. We focus on the approximation of high-dimensional scalar functions with low…

Numerical Analysis · Mathematics 2023-09-13 Francesco Romor , Marco Tezzele , Markus Mrosek , Carsten Othmer , Gianluigi Rozza

Multivariate conformal prediction requires nonconformity scores that compress residual vectors into scalars while preserving certain implicit geometric structure of the residual distribution. We introduce a Multivariate Kernel Score (MKS)…

Machine Learning · Statistics 2026-04-24 Louis Meyer , Wenkai Xu

Gaussian processes are a fully Bayesian smoothing technique that allows for the reconstruction of a function and its derivatives directly from observational data, without assuming a specific model or choosing a parameterization. This is…

Cosmology and Nongalactic Astrophysics · Physics 2013-11-27 Marina Seikel , Chris Clarkson

Gaussian Processes (GP) have become popular machine-learning methods for kernel-based learning on datasets with complicated covariance structures. In this paper, we present a novel extension to the GP framework using a contaminated normal…

Machine Learning · Computer Science 2024-07-03 Daniel Iong , Matthew McAnear , Yuezhou Qu , Shasha Zou , Gabor Toth , Yang Chen

These days we live in a world with a permanent electromagnetic field. This raises many questions about our health and the deployment of new equipment. The problem is that these fields remain difficult to visualize easily, which only some…

Signal Processing · Electrical Eng. & Systems 2022-03-04 Angesom Ataklity Tesfay , Laurent Clavier

Gaussian processes (GPs) are a class of Kernel methods that have shown to be very useful in geoscience and remote sensing applications for parameter retrieval, model inversion, and emulation. They are widely used because they are simple,…

Machine Learning · Computer Science 2020-05-21 J. Emmanuel Johnson , Valero Laparra , Gustau Camps-Valls

Gaussian processes are a widely embraced technique for regression and classification due to their good prediction accuracy, analytical tractability and built-in capabilities for uncertainty quantification. However, they suffer from the…

Optimization and Control · Mathematics 2024-02-07 Mickael Binois , Victor Picheny

In this work, we present a novel nonlocal nonlinear coarse grid approximation using a machine learning algorithm. We consider unsaturated and two-phase flow problems in heterogeneous and fractured porous media, where mathematical models are…

Numerical Analysis · Mathematics 2020-04-22 Maria Vasilyeva , Wing T. Leung , Eric T. Chung , Yalchin Efendiev , Mary Wheeler

Iterative methods for fitting a Gaussian Random Field (GRF) model via maximum likelihood (ML) estimation requires solving a nonconvex optimization problem. The problem is aggravated for anisotropic GRFs where the number of covariance…

Machine Learning · Statistics 2021-01-12 Sam Davanloo Tajbakhsh , Necdet Serhat Aybat , Enrique Del Castillo

Heteroscedastic regression models a Gaussian variable's mean and variance as a function of covariates. Parametric methods that employ neural networks for these parameter maps can capture complex relationships in the data. Yet, optimizing…

Machine Learning · Computer Science 2022-12-20 Andrew Stirn , Hans-Hermann Wessels , Megan Schertzer , Laura Pereira , Neville E. Sanjana , David A. Knowles

We propose a new modeling framework for highly-multivariate spatial processes that synthesizes ideas from recent multiscale and spectral approaches with graphical models. The basis graphical lasso writes a univariate Gaussian process as a…

Methodology · Statistics 2024-07-08 Mitchell Krock , William Kleiber , Dorit Hammerling , Stephen Becker

In Bayesian nonparametric models, Gaussian processes provide a popular prior choice for regression function estimation. Existing literature on the theoretical investigation of the resulting posterior distribution almost exclusively assume a…

Statistics Theory · Mathematics 2015-03-06 Debdeep Pati , Anirban Bhattacharya , Guang Cheng

Inspired by recent advances in the field of expert-based approximations of Gaussian processes (GPs), we present an expert-based approach to large-scale multi-output regression using single-output GP experts. Employing a deeply structured…

Machine Learning · Computer Science 2021-08-03 Zhongjie Yu , Mingye Zhu , Martin Trapp , Arseny Skryagin , Kristian Kersting

Gaussian processes offer a flexible kernel method for regression. While Gaussian processes have many useful theoretical properties and have proven practically useful, they suffer from poor scaling in the number of observations. In…

Machine Learning · Statistics 2021-08-26 Nick Terry , Youngjun Choe

Deep Gaussian Processes (DGP) are hierarchical generalizations of Gaussian Processes (GP) that have proven to work effectively on a multiple supervised regression tasks. They combine the well calibrated uncertainty estimates of GPs with the…

Machine Learning · Statistics 2018-01-10 Marton Havasi , José Miguel Hernández-Lobato , Juan José Murillo-Fuentes

This paper develops a bias correction scheme for a multivariate normal model under a general parameterization. In the model, the mean vector and the covariance matrix share the same parameters. It includes many important regression models…

Methodology · Statistics 2009-05-06 Alexandre G. Patriota , Artur J. Lemonte

Gaussian processes (GPs) are Bayesian non-parametric models popular in a variety of applications due to their accuracy and native uncertainty quantification (UQ). Tuning GP hyperparameters is critical to ensure the validity of prediction…

Machine Learning · Computer Science 2022-11-03 Killian Wood , Alec M. Dunton , Amanda Muyskens , Benjamin W. Priest