English
Related papers

Related papers: Optimal uncertainty bounds for multivariate kernel…

200 papers

Uncertainty quantification is essential for scientific analysis, as it allows for the evaluation and interpretation of variability and reliability in complex systems and datasets. In their original form, multivariate statistical regression…

We study the Gaussian Process regression model in the context of training data with noise in both input and output. The presence of two sources of noise makes the task of learning accurate predictive models extremely challenging. However,…

Machine Learning · Statistics 2015-07-03 Cuong Tran , Vladimir Pavlovic , Robert Kopp

Explicit quantification of uncertainty in engineering simulations is being increasingly used to inform robust and reliable design practices. In the aerospace industry, computationally-feasible analyses for design optimization purposes often…

Fluid Dynamics · Physics 2019-11-13 Jayant Mukhopadhaya , Brian T. Whitehead , John F. Quindlen , Juan J. Alonso

Bayesian optimisation has gained great popularity as a tool for optimising the parameters of machine learning algorithms and models. Somewhat ironically, setting up the hyper-parameters of Bayesian optimisation methods is notoriously hard.…

Machine Learning · Statistics 2014-07-01 Ziyu Wang , Nando de Freitas

In this PhD thesis, we propose a novel framework for uncertainty quantification in machine learning, which is based on proper scores. Uncertainty quantification is an important cornerstone for trustworthy and reliable machine learning…

Machine Learning · Computer Science 2025-08-26 Sebastian G. Gruber

Challenges in multi-fidelity modeling relate to accuracy, uncertainty estimation and high-dimensionality. A novel additive structure is introduced in which the highest fidelity solution is written as a sum of the lowest fidelity solution…

Machine Learning · Computer Science 2021-04-09 Wei W. Xing , Akeel A. Shah , Peng Wang , Shandian Zhe Qian Fu , Robert. M. Kirby

This paper proposes a new formulation of functional Gaussian Process regression in manifolds, based on an Empirical Bayes approach, in the spatiotemporal random field context. We apply the machinery of tight Gaussian measures in separable…

Machine Learning · Statistics 2026-03-24 MD Ruiz-Medina , AE Madrid , A Torres-Signes , JM Angulo

We present a novel extension of multi-output Gaussian processes for handling heterogeneous outputs. We assume that each output has its own likelihood function and use a vector-valued Gaussian process prior to jointly model the parameters in…

Machine Learning · Statistics 2019-01-04 Pablo Moreno-Muñoz , Antonio Artés-Rodríguez , Mauricio A. Álvarez

In this work, we introduce a spatio-temporal kernel for Gaussian process (GP) regression-based sound field estimation. Notably, GPs have the attractive property that the sound field is a linear function of the measurements, allowing the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-08 David Sundström , Shoichi Koyama , Andreas Jakobsson

This paper is an attempt to bridge the conceptual gaps between researchers working on the two widely used approaches based on positive definite kernels: Bayesian learning or inference using Gaussian processes on the one side, and…

Machine Learning · Statistics 2018-07-10 Motonobu Kanagawa , Philipp Hennig , Dino Sejdinovic , Bharath K Sriperumbudur

One major impediment to the wider use of deep learning for clinical decision making is the difficulty of assigning a level of confidence to model predictions. Currently, deep Bayesian neural networks and sparse Gaussian processes are the…

Gaussian Process (GP) models provide a flexible framework for prediction and uncertainty quantification. For most covariance functions, however, exact GP prediction with $n$ points scales as $\mathcal{O}(n^3)$, making it prohibitively…

Computation · Statistics 2026-05-29 Samanyu Arora , Christopher J. Geoga

This paper extends a conventional, general framework for online adaptive estimation problems for systems governed by unknown nonlinear ordinary differential equations. The central feature of the theory introduced in this paper represents…

Systems and Control · Computer Science 2017-07-11 Parag Bobade , Suprotim Majumdar , Savio Pereira , Andrew J. Kurdila , John B. Ferris

In this paper, we study error bounds for {\em Bayesian quadrature} (BQ), with an emphasis on noisy settings, randomized algorithms, and average-case performance measures. We seek to approximate the integral of functions in a {\em…

Machine Learning · Statistics 2023-02-13 Xu Cai , Chi Thanh Lam , Jonathan Scarlett

A method to reconstruct fields, source strengths and physical parameters based on Gaussian process regression is presented for the case where data are known to fulfill a given linear differential equation with localized sources. The…

Data Analysis, Statistics and Probability · Physics 2019-09-10 Christopher G. Albert

We propose a probabilistic enhancement of standard kernel Support Vector Machines for binary classification, in order to address the case when, along with given data sets, a description of uncertainty (e.g., error bounds) may be available…

Machine Learning · Computer Science 2020-03-19 Yongxin Chen , Tryphon T. Georgiou , Allen R. Tannenbaum

Simulation of the crack network evolution on high strain rate impact experiments performed in brittle materials is very compute-intensive. The cost increases even more if multiple simulations are needed to account for the randomness in…

Operator-Valued Kernels (OVKs) and associated vector-valued Reproducing Kernel Hilbert Spaces provide an elegant way to extend scalar kernel methods when the output space is a Hilbert space. Although primarily used in finite dimension for…

Machine Learning · Statistics 2020-08-24 Pierre Laforgue , Alex Lambert , Luc Brogat-Motte , Florence d'Alché-Buc

We develop a computational procedure to estimate the covariance hyperparameters for semiparametric Gaussian process regression models with additive noise. Namely, the presented method can be used to efficiently estimate the variance of the…

Machine Learning · Computer Science 2022-06-22 Siavash Ameli , Shawn C. Shadden

Multi-fidelity methods are prominently used when cheaply-obtained, but possibly biased and noisy, observations must be effectively combined with limited or expensive true data in order to construct reliable models. This arises in both…

Machine Learning · Statistics 2019-03-19 Kurt Cutajar , Mark Pullin , Andreas Damianou , Neil Lawrence , Javier González