English
Related papers

Related papers: Estimation and model errors in Gaussian-process-ba…

200 papers

Global sensitivity analysis of complex numerical models can be performed by calculating variance-based importance measures of the input variables, such as the Sobol indices. However, these techniques, requiring a large number of model…

Methodology · Statistics 2008-02-08 Amandine Marrel , Bertrand Iooss , Beatrice Laurent , Olivier Roustant

We introduce a stochastic variational inference procedure for training scalable Gaussian process (GP) models whose per-iteration complexity is independent of both the number of training points, $n$, and the number basis functions used in…

Machine Learning · Statistics 2020-06-05 Trefor W. Evans , Prasanth B. Nair

Gaussian processes (GPs) are a powerful tool for probabilistic inference over functions. They have been applied to both regression and non-linear dimensionality reduction, and offer desirable properties such as uncertainty estimates,…

Machine Learning · Statistics 2014-10-01 Yarin Gal , Mark van der Wilk , Carl E. Rasmussen

Gaussian Processes (GPs) can be used as flexible, non-parametric function priors. Inspired by the growing body of work on Normalizing Flows, we enlarge this class of priors through a parametric invertible transformation that can be made…

Machine Learning · Computer Science 2021-02-26 Juan Maroñas , Oliver Hamelijnck , Jeremias Knoblauch , Theodoros Damoulas

Stochastic processes are often represented through orthonormal series expansions, a framework originating in the classical works of Lo\`eve and Karhunen and widely used for simulation and numerical approximation. While truncation error in…

Statistics Theory · Mathematics 2026-03-30 Oleksandr Mokliachuk

Gaussian processes (GPs) are widely used as distributions of random effects in linear mixed models, which are fit using the restricted likelihood or the closely-related Bayesian analysis. This article addresses two problems. First, we…

Methodology · Statistics 2018-05-04 Maitreyee Bose , James S. Hodges , Sudipto Banerjee

Global sensitivity analysis of complex numerical simulators is often limited by the small number of model evaluations that can be afforded. In such settings, surrogate models built from a limited set of simulations can substantially reduce…

Machine Learning · Statistics 2026-01-21 Guerlain Lambert , Céline Helbert , Claire Lauvernet

The combination of inducing point methods with stochastic variational inference has enabled approximate Gaussian Process (GP) inference on large datasets. Unfortunately, the resulting predictive distributions often exhibit substantially…

Machine Learning · Statistics 2020-12-29 Martin Jankowiak , Geoff Pleiss , Jacob R. Gardner

Although machine learning is increasingly applied in control approaches, only few methods guarantee certifiable safety, which is necessary for real world applications. These approaches typically rely on well-understood learning algorithms,…

Machine Learning · Computer Science 2020-06-16 Armin Lederer , Markus Kessler , Sandra Hirche

Gaussian Processes (GPs) are widely recognized as powerful non-parametric models for regression and classification. Traditional GP frameworks predominantly operate under the assumption that the inputs are either accurately known or subject…

Systems and Control · Electrical Eng. & Systems 2025-10-14 Muzaffar Qureshi , Tochukwu Elijah Ogri , Zachary I. Bell , Wanjiku A. Makumi , Rushikesh Kamalapurkar

Gaussian Process Regression (GPR) is a powerful tool for nonparametric regression, but its application in a fully Bayesian fashion in high-dimensional settings is hindered by two primary challenges: the difficulty of variable selection and…

Methodology · Statistics 2025-11-11 Peter Knaus

Global sensitivity analysis (GSA) of numerical simulators aims at studying the global impact of the input uncertainties on the output. To perform the GSA, statistical tools based on inputs/output dependence measures are commonly used. We…

Statistics Theory · Mathematics 2019-02-20 Anouar Meynaoui , Amandine Marrel , Béatrice Laurent

The Gaussian function (GF) is widely used to explain the behavior or statistical distribution of many natural phenomena as well as industrial processes in different disciplines of engineering and applied science. For example, the GF can be…

Signal Processing · Electrical Eng. & Systems 2020-01-08 Ibrahim Al-Nahhal , Octavia A. Dobre , Ertugrul Basar , Cecilia Moloney , Salama Ikki

Global sensitivity analysis aims at quantifying the impact of input variability onto the variation of the response of a computational model. It has been widely applied to deterministic simulators, for which a set of input parameters has a…

Computation · Statistics 2021-06-01 X. Zhu , B. Sudret

This paper proposes a statistical verification framework using Gaussian processes (GPs) for simulation-based verification of stochastic nonlinear systems with parametric uncertainties. Given a small number of stochastic simulations, the…

Systems and Control · Computer Science 2017-10-03 John F. Quindlen , Ufuk Topcu , Girish Chowdhary , Jonathan P. How

One-dimensional Poincare inequalities are used in Global Sensitivity Analysis (GSA) to provide derivative-based upper bounds and approximations of Sobol indices. We add new perspectives by investigating weighted Poincare inequalities. Our…

Probability · Mathematics 2024-12-09 David Heredia , Aldéric Joulin , Olivier Roustant

This paper presents an efficient surrogate modeling strategy for the uncertainty quantification and Bayesian calibration of a hydrological model. In particular, a process-based dynamical urban drainage simulator that predicts the discharge…

Computation · Statistics 2019-11-14 Joseph B. Nagel , Jörg Rieckermann , Bruno Sudret

Biomechanical models often need to describe very complex systems, organs or diseases, and hence also include a large number of parameters. One of the attractive features of physics-based models is that in those models (most) parameters have…

Computational Engineering, Finance, and Science · Computer Science 2023-01-10 Barbara Wirthl , Sebastian Brandstaeter , Jonas Nitzler , Bernhard A. Schrefler , Wolfgang A. Wall

Model uncertainty quantification is an essential component of effective data assimilation. Model errors associated with sub-grid scale processes are often represented through stochastic parameterizations of the unresolved process. Many…

Methodology · Statistics 2021-04-13 Sahani Pathiraja , Peter Jan van Leeuwen

We introduce a simple and scalable method for training Gaussian process (GP) models that exploits cross-validation and nearest neighbor truncation. To accommodate binary and multi-class classification we leverage P\`olya-Gamma auxiliary…

Machine Learning · Statistics 2022-03-10 Martin Jankowiak , Geoff Pleiss