English
Related papers

Related papers: Variance based sensitivity analysis for Monte Carl…

200 papers

We present a two-stage Metropolis-Hastings algorithm for sampling probabilistic models, whose log-likelihood is computationally expensive to evaluate, by using a surrogate Gaussian Process (GP) model. The key feature of the approach, and…

Machine Learning · Statistics 2021-09-29 Alessio Benavoli , Jason Wyse , Arthur White

Bayesian inference under a set of priors, called robust Bayesian analysis, allows for estimation of parameters within a model and quantification of epistemic uncertainty in quantities of interest by bounded (or imprecise) probability.…

Computation · Statistics 2022-07-15 Ivette Raices Cruz , Johan Lindström , Matthias C. M. Troffaes , Ullrika Sahlin

We propose a multi-fidelity neural network surrogate sampling method for the uncertainty quantification of physical/biological systems described by ordinary or partial differential equations. We first generate a set of low/high-fidelity…

Numerical Analysis · Mathematics 2020-05-07 Mohammad Motamed

Gaussian process regression is a popular Bayesian framework for surrogate modeling of expensive data sources. As part of a broader effort in scientific machine learning, many recent works have incorporated physical constraints or other a…

Machine Learning · Computer Science 2021-01-07 Laura Swiler , Mamikon Gulian , Ari Frankel , Cosmin Safta , John Jakeman

Variational inference approximates the posterior distribution of a probabilistic model with a parameterized density by maximizing a lower bound for the model evidence. Modern solutions fit a flexible approximation with stochastic gradient…

Machine Learning · Statistics 2017-07-13 Joseph Sakaya , Arto Klami

Kernel methods have revolutionized the fields of pattern recognition and machine learning. Their success, however, critically depends on the choice of kernel parameters. Using Gaussian process (GP) classification as a working example, this…

Methodology · Statistics 2014-05-27 Maurizio Filippone

In this paper, we introduce a probabilistic approach to risk assessment of robot systems by focusing on the impact of uncertainties. While various approaches to identifying systematic hazards (e.g., bugs, design flaws, etc.) can be found in…

Robotics · Computer Science 2024-10-28 Woo-Jeong Baek , Tom P. Huck , Joschka Haas , Jonas Lewandrowski , Tamim Asfour , Torsten Kröger

Existing variance reduction techniques used in stochastic simulations for rare event analysis still require a substantial number of model evaluations to estimate small failure probabilities. In the context of complex, nonlinear finite…

Machine Learning · Computer Science 2025-08-04 Liuyun Xu , Seymour M. J. Spence

Bayesian inference remains one of the most important tool-kits for any scientist, but increasingly expensive likelihood functions are required for ever-more complex experiments, raising the cost of generating a Monte Carlo sample of the…

Machine Learning · Statistics 2023-05-31 Jesús Torrado , Nils Schöneberg , Jonas El Gammal

In this work we consider a class of uncertainty quantification problems where the system performance or reliability is characterized by a scalar parameter $y$. The performance parameter $y$ is random due to the presence of various sources…

Numerical Analysis · Mathematics 2016-07-20 Keyi Wu , Jinglai Li

The global sensitivity analysis of time-dependent processes requires history-aware approaches. We develop for that purpose a variance-based method that leverages the correlation structure of the problems under study and employs surrogate…

Computation · Statistics 2019-11-05 Alen Alexanderian , Pierre A. Gremaud , Ralph C. Smith

With the rapid development of modern technology, massive amounts of data with complex pattern are generated. Gaussian process models that can easily fit the non-linearity in data become more and more popular nowadays. It is often the case…

Applications · Statistics 2023-09-11 Zhiyong Hu , Dipak Dey

Adaptive importance sampling is a class of techniques for finding good proposal distributions for importance sampling. Often the proposal distributions are standard probability distributions whose parameters are adapted based on the…

Computation · Statistics 2021-03-10 Topi Paananen , Juho Piironen , Paul-Christian Bürkner , Aki Vehtari

In this paper, we propose a novel sequential data-driven method for dealing with equilibrium based chemical simulations, which can be seen as a specific machine learning approach called active learning. The underlying idea of our approach…

Machine Learning · Statistics 2024-01-26 Mary Savino , Céline Lévy-Leduc , Marc Leconte , Benoit Cochepin

Structural reliability methods aim at computing the probability of failure of systems with respect to some prescribed performance functions. In modern engineering such functions usually resort to running an expensive-to-evaluate…

Methodology · Statistics 2011-05-10 V. Dubourg , F. Deheeger , B. Sudret

Active learning methods for emulating complex computer models that rely on stationary Gaussian processes tend to produce design points that uniformly fill the entire experimental region, which can be wasteful for functions which vary only…

Methodology · Statistics 2025-07-16 Shangkun Wang , V. Roshan Joseph

Estimating the probability of failure for complex real-world systems using high-fidelity computational models is often prohibitively expensive, especially when the probability is small. Exploiting low-fidelity models can make this process…

The formulation of Bayesian inverse problems involves choosing prior distributions; choices that seem equally reasonable may lead to significantly different conclusions. We develop a computational approach to better understand the impact of…

Computation · Statistics 2026-01-08 John E. Darges , Alen Alexanderian , Pierre A. Gremaud

A popular strategy for active learning is to specifically target a reduction in epistemic uncertainty, since aleatoric uncertainty is often considered as being intrinsic to the system of interest and therefore not reducible. Yet,…

Methodology · Statistics 2024-12-12 Jake Thomas , Jeremie Houssineau

In science and engineering, we often work with models designed for accurate prediction of variables of interest. Recognizing that these models are approximations of reality, it becomes desirable to apply multiple models to the same data and…

Machine Learning · Computer Science 2024-04-03 Marzieh Ajirak , Daniel Waxman , Fernando Llorente , Petar M. Djuric