English
Related papers

Related papers: Uncertainty Quantification in Data-Driven Inverse …

200 papers

We derive an efficient stochastic algorithm for inverse problems that present an unknown linear forcing term and a set of nonlinear parameters to be recovered. It is assumed that the data is noisy and that the linear part of the problem is…

Numerical Analysis · Mathematics 2019-09-17 Darko Volkov

Bayesian inference can quantify uncertainty in the predictions of neural networks using posterior distributions for model parameters and network output. By looking at these posterior distributions, one can separate the origin of uncertainty…

Machine Learning · Computer Science 2023-11-23 H. Linander , O. Balabanov , H. Yang , B. Mehlig

We consider optimal experimental design (OED) for Bayesian nonlinear inverse problems governed by partial differential equations (PDEs) under model uncertainty. Specifically, we consider inverse problems in which, in addition to the…

Numerical Analysis · Mathematics 2024-07-03 Alen Alexanderian , Ruanui Nicholson , Noemi Petra

The Markov Decision Process (MDP) is a popular framework for sequential decision-making problems, and uncertainty quantification is an essential component of it to learn optimal decision-making strategies. In particular, a Bayesian…

Machine Learning · Statistics 2025-05-06 Jiaqi Guo , Chon Wai Ho , Sumeetpal S. Singh

Learning robot controllers by minimizing a black-box objective cost using Bayesian optimization (BO) can be time-consuming and challenging. It is very often the case that some roll-outs result in failure behaviors, causing premature…

Machine Learning · Computer Science 2020-11-11 Alonso Marco , Dominik Baumann , Philipp Hennig , Sebastian Trimpe

Bayesian methods have been very successful in quantifying uncertainty in physics-based problems in parameter estimation and prediction. In these cases, physical measurements y are modeled as the best fit of a physics-based model…

Data Analysis, Statistics and Probability · Physics 2015-02-06 Dave Higdon , Jordan D. McDonnell , Nicolas Schunck , Jason Sarich , Stefan M. Wild

Bayesian inference is often utilized for uncertainty quantification tasks. A recent analysis by Xu and Raginsky 2022 rigorously decomposed the predictive uncertainty in Bayesian inference into two uncertainties, called aleatoric and…

Machine Learning · Statistics 2023-07-25 Futoshi Futami , Tomoharu Iwata

Stochastic spectral methods have become a popular technique to quantify the uncertainties of nano-scale devices and circuits. They are much more efficient than Monte Carlo for certain design cases with a small number of random parameters.…

Computational Engineering, Finance, and Science · Computer Science 2016-03-22 Zheng Zhang , Tsui-Wei Weng , Luca Daniel

AIMS. The maximum-likelihood method is the standard approach to obtain model fits to observational data and the corresponding confidence regions. We investigate possible sources of bias in the log-likelihood function and its subsequent…

Astrophysics · Physics 2009-11-11 J. Hartlap , P. Simon , P. Schneider

In this work, we investigate the use of Besov priors in the context of Bayesian inverse problems. The solution to Bayesian inverse problems is the posterior distribution which naturally enables us to interpret the uncertainties. Besov…

Numerical Analysis · Mathematics 2025-06-23 Andreas Horst , Babak Maboudi Afkham , Yiqiu Dong , Jakob Lemvig

We introduce a computational efficient data-driven framework suitable for quantifying the uncertainty in physical parameters and model formulation of computer models, represented by differential equations. We construct physics-informed…

Machine Learning · Statistics 2023-02-01 Michail Spitieris , Ingelin Steinsland

A framework is presented for fitting inverse problem models via variational Bayes approximations. This methodology guarantees flexibility to statistical model specification for a broad range of applications, good accuracy and reduced model…

Methodology · Statistics 2024-09-05 Luca Maestrini , Robert G. Aykroyd , Matt P. Wand

Optimization of complex functions, such as the output of computer simulators, is a difficult task that has received much attention in the literature. A less studied problem is that of optimization under unknown constraints, i.e., when the…

Methodology · Statistics 2010-07-06 Robert B. Gramacy , Herbert K. H. Lee

A framework for robust optimization under uncertainty based on the use of the generalized inverse distribution function (GIDF), also called quantile function, is here proposed. Compared to more classical approaches that rely on the usage of…

Optimization and Control · Mathematics 2014-07-18 Domenico Quagliarella , Giovanni Petrone , Gianluca Iaccarino

There are various measures of predictive uncertainty in the literature, but their relationships to each other remain unclear. This paper uses a decomposition of statistical pointwise risk into components, associated with different sources…

Machine Learning · Statistics 2025-02-18 Nikita Kotelevskii , Vladimir Kondratyev , Martin Takáč , Éric Moulines , Maxim Panov

We consider the problem of uncertainty estimation in the context of (non-Bayesian) deep neural classification. In this context, all known methods are based on extracting uncertainty signals from a trained network optimized to solve the…

Machine Learning · Computer Science 2019-04-25 Yonatan Geifman , Guy Uziel , Ran El-Yaniv

We propose a novel iterative algorithm for estimating a deterministic but unknown parameter vector in the presence of model uncertainties. This iterative algorithm is based on a system model where an overall noise term describes both, the…

Statistics Theory · Mathematics 2017-11-27 Oliver Lang , Michael Lunglmayr , Mario Huemer

In this work, we describe a new approach that uses variational encoder-decoder (VED) networks for efficient goal-oriented uncertainty quantification for inverse problems. Contrary to standard inverse problems, these approaches are…

Numerical Analysis · Mathematics 2023-10-02 Babak Maboudi Afkham , Julianne Chung , Matthias Chung

For linear inverse problems with a large number of unknown parameters, uncertainty quantification remains a challenging task. In this work, we use Krylov subspace methods to approximate the posterior covariance matrix and describe efficient…

Numerical Analysis · Mathematics 2019-05-22 Arvind K. Saibaba , Julianne Chung , Katrina Petroske

Understanding the uncertainty of a neural network's (NN) predictions is essential for many purposes. The Bayesian framework provides a principled approach to this, however applying it to NNs is challenging due to large numbers of parameters…

Machine Learning · Statistics 2020-02-27 Tim Pearce , Felix Leibfried , Alexandra Brintrup , Mohamed Zaki , Andy Neely