English
Related papers

Related papers: Multi-Fidelity Delayed Acceptance: hierarchical MC…

200 papers

Multi-fidelity modelling arises in many situations in computational science and engineering world. It enables accurate inference even when only a small set of accurate data is available. Those data often come from a high-fidelity model,…

Machine Learning · Statistics 2022-04-12 Jiahao Zhang , Shiqi Zhang , Guang Lin

This paper introduces a novel hierarchical Bayesian model specifically designed to address challenges in Inverse Uncertainty Quantification (IUQ) for time-dependent problems in nuclear Thermal Hydraulics (TH) systems. The unique…

Applications · Statistics 2024-03-27 Chen Wang

Reliable uncertainty estimation is crucial for machine learning models, especially in safety-critical domains. While exact Bayesian inference offers a principled approach, it is often computationally infeasible for deep neural networks.…

Machine Learning · Computer Science 2025-12-18 Aslak Djupskås , Alexander Johannes Stasik , Signe Riemer-Sørensen

Markov chain Monte Carlo (MCMC) methods have not been broadly adopted in Bayesian neural networks (BNNs). This paper initially reviews the main challenges in sampling from the parameter posterior of a neural network via MCMC. Such…

Machine Learning · Statistics 2021-10-05 Theodore Papamarkou , Jacob Hinkle , M. Todd Young , David Womble

Several multiscale methods account for sub-grid scale features using coarse scale basis functions. For example, in the Multiscale Finite Volume method the coarse scale basis functions are obtained by solving a set of local problems over…

Machine Learning · Computer Science 2017-11-15 Shing Chan , Ahmed H. Elsheikh

In Bayesian inverse problems sampling the posterior distribution is often a challenging task when the underlying models are computationally intensive. To this end, surrogates or reduced models are often used to accelerate the computation.…

Numerical Analysis · Mathematics 2019-09-04 Qifeng Liao , Jinglai Li

Traditional neural networks provide deterministic predictions without inherent uncertainty estimates. While Bayesian Neural Networks (BNNs) offer a principled approach to uncertainty quantification, their computational complexity limits…

Machine Learning · Statistics 2026-05-25 Rouaa Hoblos , Noura Dridi , Noureddine Zerhouni , Zeina Al Masry

The Markov Decision Process (MDP) is a popular framework for sequential decision-making problems, and uncertainty quantification is an essential component of it to learn optimal decision-making strategies. In particular, a Bayesian…

Machine Learning · Statistics 2025-05-06 Jiaqi Guo , Chon Wai Ho , Sumeetpal S. Singh

Statistical machine learning has widespread application in various domains. These methods include probabilistic algorithms, such as Markov Chain Monte-Carlo (MCMC), which rely on generating random numbers from probability distributions.…

Hardware Architecture · Computer Science 2021-08-03 Ramin Bashizade , Xiangyu Zhang , Sayan Mukherjee , Alvin R. Lebeck

While deep neural networks have become the go-to approach in computer vision, the vast majority of these models fail to properly capture the uncertainty inherent in their predictions. Estimating this predictive uncertainty can be crucial,…

Machine Learning · Computer Science 2020-04-08 Fredrik K. Gustafsson , Martin Danelljan , Thomas B. Schön

In nuclear reactor system design and safety analysis, the Best Estimate plus Uncertainty (BEPU) methodology requires that computer model output uncertainties must be quantified in order to prove that the investigated design stays within…

Computation · Statistics 2018-06-22 Xu Wu , Tomasz Kozlowski , Hadi Meidani , Koroush Shirvan

Uncertainty Quantification (UQ) is a booming discipline for complex computational models based on the analysis of robustness, reliability and credibility. UQ analysis for nonlinear crash models with high dimensional outputs presents…

Computational Engineering, Finance, and Science · Computer Science 2021-03-31 Marc Rocas , Alberto García-González , Xabier Larrayoz , Pedro Díez

Because of their robustness, efficiency and non-intrusiveness, Monte Carlo methods are probably the most popular approach in uncertainty quantification to computing expected values of quantities of interest (QoIs). Multilevel Monte Carlo…

Numerical Analysis · Mathematics 2022-04-12 Marcus J. Grote , Simon Michel , Fabio Nobile

In this paper we propose a general framework for the uncertainty quantification of quantities of interest for high-contrast single-phase flow problems. It is based on the generalized multiscale finite element method (GMsFEM) and multilevel…

Numerical Analysis · Mathematics 2015-06-18 Yalchin Efendiev , Bangti Jin , Michael Presho , Xiaosi Tan

Bayesian inference for models that have an intractable partition function is known as a doubly intractable problem, where standard Monte Carlo methods are not applicable. The past decade has seen the development of auxiliary variable Monte…

Computation · Statistics 2017-10-13 Richard G. Everitt , Dennis Prangle , Philip Maybank , Mark Bell

We present the Incremental Generative Monte Carlo (IGMC) method, designed to measure uncertainty in deep neural networks using deep generative approaches. IGMC iteratively trains generative models, adding their output to the dataset, to…

Machine Learning · Computer Science 2023-10-17 Yunsheng Zhang

Bayesian inference in the physical sciences faces a fundamental challenge: the imperative for high-fidelity physical modeling often clashes with the intrinsic limitations of stochastic sampling algorithms. Complex, high-dimensional…

Instrumentation and Methods for Astrophysics · Physics 2026-04-09 Bo Liang , Chang Liu , Hanlin Song , Tianyu Zhao , Minghui Du , He Wang , Haohao Gu , Sensen He , Yuxiang Xu , Wei-Liang Qian , Li-e Qiang , Peng Xu , Ziren Luo , Mingming Sun

Deep learning-based surrogate models have demonstrated remarkable advantages over classical solvers in terms of speed, often achieving speedups of 10 to 1000 times over traditional partial differential equation (PDE) solvers. However, a…

Machine Learning · Computer Science 2024-02-14 Tailin Wu , Willie Neiswanger , Hongtao Zheng , Stefano Ermon , Jure Leskovec

Inverse problems aim to determine model parameters of a mathematical problem from given observational data. Neural networks can provide an efficient tool to solve these problems. In the context of Bayesian inverse problems, Uncertainty…

Numerical Analysis · Mathematics 2025-09-16 Andrea Tonini , Tan Bui-Thanh , Francesco Regazzoni , Luca Dede' , Alfio Quarteroni

The Bayesian inversion method demonstrates significant potential for solving inverse problems, enabling both point estimation and uncertainty quantification (UQ). However, Bayesian maximum a posteriori (MAP) estimation may become unstable…

Numerical Analysis · Mathematics 2025-06-04 Ruibiao Song , Liying Zhang