English
Related papers

Related papers: Multi-Fidelity Delayed Acceptance: hierarchical MC…

200 papers

Across many domains of science, stochastic models are an essential tool to understand the mechanisms underlying empirically observed data. Models can be of different levels of detail and accuracy, with models of high-fidelity (i.e., high…

In many computational problems, using the Markov Chain Monte Carlo (MCMC) can be prohibitively time-consuming. We propose MCMC-Net, a simple yet efficient way to accelerate MCMC via neural networks. The key idea of our approach is to…

Numerical Analysis · Mathematics 2025-09-16 Sudeb Majee , Anuj Abhishek , Thilo Strauss , Taufiquar Khan

Accept-reject based Markov chain Monte Carlo (MCMC) methods are the workhorse algorithm for Bayesian inference. These algorithms, like Metropolis-Hastings, require choosing a proposal distribution which is typically informed by the desired…

Computation · Statistics 2026-04-21 Dwija Kakkad , Dootika Vats

In this paper, we present an adaptive algorithm to construct response surface approximations of high-fidelity models using a hierarchy of lower fidelity models. Our algorithm is based on multi-index stochastic collocation and automatically…

Numerical Analysis · Mathematics 2021-05-04 John D. Jakeman , Michael Eldred , Gianluca Geraci , Alex Gorodetsky

Performing Bayesian inference via Markov chain Monte Carlo (MCMC) can be exceedingly expensive when posterior evaluations invoke the evaluation of a computationally expensive model, such as a system of partial differential equations. In…

Computation · Statistics 2017-12-27 Patrick Conrad , Andrew Davis , Youssef Marzouk , Natesh Pillai , Aaron Smith

Surrogate modeling is an essential data-driven technique for quantifying relationships between input variables and system responses in manufacturing and engineering systems. Two major challenges limit its effectiveness: (1) large data…

Machine Learning · Computer Science 2026-03-11 Manan Mehta , Zhiqiao Dong , Yuhang Yang , Chenhui Shao

In many situations across computational science and engineering, multiple computational models are available that describe a system of interest. These different models have varying evaluation costs and varying fidelities. Typically, a…

Numerical Analysis · Mathematics 2018-06-29 Benjamin Peherstorfer , Karen Willcox , Max Gunzburger

Uncertainty quantification (UQ) plays a pivotal role in scientific machine learning, especially when surrogate models are used to approximate complex systems. Although multilayer perceptions (MLPs) are commonly employed as surrogates, they…

Numerical Analysis · Mathematics 2025-01-22 Zhiwei Gao , George Em Karniadakis

Existing multilevel quasi-Monte Carlo (MLQMC) methods often rely on multiple independent randomizations of a low-discrepancy (LD) sequence to estimate statistical errors on each level. While this approach is standard, it can be less…

In this work, we propose a multi-agent actor-critic reinforcement learning (RL) algorithm to accelerate the multi-level Monte Carlo Markov Chain (MCMC) sampling algorithms. The policies (actors) of the agents are used to generate the…

Machine Learning · Computer Science 2020-11-19 Eric Chung , Yalchin Efendiev , Wing Tat Leung , Sai-Mang Pun , Zecheng Zhang

We propose a multilevel Markov chain Monte Carlo (MCMC) method for the Bayesian inference of random field parameters in PDEs using high-resolution data. Compared to existing multilevel MCMC methods, we additionally consider level-dependent…

Numerical Analysis · Mathematics 2025-08-19 Pieter Vanmechelen , Geert Lombaert , Giovanni Samaey

Inverse Uncertainty Quantification (UQ) is a process to quantify the uncertainties in random input parameters while achieving consistency between code simulations and physical observations. In this paper, we performed inverse UQ using an…

Applications · Statistics 2018-06-22 Xu Wu , Tomasz Kozlowski , Hadi Meidani , Koroush Shirvan

Deep neural networks (DNNs) have made a revolution in numerous fields during the last decade. However, in tasks with high safety requirements, such as medical or autonomous driving applications, providing an assessment of the models…

Machine Learning · Computer Science 2020-11-20 Omer Achrack , Raizy Kellerman , Ouriel Barzilay

This paper introduces a framework for speeding up Bayesian inference conducted in presence of large datasets. We design a Markov chain whose transition kernel uses an (unknown) fraction of (fixed size) of the available data that is randomly…

Methodology · Statistics 2018-06-01 Florian Maire , Nial Friel , Pierre Alquier

Deep learning (DL)-based methods have achieved state-of-the-art performance for many medical image segmentation tasks. Nevertheless, recent studies show that deep neural networks (DNNs) can be miscalibrated and overconfident, leading to…

Image and Video Processing · Electrical Eng. & Systems 2024-06-28 Yidong Zhao , Joao Tourais , Iain Pierce , Christian Nitsche , Thomas A. Treibel , Sebastian Weingärtner , Artur M. Schweidtmann , Qian Tao

Machine learning techniques typically rely on large datasets to create accurate classifiers. However, there are situations when data is scarce and expensive to acquire. This is the case of studies that rely on state-of-the-art computational…

Machine Learning · Computer Science 2019-10-02 Francisco Sahli Costabal , Paris Perdikaris , Ellen Kuhl , Daniel E. Hurtado

High-resolution simulation models are essential for representing complex physical systems, yet their substantial computational cost severely limits the number of feasible high-fidelity (HF) evaluations. This problem is often addressed…

Methodology · Statistics 2026-04-21 Hossein Mohammadi

Multilevel models (MLMs) are a central building block of the Bayesian workflow. They enable joint, interpretable modeling of data across hierarchical levels and provide a fully probabilistic quantification of uncertainty. Despite their…

Existing variance reduction techniques used in stochastic simulations for rare event analysis still require a substantial number of model evaluations to estimate small failure probabilities. In the context of complex, nonlinear finite…

Machine Learning · Computer Science 2025-08-04 Liuyun Xu , Seymour M. J. Spence

We address the numerical solution of infinite-dimensional inverse problems in the framework of Bayesian inference. In the Part I companion to this paper (arXiv.org:1308.1313), we considered the linearized infinite-dimensional inverse…

Methodology · Statistics 2014-04-14 Noemi Petra , James Martin , Georg Stadler , Omar Ghattas