English
Related papers

Related papers: Multilevel Delayed Acceptance MCMC with an Adaptiv…

200 papers

Bayesian inverse problems arise in various scientific and engineering domains, and solving them can be computationally demanding. This is especially the case for problems governed by partial differential equations, where the repeated…

Numerical Analysis · Mathematics 2025-11-04 Juntao Yang , Jeff Adie , Simon See , Adriano Gualandi , Gianmarco Mengaldo

Machine learning has recently been widely adopted to address the managerial decision making problems, in which the decision maker needs to be able to interpret the contributions of individual attributes in an explicit form. However, there…

Machine Learning · Computer Science 2019-10-28 Mengzhuo Guo , Qingpeng Zhang , Xiuwu Liao , Frank Youhua Chen , Daniel Dajun Zeng

Estimating the difficulty of input questions as perceived by large language models (LLMs) is essential for accurate performance evaluation and adaptive inference. Existing methods typically rely on repeated response sampling, auxiliary…

Computation and Language · Computer Science 2025-09-17 Yubo Zhu , Dongrui Liu , Zecheng Lin , Wei Tong , Sheng Zhong , Jing Shao

We construct a new framework for accelerating Markov chain Monte Carlo in posterior sampling problems where standard methods are limited by the computational cost of the likelihood, or of numerical models embedded therein. Our approach…

Methodology · Statistics 2017-01-06 Patrick R. Conrad , Youssef M. Marzouk , Natesh S. Pillai , Aaron Smith

The task of estimating a matrix given a sample of observed entries is known as the \emph{matrix completion problem}. Most works on matrix completion have focused on recovering an unknown real-valued low-rank matrix from a random sample of…

Statistics Theory · Mathematics 2014-08-27 Olga Klopp , Jean Lafond , Eric Moulines , Joseph Salmon

In this work, we present, analyze, and implement a class of Multi-Level Markov chain Monte Carlo (ML-MCMC) algorithms based on independent Metropolis-Hastings proposals for Bayesian inverse problems. In this context, the likelihood function…

Numerical Analysis · Mathematics 2021-05-06 Juan Pablo Madrigal-Cianci , Fabio Nobile , Raul Tempone

Methods that bypass analytical evaluations of the likelihood function have become an indispensable tool for statistical inference in many fields of science. These so-called likelihood-free methods rely on accepting and rejecting simulations…

A statistical learning approach for parametric PDEs related to Uncertainty Quantification is derived. The method is based on the minimization of an empirical risk on a selected model class and it is shown to be applicable to a broad range…

Numerical Analysis · Mathematics 2020-01-07 Martin Eigel , Reinhold Schneider , Philipp Trunschke , Sebastian Wolf

In parameter estimation problems one computes a posterior distribution over uncertain parameters defined jointly by a prior distribution, a model, and noisy data. Markov Chain Monte Carlo (MCMC) is often used for the numerical solution of…

Numerical Analysis · Mathematics 2017-11-15 Matthias Morzfeld , Marcus S. Day , Ray W. Grout , George Shu Heng Pau , Stefan A. Finsterle , John B. Bell

A novel adaptive Markov chain Monte Carlo algorithm is presented. The algorithm utilizes sparsity in the partial correlation structure of a density to efficiently estimate the covariance matrix through the Cholesky factor of the precision…

Computation · Statistics 2016-02-09 Jonas Wallin , David Bolin

Markov chain Monte Carlo (MCMC) algorithms provide a very general recipe for estimating properties of complicated distributions. While their use has become commonplace and there is a large literature on MCMC theory and practice, MCMC users…

Computation · Statistics 2012-05-03 Murali Haran , Luke Tierney

In the field of computational finance, one is commonly interested in the expected value of a financial derivative whose payoff depends on the solution of stochastic differential equations (SDEs). For multi-dimensional SDEs with…

Numerical Analysis · Mathematics 2024-09-12 Chenxu Pang , Xiaojie Wang

This paper considers uncertainty quantification for an elliptic nonlocal equation. In particular, it is assumed that the parameters which define the kernel in the nonlocal operator are uncertain and a priori distributed according to a…

Computation · Statistics 2016-03-22 Ajay Jasra , Kody Law , Yan Zhou

Markov Chain Monte Carlo (MCMC) algorithms are standard approaches to solve imaging inverse problems and quantify estimation uncertainties, a key requirement in absence of ground-truth data. To improve estimation quality, Plug-and-Play MCMC…

Methodology · Statistics 2025-11-04 Maxime Bouton , Pierre-Antoine Thouvenin , Audrey Repetti , Pierre Chainais

Nested Monte Carlo is widely used for risk estimation, but its efficiency is limited by the discontinuity of the indicator function and high computational cost. This paper proposes a nested Multilevel Monte Carlo (MLMC) method combined with…

Numerical Analysis · Mathematics 2026-04-06 Yu Xu , Xiaoqun Wang

A simple and efficient adaptive Markov Chain Monte Carlo (MCMC) method, called the Metropolized Adaptive Subspace (MAdaSub) algorithm, is proposed for sampling from high-dimensional posterior model distributions in Bayesian variable…

Methodology · Statistics 2023-01-04 Christian Staerk , Maria Kateri , Ioannis Ntzoufras

In the following article we consider approximate Bayesian computation (ABC) inference. We introduce a method for numerically approximating ABC posteriors using the multilevel Monte Carlo (MLMC). A sequential Monte Carlo version of the…

Methodology · Statistics 2017-02-14 Ajay Jasra , Seongil Jo , David Nott , Christine Shoemaker , Raul Tempone

The multilevel Monte Carlo method is applied to an academic example in the field of electromagnetism. The method exhibits a reduced variance by assigning the samples to multiple models with a varying spatial resolution. For the given…

Computational Engineering, Finance, and Science · Computer Science 2017-09-26 Armin Galetzka , Zeger Bontinck , Ulrich Römer , Sebastian Schöps

Accurate estimates of long-term risk probabilities and their gradients are critical for many stochastic safe control methods. However, computing such risk probabilities in real-time and in unseen or changing environments is challenging.…

Systems and Control · Electrical Eng. & Systems 2024-08-20 Zhuoyuan Wang , Yorie Nakahira

Many scientific and engineering problems require to perform Bayesian inferences in function spaces, in which the unknowns are of infinite dimension. In such problems, many standard Markov Chain Monte Carlo (MCMC) algorithms become arbitrary…

Numerical Analysis · Mathematics 2016-04-12 Zhe Feng , Jinglai Li