English
Related papers

Related papers: Nested Multilevel Monte Carlo with Biased and Anti…

200 papers

Multilevel Monte Carlo (MLMC) and unbiased estimators recently proposed by McLeish (Monte Carlo Methods Appl., 2011) and Rhee and Glynn (Oper. Res., 2015) are closely related. This connection is elaborated by presenting a new general class…

Computation · Statistics 2017-05-12 Matti Vihola

We study stochastic gradient descent for solving conditional stochastic optimization problems, in which an objective to be minimized is given by a parametric nested expectation with an outer expectation taken with respect to one random…

Numerical Analysis · Mathematics 2023-04-28 Takashi Goda , Wataru Kitade

In this article we consider computing expectations w.r.t.~probability laws associated to a certain class of stochastic systems. In order to achieve such a task, one must not only resort to numerical approximation of the expectation, but…

Computation · Statistics 2017-10-30 Ajay Jasra , Kengo Kamatani , Kody Law , Yan Zhou

Uncertainty Quantification through Markov Chain Monte Carlo (MCMC) can be prohibitively expensive for target probability densities with expensive likelihood functions, for instance when the evaluation it involves solving a Partial…

Computation · Statistics 2020-12-11 Mikkel B. Lykkegaard , Grigorios Mingas , Robert Scheichl , Colin Fox , Tim J. Dodwell

An optimal experimental set-up maximizes the value of data for statistical inferences and predictions. The efficiency of strategies for finding optimal experimental set-ups is particularly important for experiments that are time-consuming…

Numerical Analysis · Mathematics 2020-02-04 Joakim Beck , Ben Mansour Dia , Luis F. R. Espath , Raul Tempone

In this article, we present a review of the recent developments on the topic of Multilevel Monte Carlo (MLMC) algorithm, in the paradigm of applications in financial engineering. We specifically focus on the recent studies conducted in two…

Computational Finance · Quantitative Finance 2022-09-30 Devang Sinha , Siddhartha P. Chakrabarty

In this paper we discuss the possibility of using multilevel Monte Carlo (MLMC) methods for weak approximation schemes. It turns out that by means of a simple coupling between consecutive time discretisation levels, one can achieve the same…

Computational Finance · Quantitative Finance 2014-10-07 Denis Belomestny , Tigran Nagapetyan

In this work, we propose a smart idea to couple importance sampling and Multilevel Monte Carlo (MLMC). We advocate a per level approach with as many importance sampling parameters as the number of levels, which enables us to compute the…

Probability · Mathematics 2017-07-10 Ahmed Kebaier , Jérôme Lelong

The multilevel Monte Carlo (MLMC) method is highly efficient for estimating expectations of a functional of a solution to a stochastic differential equation (SDE). However, MLMC estimators may be unstable and have a poor (noncanonical)…

Computational Finance · Quantitative Finance 2024-05-07 Christian Bayer , Chiheb Ben Hammouda , Raul Tempone

Many problems in machine learning and statistics involve nested expectations and thus do not permit conventional Monte Carlo (MC) estimation. For such problems, one must nest estimators, such that terms in an outer estimator themselves…

Computation · Statistics 2018-05-24 Tom Rainforth , Robert Cornish , Hongseok Yang , Andrew Warrington , Frank Wood

Inverse uncertainty quantification (UQ) tasks such as parameter estimation are computationally demanding whenever dealing with physics-based models, and typically require repeated evaluations of complex numerical solvers. When partial…

Machine Learning · Computer Science 2025-12-19 Filippo Zacchei , Paolo Conti , Attilio Alberto Frangi , Andrea Manzoni

The Multilevel Monte Carlo (MLMC) method has proven to be an effective variance-reduction statistical method for Uncertainty Quantification (UQ) in Partial Differential Equation (PDE) models, combining model computations at different levels…

Mathematical Software · Computer Science 2023-05-24 Santiago Badia , Jerrad Hampton , Javier Principe

This paper addresses optimization problems constrained by partial differential equations with uncertain coefficients. In particular, the robust control problem and the average control problem are considered for a tracking type cost…

Optimization and Control · Mathematics 2017-11-08 Andreas Van Barel , Stefan Vandewalle

We propose a new unbiased estimator for estimating the utility of the optimal stopping problem. The MUSE, short for Multilevel Unbiased Stopping Estimator, constructs the unbiased Multilevel Monte Carlo (MLMC) estimator at every stage of…

Computation · Statistics 2022-12-29 Zhengqing Zhou , Guanyang Wang , Jose Blanchet , Peter W. Glynn

While multilevel Monte Carlo (MLMC) methods for the numerical approximation of partial differential equations with random coefficients enjoy great popularity, combinations with spatial adaptivity seem to be rare. We present an adaptive MLMC…

Numerical Analysis · Mathematics 2017-12-20 Ralf Kornhuber , Evgenia Youett

This work presents an efficient approach for accelerating multilevel Markov Chain Monte Carlo (MCMC) sampling for large-scale problems using low-fidelity machine learning models. While conventional techniques for large-scale Bayesian…

Machine Learning · Statistics 2024-05-21 Sohail Reddy , Hillary Fairbanks

We consider stochastic optimization when one only has access to biased stochastic oracles of the objective and the gradient, and obtaining stochastic gradients with low biases comes at high costs. This setting captures various optimization…

Optimization and Control · Mathematics 2024-08-22 Yifan Hu , Jie Wang , Xin Chen , Niao He

We design and implement a novel algorithm for computing a multilevel Monte Carlo (MLMC) estimator of the cumulative distribution function of a quantity of interest in problems with random input parameters or initial conditions. Our approach…

Numerical Analysis · Mathematics 2020-08-26 Søren Taverniers , Daniel M. Tartakovsky

Distributed learning methods have gained substantial momentum in recent years, with communication overhead often emerging as a critical bottleneck. Gradient compression techniques alleviate communication costs but involve an inherent…

Machine Learning · Computer Science 2025-07-09 Ze'ev Zukerman , Bassel Hamoud , Kfir Y. Levy

Stochastic optimization in learning and inference often relies on Markov chain Monte Carlo (MCMC) to approximate gradients when exact computation is intractable. However, finite-time MCMC estimators are biased, and reducing this bias…

Statistics Theory · Mathematics 2026-02-02 Antoine Godichon-Baggioni , Gabriel Lang , Sylvain Le Corff , Julien Stoehr , Sobihan Surendran