English
Related papers

Related papers: Multilevel Monte Carlo methods for stochastic conv…

200 papers

Stochastic optimization in learning and inference often relies on Markov chain Monte Carlo (MCMC) to approximate gradients when exact computation is intractable. However, finite-time MCMC estimators are biased, and reducing this bias…

Statistics Theory · Mathematics 2026-02-02 Antoine Godichon-Baggioni , Gabriel Lang , Sylvain Le Corff , Julien Stoehr , Sobihan Surendran

We analyse a multilevel Monte Carlo method for the approximation of distribution functions of univariate random variables. Since, by assumption, the target distribution is not known explicitly, approximations have to be used. We provide an…

Probability · Mathematics 2017-06-22 Mike B. Giles , Tigran Nagapetyan , Klaus Ritter

For many complex simulation tasks spanning areas such as healthcare, engineering, and finance, Monte Carlo (MC) methods are invaluable due to their unbiased estimates and precise error quantification. Nevertheless, Monte Carlo simulations…

A first-order, Monte Carlo ensemble method has been recently introduced for solving parabolic equations with random coefficients in [26], which is a natural synthesis of the ensemble-based, Monte Carlo sampling algorithm and the…

Numerical Analysis · Mathematics 2018-02-19 Yan Luo , Zhu Wang

Quasi-Monte Carlo (QMC) method is a useful numerical tool for pricing and hedging of complex financial derivatives. These problems are usually of high dimensionality and discontinuities. The two factors may significantly deteriorate the…

Numerical Analysis · Mathematics 2019-02-27 Zhijian He , Xiaoqun Wang

We introduce a novel Multi-Order Monte Carlo approach for uncertainty quantification in the context of multiscale time-dependent partial differential equations. The new framework leverages Implicit-Explicit Runge-Kutta time integrators to…

Numerical Analysis · Mathematics 2026-04-08 Giulia Bertaglia , Walter Boscheri , Lorenzo Pareschi

This work presents self-rewarding sequential Monte Carlo (SMC), an inference-time scaling algorithm enabling effective sampling of masked diffusion language models (MDLMs). Our algorithm stems from the observation that most existing MDLMs…

Machine Learning · Computer Science 2026-02-03 Ziwei Luo , Ziqi Jin , Lei Wang , Lidong Bing , Thomas B. Schön

We investigate the problem of computing a nested expectation of the form $\mathbb{P}[\mathbb{E}[X|Y] \!\geq\!0]\!=\!\mathbb{E}[\textrm{H}(\mathbb{E}[X|Y])]$ where $\textrm{H}$ is the Heaviside function. This nested expectation appears, for…

Computational Finance · Quantitative Finance 2019-02-15 Michael B. Giles , Abdul-Lateef Haji-Ali

By adopting a Multilevel Monte Carlo (MLMC) framework, we show that only a handful of costly fine scale computations are needed to accurately estimate statistics of the failure of a composite structure, as opposed to the thousands typically…

Numerical Analysis · Mathematics 2019-07-25 T. J. Dodwell , S. Kinston , R. Butler , R. T. Haftka , Nam H. Kim , R. Scheichl

We propose and analyze a novel Multi-Index Monte Carlo (MIMC) method for weak approximation of stochastic models that are described in terms of differential equations either driven by random measures or with random coefficients. The MIMC…

Numerical Analysis · Mathematics 2015-03-26 Abdul-Lateef Haji-Ali , Fabio Nobile , Raul Tempone

We consider the problem of estimating expectations with respect to a target distribution with an unknown normalizing constant, and where even the unnormalized target needs to be approximated at finite resolution. This setting is ubiquitous…

Numerical Analysis · Mathematics 2023-03-23 Kody J. H. Law , Neil Walton , Shangda Yang , Ajay Jasra

Engineering problems are often characterized by significant uncertainty in their material parameters. A typical example coming from geotechnical engineering is the slope stability problem where the soil's cohesion is modeled as a random…

Numerical Analysis · Mathematics 2021-09-30 Philippe Blondeel , Pieterjan Robbe , Stijn François , Geert Lombaert , Stefan Vandewalle

This work describes a domain embedding technique between two non-matching meshes used for generating realizations of spatially correlated random fields with applications to large-scale sampling-based uncertainty quantification. The goal is…

Numerical Analysis · Mathematics 2017-12-20 Sarah Osborn , Patrick Zulian , Thomas Benson , Umberto Villa , Rolf Krause , Panayot S. Vassilevski

Microscopic processes on surfaces such as adsorption, desorption, diffusion and reaction of interacting particles can be simulated using kinetic Monte Carlo (kMC) algorithms. Even though kMC methods are accurate, they are computationally…

Mathematical Physics · Physics 2013-12-24 Yannis Pantazis , Markos Katsoulakis

Sampling from log-concave distributions is a well researched problem that has many applications in statistics and machine learning. We study the distributions of the form $p^{*}\propto\exp(-f(x))$, where…

Machine Learning · Computer Science 2019-09-13 Ruoqi Shen , Yin Tat Lee

We develop a novel Markov chain Monte Carlo (MCMC) method that exploits a hierarchy of models of increasing complexity to efficiently generate samples from an unnormalized target distribution. Broadly, the method rewrites the Multilevel…

Methodology · Statistics 2022-09-05 Mikkel B. Lykkegaard , Tim J. Dodwell , Colin Fox , Grigorios Mingas , Robert Scheichl

Efficient uncertainty quantification algorithms are key to understand the propagation of uncertainty -- from uncertain input parameters to uncertain output quantities -- in high resolution mathematical models of brain physiology. Advanced…

Computational Engineering, Finance, and Science · Computer Science 2023-01-10 Matteo Croci , Vegard Vinje , Marie E. Rognes

Computing risk measures of a financial portfolio comprising thousands of derivatives is a challenging problem because (a) it involves a nested expectation requiring multiple evaluations of the loss of the financial portfolio for different…

Mathematical Finance · Quantitative Finance 2023-01-10 Michael B. Giles , Abdul-Lateef Haji-Ali

The computational complexity of naive, sampling-based uncertainty quantification for 3D partial differential equations is extremely high. Multilevel approaches, such as multilevel Monte Carlo (MLMC), can reduce the complexity significantly,…

Computational Engineering, Finance, and Science · Computer Science 2016-07-13 Björn Gmeiner , Daniel Drzisga , Ulrich Ruede , Robert Scheichl , Barbara Wohlmuth

Recently, Stochastic Gradient Markov Chain Monte Carlo (SG-MCMC) methods have been proposed for scaling up Monte Carlo computations to large data problems. Whilst these approaches have proven useful in many applications, vanilla SG-MCMC…

Machine Learning · Statistics 2016-12-13 Umut Şimşekli , Roland Badeau , A. Taylan Cemgil , Gaël Richard