English
Related papers

Related papers: Multilevel Quasi-Monte Carlo for Optimization unde…

200 papers

This paper provides a framework in which multilevel Monte Carlo and continuous level Monte Carlo can be compared. In continuous level Monte Carlo the level of refinement is determined by an exponentially distributed random variable, which…

Numerical Analysis · Mathematics 2023-10-13 Cedric Aaron Beschle , Andrea Barth

Many machine learning problems involve Monte Carlo gradient estimators. As a prominent example, we focus on Monte Carlo variational inference (MCVI) in this paper. The performance of MCVI crucially depends on the variance of its stochastic…

Machine Learning · Statistics 2018-07-05 Alexander Buchholz , Florian Wenzel , Stephan Mandt

In this paper the application of the multi-level Monte Carlo (MLMC) method on numerical simulations of turbulent flows with uncertain parameters is investigated. Several strategies for setting up the MLMC method are presented, and the…

Computation · Statistics 2016-08-22 Qingsha Chen , Ju Ming

Many machine learning problems optimize an objective that must be measured with noise. The primary method is a first order stochastic gradient descent using one or more Monte Carlo (MC) samples at each step. There are settings where…

Machine Learning · Computer Science 2021-04-22 Sifan Liu , Art B. Owen

The subsurface flow is usually subject to uncertain porous media structures. In most cases, however, we only have partial knowledge about the porous media properties. A common approach is to model the uncertain parameters of porous media as…

Numerical Analysis · Mathematics 2019-10-11 Yang Liu , Jingfa Li , Shuyu Sun , Bo Yu

We consider the application of multilevel Monte Carlo methods to elliptic PDEs with random coefficients. We focus on models of the random coefficient that lack uniform ellipticity and boundedness with respect to the random parameter, and…

Numerical Analysis · Mathematics 2012-04-17 A. L. Teckentrup , R. Scheichl , M. B. Giles , E. Ullmann

While multilevel Monte Carlo (MLMC) methods for the numerical approximation of partial differential equations with random coefficients enjoy great popularity, combinations with spatial adaptivity seem to be rare. We present an adaptive MLMC…

Numerical Analysis · Mathematics 2017-12-20 Ralf Kornhuber , Evgenia Youett

This article considers the sequential Monte Carlo (SMC) approximation of ratios of normalizing constants associated to posterior distributions which in principle rely on continuum models. Therefore, the Monte Carlo estimation error and the…

Computation · Statistics 2016-03-04 Pierre Del Moral , Ajay Jasra , Kody Law , Yan Zhou

Quasi-Monte Carlo (QMC) methods for estimating integrals are attractive since the resulting estimators typically converge at a faster rate than pseudo-random Monte Carlo. However, they can be difficult to set up on arbitrary posterior…

Statistics Theory · Mathematics 2018-10-03 Tobias Schwedes , Ben Calderhead

Multilevel sampling methods, such as multilevel and multifidelity Monte Carlo, multilevel stochastic collocation, or delayed acceptance Markov chain Monte Carlo, have become standard uncertainty quantification (UQ) tools for a wide class of…

Numerical Analysis · Mathematics 2025-10-01 Josef Martínek , Erin Carson , Robert Scheichl

Practical structural engineering problems are often characterized by significant uncertainties. Historically, one of the prevalent methods to account for this uncertainty has been the standard Monte Carlo (MC) method. Recently, improved…

Numerical Analysis · Mathematics 2019-06-27 Philippe Blondeel , Pieterjan Robbe , Cédric van hoorickx , Geert Lombaert , Stefan Vandewalle

We propose a variance reduction framework for variational inference using the Multilevel Monte Carlo (MLMC) method. Our framework is built on reparameterized gradient estimators and "recycles" parameters obtained from past update history in…

Machine Learning · Statistics 2021-12-03 Masahiro Fujisawa , Issei Sato

Quasi-Monte Carlo (QMC) methods are applied to multi-level Finite Element (FE) discretizations of elliptic partial differential equations (PDEs) with a random coefficient, to estimate expected values of linear functionals of the solution.…

Numerical Analysis · Mathematics 2014-05-16 Frances Y. Kuo , Christoph Schwab , Ian H. Sloan

In a previous paper (J. Comp. Phys. 230 (2011), 3668--3694), the authors proposed a new practical method for computing expected values of functionals of solutions for certain classes of elliptic partial differential equations with random…

Numerical Analysis · Mathematics 2018-04-03 Ivan G. Graham , Frances Y. Kuo , Dirk Nuyens , Rob Scheichl , Ian H. Sloan

In this work, we consider the problem of estimating the probability distribution, the quantile or the conditional expectation above the quantile, the so called conditional-value-at-risk, of output quantities of complex random differential…

Computation · Statistics 2023-05-23 Quentin Ayoul-Guilmard , Sundar Ganesh , Sebastian Krumscheid , Fabio Nobile

In the stochastic gradient descent (SGD) for sequential simulations such as the neural stochastic differential equations, the Multilevel Monte Carlo (MLMC) method is known to offer better theoretical computational complexity compared to the…

Machine Learning · Computer Science 2023-10-11 Kei Ishikawa

Quasi-Monte Carlo sampling can attain far better accuracy than plain Monte Carlo sampling. However, with plain Monte Carlo sampling it is much easier to estimate the attained accuracy. This article describes methods old and new to quantify…

Numerical Analysis · Mathematics 2025-07-16 Art B. Owen

We present a multilevel Monte Carlo (MLMC) method for the uncertainty quantification of variably saturated porous media flow that are modeled using the Richards' equation. We propose a stochastic extension for the empirical models that are…

Numerical Analysis · Mathematics 2019-03-22 Prashant Kumar , Carmen Rodrigo , Francisco J. Gaspar , Cornelis W. Oosterlee

This study analyzes the nonasymptotic convergence behavior of the quasi-Monte Carlo (QMC) method with applications to linear elliptic partial differential equations (PDEs) with lognormal coefficients. Building upon the error analysis…

Numerical Analysis · Mathematics 2026-01-13 Yang Liu , Raúl Tempone

Uncertainty quantification (UQ) includes the characterization, integration, and propagation of uncertainties that result from stochastic variations and a lack of knowledge or data in the natural world. Monte Carlo (MC) method is a…

Methodology · Statistics 2020-11-03 Jiaxin Zhang