English
Related papers

Related papers: Multi-scale variance reduction methods based on mu…

200 papers

Estimating risk measures such as large loss probabilities and Value-at-Risk is fundamental in financial risk management and often relies on computationally intensive nested Monte Carlo methods. While Multi-Level Monte Carlo (MLMC)…

Computational Finance · Quantitative Finance 2025-10-23 Alexandre Boumezoued , Adel Cherchali , Vincent Lemaire , Gilles Pagès , Mathieu Truc

The trace of a matrix function f(A), most notably of the matrix inverse, can be estimated stochastically using samples< x,f(A)x> if the components of the random vectors x obey an appropriate probability distribution. However such a…

Numerical Analysis · Mathematics 2021-08-26 Andreas Frommer , Mostafa Nasr Khalil , Gustavo Ramirez-Hidalgo

Variance reduction techniques have been shown by others in the past to be a useful tool to reduce variance in Simulation studies. However, their application and success in the past has been mainly domain specific, with relatively little…

Computational Engineering, Finance, and Science · Computer Science 2013-06-03 Adrian Adewunmi , Uwe Aickelin

In many real-world engineering systems, the performance or reliability of the system is characterised by a scalar parameter. The distribution of this performance parameter is important in many uncertainty quantification problems, ranging…

Methodology · Statistics 2022-10-03 Robert Millar , Jinglai Li , Hui Li

We propose a hierarchy of multi-level kinetic Monte Carlo methods for sampling high-dimensional, stochastic lattice particle dynamics with complex interactions. The method is based on the efficient coupling of different spatial resolution…

Numerical Analysis · Mathematics 2012-08-06 Evangelia Kalligiannaki , Markos A. Katsoulakis , Petr Plechac

We discuss kinetic-based particle optimization methods and variable-sample strategies for problems where the cost function represents the expected value of a random mapping. Kinetic-based optimization methods rely on a consensus mechanism…

Optimization and Control · Mathematics 2025-07-08 Sabrina Bonandin , Michael Herty

We propose a variance reduction framework for variational inference using the Multilevel Monte Carlo (MLMC) method. Our framework is built on reparameterized gradient estimators and "recycles" parameters obtained from past update history in…

Machine Learning · Statistics 2021-12-03 Masahiro Fujisawa , Issei Sato

In this paper, we present a multilevel Monte Carlo (MLMC) version of the Stochastic Gradient (SG) method for optimization under uncertainty, in order to tackle Optimal Control Problems (OCP) where the constraints are described in the form…

Optimization and Control · Mathematics 2019-12-30 Matthieu Martin , Fabio Nobile , Panagiotis Tsilifis

The kinetic Monte Carlo (kMC) method is used in many scientific fields in applications involving rare-event transitions. Due to its discrete stochastic nature, efforts to parallelize kMC approaches often produce unbalanced time evolutions…

Computational Physics · Physics 2017-01-04 Jerome P. Nilmeier , Jaime Marian

In the framework of uncertainty quantification, we consider a quantity of interest which depends non-smoothly on the high-dimensional parameter representing the uncertainty. We show that, in this situation, the multilevel Monte Carlo…

Numerical Analysis · Mathematics 2017-06-27 Laura Scarabosio

Block coordinate methods have been extensively studied for minimization problems, where they come with significant complexity improvements whenever the considered problems are compatible with block decomposition and, moreover, block…

Optimization and Control · Mathematics 2025-01-31 Jelena Diakonikolas

Safety in dynamic systems with prevalent uncertainties is crucial. Current robust safe controllers, designed primarily for uni-modal uncertainties, may be either overly conservative or unsafe when handling multi-modal uncertainties. To…

Robotics · Computer Science 2023-10-02 Tianhao Wei , Liqian Ma , Ravi Pandya , Changliu Liu

Robust controllers that stabilize dynamical systems even under disturbances and noise are often formulated as solutions of nonsmooth, nonconvex optimization problems. While methods such as gradient sampling can handle the nonconvexity and…

Optimization and Control · Mathematics 2023-05-01 Steffen W. R. Werner , Michael L. Overton , Benjamin Peherstorfer

Monte Carlo is a versatile and frequently used tool in statistical physics and beyond. Correspondingly, the number of algorithms and variants reported in the literature is vast, and an overview is not easy to achieve. In this pedagogical…

Statistical Mechanics · Physics 2010-01-04 Michael Kastner

Shapley values are among the most popular tools for explaining predictions of blackbox machine learning models. However, their high computational cost motivates the use of sampling approximations, inducing a considerable degree of…

Machine Learning · Statistics 2024-04-11 Jeremy Goldwasser , Giles Hooker

The multilevel Monte Carlo method is applied to an academic example in the field of electromagnetism. The method exhibits a reduced variance by assigning the samples to multiple models with a varying spatial resolution. For the given…

Computational Engineering, Finance, and Science · Computer Science 2017-09-26 Armin Galetzka , Zeger Bontinck , Ulrich Römer , Sebastian Schöps

We show that deliberately introducing a nested simulation stage can lead to significant variance reductions when comparing two stopping times by Monte Carlo. We derive the optimal number of nested simulations and prove that the algorithm is…

Computational Finance · Quantitative Finance 2014-02-04 Fabian Dickmann , Nikolaus Schweizer

In this paper we present an enhancement of the regression-based variance reduction approaches recently proposed in Belomestny et al. This enhancement is based on a truncation of the control variate and allows for a significant reduction of…

Probability · Mathematics 2017-11-10 Denis Belomestny , Stefan Häfner , Mikhail Urusov

A method for the multifidelity Monte Carlo (MFMC) estimation of statistical quantities is proposed which is applicable to computational budgets of any size. Based on a sequence of optimization problems each with a globally minimizing…

Numerical Analysis · Mathematics 2022-11-15 Anthony Gruber , Max Gunzburger , Lili Ju , Zhu Wang

The stochastic protein kinetic equations can be stiff for certain parameters, which makes their numerical simulation rely on very small time step sizes, resulting in large computational cost and accumulated round-off errors. For such…

Numerical Analysis · Mathematics 2014-11-14 Lijin Wang