English
Related papers

Related papers: Variance reduction for discretised diffusions via …

200 papers

Approximate inference in complex probabilistic models such as deep Gaussian processes requires the optimisation of doubly stochastic objective functions. These objectives incorporate randomness both from mini-batch subsampling of the data…

Machine Learning · Statistics 2020-03-26 Ayman Boustati , Sattar Vakili , James Hensman , ST John

We briefly review the principles, mathematical bases, numerical shortcuts and applications of fast random walk (FRW) algorithms. This Monte Carlo technique allows one to simulate individual trajectories of diffusing particles in order to…

Computational Physics · Physics 2013-05-01 Denis Grebenkov

This work is motivated by the need to develop efficient tools for uncertainty quantification in subsurface flows associated with radioactive waste disposal studies. We consider single phase flow problems in random porous media described by…

Numerical Analysis · Mathematics 2013-12-23 Ivan G. Graham , Robert Scheichl , Elisabeth Ullmann

In this paper, we propose high order numerical methods to solve a 2D advection diffusion equation, in the highly oscillatory regime. We use an integrator strategy that allows the construction of arbitrary high-order schemes {leading} to an…

Numerical Analysis · Mathematics 2024-11-11 Clarissa Astuto

Recently, we have proposed a new diffusive representation for fractional derivatives and, based on this representation, suggested an algorithm for their numerical computation. From the construction of the algorithm, it is immediately…

Numerical Analysis · Mathematics 2022-04-12 Kai Diethelm

In this paper, a method to exactly sample the trajectories of inverse subordinators (in the sense of the finite-dimensional distributions), jointly with the undershooting or overshooting process, is provided. The method applies to general…

Probability · Mathematics 2025-11-05 Ivan Biočić , Daniel E. Cedeño-Girón , Bruno Toaldo

Score-based models, trained with denoising score matching, are remarkably effective in generating high dimensional data. However, the high variance of their training objective hinders optimisation. We attempt to reduce it with a control…

Machine Learning · Computer Science 2024-08-23 Paul Jeha , Will Grathwohl , Michael Riis Andersen , Carl Henrik Ek , Jes Frellsen

In this paper we suggest a modification of the regression-based variance reduction approach recently proposed in Belomestny et al. This modification is based on the stratification technique and allows for a further significant variance…

Computational Finance · Quantitative Finance 2017-06-13 Denis Belomestny , Stefan Häfner , Mikhail Urusov

This paper provides a convergence analysis for generalized Hamiltonian Monte Carlo samplers, a family of Markov Chain Monte Carlo methods based on leapfrog integration of Hamiltonian dynamics and kinetic Langevin diffusion, that encompasses…

Probability · Mathematics 2024-05-14 Evan Camrud , Alain Durmus , Pierre Monmarché , Gabriel Stoltz

To ensure the discrete maximum principle or solution positivity in finite volume schemes, diffusive flux is sometimes discretized as a conical combination of finite differences. Such a combination may be impossible to construct along…

Computational Physics · Physics 2015-06-19 D. Vidović , M. Dotlić , M. Pušić , B. Pokorni

Variational inference in Bayesian deep learning often involves computing the gradient of an expectation that lacks a closed-form solution. In these cases, pathwise and score-function gradient estimators are the most common approaches. The…

Machine Learning · Statistics 2024-10-10 Kenyon Ng , Susan Wei

Based on the central limit theorem, we discuss the problem of evaluation of the statistical error of Monte Carlo calculations using a time discretized diffusion process. We present a robust and practical method to determine the effective…

Computational Physics · Physics 2017-02-22 François Delyon , Bernard Bernu , Markus Holzmann

Control variates are variance reduction tools for Monte Carlo estimators. They can provide significant variance reduction, but usually require a large number of samples, which can be prohibitive when sampling or evaluating the integrand is…

Methodology · Statistics 2023-06-08 Zhuo Sun , Alessandro Barp , François-Xavier Briol

We extend a recently developed method to solve semi-linear PDEs to the case of a degenerated diffusion. Being a pure Monte Carlo method it does not suffer from the so called curse of dimensionality and it can be used to solve problems that…

Probability · Mathematics 2018-05-15 Xavier Warin

We study the large deviations principle for locally periodic stochastic differential equations with small noise and fast oscillating coefficients. There are three possible regimes depending on how fast the intensity of the noise goes to…

Probability · Mathematics 2012-04-05 Paul Dupuis , Konstantinos Spiliopoulos

In this paper, a Monte Carlo based approach for the quantification of the importance of the scattering input parameters with respect to the failure probability is presented. Using the basic idea of the alpha-factors of the First Order…

Computation · Statistics 2024-08-14 Thomas Most

In this paper, we aim to study the diffusion approximation for multi-scale McKean-Vlasov stochastic differential equations. More precisely, we prove the weak convergence of slow process $X^\varepsilon$ in $C([0,T];\mathbb{R}^n)$ towards the…

Probability · Mathematics 2022-06-07 Wei Hong , Shihu Li , Xiaobin Sun

We propose a novel approach to analyze generalization error for discretizations of Langevin diffusion, such as the stochastic gradient Langevin dynamics (SGLD). For an $\epsilon$ tolerance of expected generalization error, it is known that…

Machine Learning · Statistics 2021-02-15 Mufan Bill Li , Maxime Gazeau

Discretizations of Langevin diffusions provide a powerful method for sampling and Bayesian inference. However, such discretizations require evaluation of the gradient of the potential function. In several real-world scenarios, obtaining…

Statistics Theory · Mathematics 2021-01-19 Abhishek Roy , Lingqing Shen , Krishnakumar Balasubramanian , Saeed Ghadimi

We describe and analyze a variance reduction approach for Monte Carlo (MC) sampling that accelerates the estimation of statistics of computationally expensive simulation models using an ensemble of models with lower cost. These lower cost…

Computation · Statistics 2021-05-04 Alex A. Gorodetsky , Gianluca Geraci , Mike Eldred , John D. Jakeman