English
Related papers

Related papers: Variance reduction for discretised diffusions via …

200 papers

We consider systems of stochastic differential equations with multiple scales and small noise and assume that the coefficients of the equations are ergodic and stationary random fields. Our goal is to construct provably-efficient importance…

Probability · Mathematics 2015-09-29 Konstantinos Spiliopoulos

We prove optimal error bounds for a second order in time finite element approximation of curve shortening flow in possibly higher codimension. In addition, we introduce a second order in time method for curve diffusion. Both schemes are…

Numerical Analysis · Mathematics 2026-01-29 Klaus Deckelnick , Robert Nürnberg

Sequential Monte Carlo methods, also known as particle methods, are a popular set of techniques for approximating high-dimensional probability distributions and their normalizing constants. These methods have found numerous applications in…

Computation · Statistics 2021-06-23 Jeremy Heng , Adrian N. Bishop , George Deligiannidis , Arnaud Doucet

Recently, rectified flow (RF)-based models have achieved state-of-the-art performance in many areas for both the multi-step and one-step generation. However, only a few theoretical works analyze the discretization complexity of RF-based…

Machine Learning · Computer Science 2025-08-13 Ruofeng Yang , Zhaoyu Zhu , Bo Jiang , Cheng Chen , Shuai Li

Gradients have been exploited in proposal distributions to accelerate the convergence of Markov chain Monte Carlo algorithms on discrete distributions. However, these methods require a natural differentiable extension of the target discrete…

Machine Learning · Computer Science 2023-02-28 Yue Xiang , Dongyao Zhu , Bowen Lei , Dongkuan Xu , Ruqi Zhang

Variational inference approximates the posterior distribution of a probabilistic model with a parameterized density by maximizing a lower bound for the model evidence. Modern solutions fit a flexible approximation with stochastic gradient…

Machine Learning · Statistics 2017-07-13 Joseph Sakaya , Arto Klami

Even in low dimensions, sampling from multi-modal distributions is challenging. We provide the first sampling algorithm for a broad class of distributions -- including all Gaussian mixtures -- with a query complexity that is polynomial in…

Computation · Statistics 2025-10-24 Adrien Vacher , Omar Chehab , Anna Korba

A reaction-diffusion problem with a Caputo time derivative is considered. An integral discretization scheme on a graded mesh along with a decomposition of the exact solution is proposed. The truncation error estimate of the discretization…

Numerical Analysis · Mathematics 2018-10-19 Zhongdi Cen , Jian Huang , Anbo Le , Aimin Xu

We propose a nonlinear Discrete Duality Finite Volume scheme to approximate the solutions of drift diffusion equations. The scheme is built to preserve at the discrete level even on severely distorted meshes the energy / energy dissipation…

Analysis of PDEs · Mathematics 2017-05-31 Clément Cancès , Claire Chainais-Hillairet , Stella Krell

We propose a fast stochastic Hamilton Monte Carlo (HMC) method, for sampling from a smooth and strongly log-concave distribution. At the core of our proposed method is a variance reduction technique inspired by the recent advance in…

Machine Learning · Statistics 2020-10-20 Difan Zou , Pan Xu , Quanquan Gu

Due to the complexity of order statistics, the finite sample behaviour of robust statistics is generally not analytically solvable. While the Monte Carlo method can provide approximate solutions, its convergence rate is typically very slow,…

Methodology · Statistics 2024-09-12 Li Tuobang

High-dimensional count data poses significant challenges for statistical analysis, necessitating effective methods that also preserve explainability. We focus on a low rank constrained variant of the Poisson log-normal model, which relates…

Optimization and Control · Mathematics 2025-06-17 Bastien Batardière , Julien Chiquet , Joon Kwon , Julien Stoehr

We give an introduction to discrete functional analysis techniques for stationary and transient diffusion equations. We show how these techniques are used to establish the convergence of various numerical schemes without assuming…

Numerical Analysis · Mathematics 2016-02-25 Jerome Droniou

Wavefunction correction scheme, which was developed as a variance reduction tool for the pure and fixed-node diffusion Monte Carlo (DMC) computations by Anderson and Freihaut, is applied to the DMC computations of fermions without using the…

Computational Physics · Physics 2010-03-29 Nazim Dugan , Inanc Kanik , Sakir Erkoc

Monte Carlo methods represent a cornerstone of computer science. They allow to sample high dimensional distribution functions in an efficient way. In this paper we consider the extension of Automatic Differentiation (AD) techniques to Monte…

High Energy Physics - Lattice · Physics 2023-07-31 Guilherme Catumba , Alberto Ramos , Bryan Zaldivar

In this paper, we study the problem of sampling from a given probability density function that is known to be smooth and strongly log-concave. We analyze several methods of approximate sampling based on discretizations of the (highly…

Statistics Theory · Mathematics 2024-02-26 Arnak S. Dalalyan , Avetik G. Karagulyan

Drawing a sample from a discrete distribution is one of the building components for Monte Carlo methods. Like other sampling algorithms, discrete sampling suffers from the high computational burden in large-scale inference problems. We…

Machine Learning · Statistics 2016-04-29 Yutian Chen , Zoubin Ghahramani

The order of convergence of the Monte Carlo method is 1/2 which means that we need quadruple samples to decrease the error in half in the numerical simulation. Multilevel Monte Carlo methods reach the same order of error by spending less…

Numerical Analysis · Mathematics 2015-02-27 Myoungnyoun Kim , Imbo Sim

The subdiffusion model that involves a Caputo fractional derivative in time is widely used to describe anomalously slow diffusion processes. In this work we aim at recovering the locations of small conductivity inclusions in the model from…

Numerical Analysis · Mathematics 2025-05-29 Jiho Hong , Bangti Jin , Zhizhang Wu

Learning in models with discrete latent variables is challenging due to high variance gradient estimators. Generally, approaches have relied on control variates to reduce the variance of the REINFORCE estimator. Recent work (Jang et al.…

Machine Learning · Computer Science 2017-11-07 George Tucker , Andriy Mnih , Chris J. Maddison , Dieterich Lawson , Jascha Sohl-Dickstein