English
Related papers

Related papers: Variance reduction for diffusions

200 papers

We consider non-reversible perturbations of reversible diffusions that do not alter the invariant distribution and we ask whether there exists an optimal perturbation such that the rate of convergence to equilibrium is maximized. We solve…

Numerical Analysis · Mathematics 2015-06-12 Tony Lelièvre , Francis Nier , Grigorios A. Pavliotis

We introduce overdispersed black-box variational inference, a method to reduce the variance of the Monte Carlo estimator of the gradient in black-box variational inference. Instead of taking samples from the variational distribution, we use…

Machine Learning · Statistics 2016-03-04 Francisco J. R. Ruiz , Michalis K. Titsias , David M. Blei

A new methodology is presented for the construction of control variates to reduce the variance of additive functionals of Markov Chain Monte Carlo (MCMC) samplers. Our control variates are definedthrough the minimization of the asymptotic…

Methodology · Statistics 2019-07-09 Nicolas Brosse , Alain Durmus , Sean Meyn , Eric Moulines , Anand Radhakrishnan

We consider the solution to a stochastic differential equation with a drift function which depends smoothly on some real parameter $\lambda$, and admitting a unique invariant measure for any value of $\lambda$ around $\lambda$ = 0. Our aim…

Probability · Mathematics 2015-09-07 Roland Assaraf , Benjamin Jourdain , Tony Lelièvre , Raphaël Roux

Weighting methods are widely used to adjust for covariates in observational studies, sample surveys, and regression settings. In this paper, we study a class of recently proposed weighting methods which find the weights of minimum…

Methodology · Statistics 2019-10-29 Yixin Wang , José R. Zubizarreta

Reflected diffusions in polyhedral domains are commonly used as approximate models for stochastic processing networks in heavy traffic. Stationary distributions of such models give useful information on the steady state performance of the…

Probability · Mathematics 2012-05-24 Amarjit Budhiraja , Jiang Chen , Sylvain Rubenthaler

We develop a new Monte Carlo method that solves hyperbolic transport equations with stiff terms, characterized by a (small) scaling parameter. In particular, we focus on systems which lead to a reduced problem of parabolic type in the limit…

Numerical Analysis · Mathematics 2017-08-01 G. Dimarco , L. Pareschi , G. Samaey

By means of rather general arguments, based on an approach due to Derrida that makes use of samples of finite size, we analyse the effective diffusivity and drift tensors in certain types of random medium in which the motion of the…

Condensed Matter · Physics 2009-10-28 D S Dean , I T Drummond , R R Horgan

We prove a global asymptotic equivalence of experiments in the sense of Le Cam's theory. The experiments are a continuously observed diffusion with nonparametric drift and its Euler scheme. We focus on diffusions with nonconstant-known…

Statistics Theory · Mathematics 2014-06-24 Valentine Genon-Catalot , Catherine Larédo

Science and engineering problems subject to uncertainty are frequently both computationally expensive and feature nonsmooth parameter dependence, making standard Monte Carlo too slow, and excluding efficient use of accelerated uncertainty…

Numerical Analysis · Mathematics 2021-10-01 Per Pettersson , Sebastian Krumscheid

Markov Chain Monte Carlo inference of target posterior distributions in machine learning is predominately conducted via Hamiltonian Monte Carlo and its variants. This is due to Hamiltonian Monte Carlo based samplers ability to suppress…

Machine Learning · Statistics 2021-07-06 Wilson Tsakane Mongwe , Rendani Mbuvha , Tshilidzi Marwala

We propose a modification, based on the RESTART (repetitive simulation trials after reaching thresholds) and DPR (dynamics probability redistribution) rare event simulation algorithms, of the standard diffusion Monte Carlo (DMC) algorithm.…

Probability · Mathematics 2014-04-10 Martin Hairer , Jonathan Weare

Diffusion models, which convert noise into new data instances by learning to reverse a diffusion process, have become a cornerstone in contemporary generative modeling. In this work, we develop non-asymptotic convergence theory for a…

Machine Learning · Computer Science 2024-08-06 Gen Li , Yuting Wei , Yuejie Chi , Yuxin Chen

The efficiency of Monte Carlo samplers is dictated not only by energetic effects, such as large barriers, but also by entropic effects that are due to the sheer volume that is sampled. The latter effects appear in the form of an entropic…

Computational Physics · Physics 2009-11-13 Cristian Predescu

This paper considers inference for conditional moment inequality models using a multiscale statistic. We derive the asymptotic distribution of this test statistic and use the result to propose feasible critical values that have a simple…

Applications · Statistics 2015-12-10 Timothy B. Armstrong , Hock Peng Chan

Direct sampling of multi-dimensional systems with quantum Monte Carlo methods allows exact account of many-body effects or particle correlations. The most straightforward approach to solve the Schr\"odinger equation, Diffusion Monte Carlo,…

Quantum Physics · Physics 2017-09-07 Ilkka Ruokosenmäki , Tapio T. Rantala

The montecarlo method, which is quite commonly used to solve maximum entropy problems in statistical physics, can actually be used to solve inverse problems in a much wider context. The probability distribution which maximizes entropy can…

Statistical Mechanics · Physics 2007-05-23 Jan Naudts

Rerandomization is a strategy of increasing efficiency as compared to complete randomization. The idea with rerandomization is that of removing allocations with imbalance in the observed covariates and then randomizing within the set of…

Methodology · Statistics 2019-11-07 Junni L. Zhang , Per Johansson

This paper introduces a quasi-likelihood ratio testing procedure for diffusion processes observed under nonsynchronous sampling schemes. High-frequency data, particularly in financial econometrics, are often recorded at irregular time…

Statistics Theory · Mathematics 2025-03-25 Teppei Ogihara , Futo Ueno

Even in low dimensions, sampling from multi-modal distributions is challenging. We provide the first sampling algorithm for a broad class of distributions -- including all Gaussian mixtures -- with a query complexity that is polynomial in…

Computation · Statistics 2025-10-24 Adrien Vacher , Omar Chehab , Anna Korba