English
Related papers

Related papers: On variance stabilisation by double Rao-Blackwelli…

200 papers

Exact Bayesian inference on state-space models~(SSM) is in general untractable, and unfortunately, basic Sequential Monte Carlo~(SMC) methods do not yield correct approximations for complex models. In this paper, we propose a mixed…

Machine Learning · Computer Science 2023-12-18 Waïss Azizian , Guillaume Baudart , Marc Lelarge

The multilevel Monte Carlo (MLMC) method has been used for a wide variety of stochastic applications. In this paper we consider its use in situations in which input random variables can be replaced by similar approximate random variables…

Numerical Analysis · Mathematics 2022-04-08 Mike Giles , Oliver Sheridan-Methven

In this review, we address the use of Monte Carlo methods for approximating definite integrals of the form $Z = \int L(x) d P(x)$, where $L$ is a target function (often a likelihood) and $P$ a finite measure. We present vertical-likelihood…

Computation · Statistics 2015-06-24 Nicholas G. Polson , James G. Scott

We introduce a modification of the well-known Metropolis importance sampling algorithm by using a methodology inspired on the consideration of the reparametrization invariance of the microcanonical ensemble. The most important feature of…

Statistical Mechanics · Physics 2007-05-23 L. Velazquez , J. C. Castro Palacio

Importance sampling (IS) is a powerful Monte Carlo (MC) technique for approximating intractable integrals, for instance in Bayesian inference. The performance of IS relies heavily on the appropriate choice of the so-called proposal…

Computation · Statistics 2024-12-30 Ali Mousavi , Víctor Elvira

We introduce a new sufficient statistic for the population parameter vector by allowing for the sampling design to first be selected at random amongst a set of candidate sampling designs. In contrast to the traditional approach in survey…

Statistics Theory · Mathematics 2014-11-11 Kyle Vincent , Christopher S. Henry

Approximate Bayesian computation (ABC) methods can be used to sample from posterior distributions when the likelihood function is unavailable or intractable, as is often the case in biological systems. ABC methods suffer from inefficient…

Machine Learning · Statistics 2019-12-03 Charlie Rogers-Smith , Henri Pesonen , Samuel Kaski

An importance sampling approach for sampling copula models is introduced. We propose two algorithms that improve Monte Carlo estimators when the functional of interest depends mainly on the behaviour of the underlying random vector when at…

Computation · Statistics 2015-04-08 Philipp Arbenz , Mathieu Cambou , Marius Hofert

We present a general approach to greatly increase at little cost the efficiency of Monte Carlo algorithms. To each observable to be computed we associate a renormalized observable (improved estimator) having the same average but a different…

Statistical Mechanics · Physics 2009-10-31 Roland Assaraf , Michel Caffarel

In this paper, we suggest a novel sampling method for Monte Carlo molecular simulations. In order to perform efficient sampling of molecular systems, it is advantageous to avoid extremely high energy configurations while also retaining the…

Computational Physics · Physics 2019-07-18 Katsuhiro Endo , Daisuke Yuhara , Kenji Yasuoka

Markov chain Monte Carlo algorithms are used to simulate from complex statistical distributions by way of a local exploration of these distributions. This local feature avoids heavy requests on understanding the nature of the target, but it…

Computation · Statistics 2018-04-12 Christian P. Robert , Victor Elvira , Nick Tawn , Changye Wu

Monte Carlo methods are widely used importance sampling techniques for studying complex physical systems. Integrating these methods with deep learning has significantly improved efficiency and accuracy in high-dimensional problems and…

Disordered Systems and Neural Networks · Physics 2024-12-24 Yixiong Ren , Jianhui Zhou

We propose a modification, based on the RESTART (repetitive simulation trials after reaching thresholds) and DPR (dynamics probability redistribution) rare event simulation algorithms, of the standard diffusion Monte Carlo (DMC) algorithm.…

Probability · Mathematics 2014-04-10 Martin Hairer , Jonathan Weare

Population Monte Carlo simulations in the form commonly referred to as population annealing can serve as a useful meta-algorithm for simulating systems with complex free-energy landscapes. In the present paper we provide an easily…

Statistical Mechanics · Physics 2024-01-17 P. L. Ebert , D. Gessert , W. Janke , M. Weigel

We propose a weighting scheme for the proposals within Markov chain Monte Carlo algorithms and show how this can improve statistical efficiency at no extra computational cost. These methods are most powerful when combined with…

Computation · Statistics 2015-07-01 Espen Bernton , Shihao Yang , Yang Chen , Neil Shephard , Jun S. Liu

Monte Carlo simulations are widely used in many areas including particle accelerators. In this lecture, after a short introduction and reviewing of some statistical backgrounds, we will discuss methods such as direct inversion, rejection…

Computational Physics · Physics 2020-06-19 Ji Qiang

Rao-Blackwellization is a notion often occurring in the MCMC literature, with possibly different meanings and connections with the original Rao--Blackwell theorem (Rao, 1945 and Blackwell,1947), including a reduction of the variance of the…

Computation · Statistics 2021-01-05 Christian P. Robert , Gareth O. Roberts

We introduce overdispersed black-box variational inference, a method to reduce the variance of the Monte Carlo estimator of the gradient in black-box variational inference. Instead of taking samples from the variational distribution, we use…

Machine Learning · Statistics 2016-03-04 Francisco J. R. Ruiz , Michalis K. Titsias , David M. Blei

The Monte Carlo algorithm is increasingly utilized, with its central step involving computer-based random sampling from stochastic models. While both Markov Chain Monte Carlo (MCMC) and Reject Monte Carlo serve as sampling methods, the…

Computation · Statistics 2024-02-28 Fengyu Li , Huijiao Yu , Jun Yan , Xianyong Meng

Parallel tempering and population annealing are both effective methods for simulating equilibrium systems with rough free energy landscapes. Parallel tempering, also known as replica exchange Monte Carlo, is a Markov chain Monte Carlo…

Statistical Mechanics · Physics 2011-09-05 Jon Machta , Richard S. Ellis