English
Related papers

Related papers: Monte Carlo sampling with integrator snippets

200 papers

There is a tension between robustness and efficiency when designing Markov chain Monte Carlo (MCMC) sampling algorithms. Here we focus on robustness with respect to tuning parameters, showing that more sophisticated algorithms tend to be…

Computation · Statistics 2020-05-12 Samuel Livingstone , Giacomo Zanella

Elliptical slice sampling, when adapted to linearly truncated multivariate normal distributions, is a rejection-free Markov chain Monte Carlo method. At its core, it requires analytically constructing an ellipse-polytope intersection. The…

Machine Learning · Computer Science 2024-07-16 Kaiwen Wu , Jacob R. Gardner

Model comparison for the purposes of selection, averaging and validation is a problem found throughout statistics. Within the Bayesian paradigm, these problems all require the calculation of the posterior probabilities of models within a…

Methodology · Statistics 2015-06-08 Yan Zhou , Adam M Johansen , John A D Aston

Sequential Monte Carlo (SMC) is a methodology for sampling approximately from a sequence of probability distributions of increasing dimension and estimating their normalizing constants. We propose here an alternative methodology named…

Statistics Theory · Mathematics 2012-11-13 Anthony Brockwell , Pierre Del Moral , Arnaud Doucet

We present a Monte Carlo algorithm for selectively sampling radial distribution functions and effective interaction potentials in asymmetric liquid mixtures. We demonstrate its efficiency for hard-sphere mixtures, and for model systems with…

Soft Condensed Matter · Physics 2009-11-13 J. G. Malherbe , Werner Krauth

An efficient simulation-based methodology is proposed for the rolling window estimation of state space models, called particle rolling Markov chain Monte Carlo (MCMC) with double block sampling. In our method, which is based on Sequential…

Computation · Statistics 2021-09-17 Naoki Awaya , Yasuhiro Omori

We study convergence rates of Hamiltonian Monte Carlo (HMC) algorithms with leapfrog integration under mild conditions on stochastic gradient oracle for the target distribution (SGHMC). Our method extends standard HMC by allowing the use of…

Statistics Theory · Mathematics 2024-05-28 Soumyadip Ghosh , Yingdong Lu , Tomasz Nowicki

Adaptive importance sampling (AIS) methods provide a useful alternative to Markov Chain Monte Carlo (MCMC) algorithms for performing inference of intractable distributions. Population Monte Carlo (PMC) algorithms constitute a family of AIS…

Methodology · Statistics 2023-12-13 Soumyasundar Pal , Antonios Valkanas , Mark Coates

Adaptive Monte Carlo methods are very efficient techniques designed to tune simulation estimators on-line. In this work, we present an alternative to stochastic approximation to tune the optimal change of measure in the context of…

Probability · Mathematics 2009-10-23 Benjamin Jourdain , Jérôme Lelong

In this paper, we propose a MCMC algorithm based on elliptical slice sampling with the purpose to improve sampling efficiency. During sampling, a mixture distribution is fitted periodically to previous samples. The components of the mixture…

Computation · Statistics 2019-03-14 Song Li , Geoffrey K. F. Tso

We propose a novel approach called Self-Learning Hybrid Monte Carlo (SLHMC) which is a general method to make use of machine learning potentials to accelerate the statistical sampling of first-principles density-functional-theory (DFT)…

Materials Science · Physics 2020-08-05 Yuki Nagai , Masahiro Okumura , Keita Kobayashi , Motoyuki Shiga

Traditional gradient-based sampling methods, like standard Hamiltonian Monte Carlo, require that the desired target distribution is continuous and differentiable. This limits the types of models one can define, although the presented models…

Computation · Statistics 2025-04-28 Jimmy Huy Tran , Tore Selland Kleppe

We present a trainable framework for efficiently generating gauge configurations, and discuss ongoing work in this direction. In particular, we consider the problem of sampling configurations from a 4D $SU(3)$ lattice gauge theory, and…

High Energy Physics - Lattice · Physics 2023-12-19 Sam Foreman , Xiao-Yong Jin , James C. Osborn

The theme of the present paper is numerical integration of $C^r$ functions using randomized methods. We consider variance reduction methods that consist in two steps. First the initial interval is partitioned into subintervals and the…

Numerical Analysis · Mathematics 2023-06-21 Leszek Plaskota , Paweł Przybyłowicz , Łukasz Stępień

Monte Carlo sampling is a powerful toolbox of algorithmic techniques widely used for a number of applications wherein some noisy quantity, or summary statistic thereof, is sought to be estimated. In this paper, we survey the literature for…

Hamiltonian Monte Carlo (HMC) has become routinely used for sampling from posterior distributions. Its extension Riemann manifold HMC (RMHMC) modifies the proposal kernel through distortion of local distances by a Riemannian metric. The…

Computation · Statistics 2017-02-21 Akihiko Nishimura , David Dunson

Monte Carlo algorithms, such as Markov chain Monte Carlo (MCMC) and Hamiltonian Monte Carlo (HMC), are routinely used for Bayesian inference in generalized linear models; however, these algorithms are prohibitively slow in massive data…

Computation · Statistics 2020-08-31 Nariankadu D. Shyamalkumar , Sanvesh Srivastava

In solving simulation-based stochastic root-finding or optimization problems that involve rare events, such as in extreme quantile estimation, running crude Monte Carlo can be prohibitively inefficient. To address this issue, importance…

Methodology · Statistics 2021-02-23 Shengyi He , Guangxin Jiang , Henry Lam , Michael C. Fu

Monte Carlo integration is a commonly used technique to compute intractable integrals and is typically thought to perform poorly for very high-dimensional integrals. To show that this is not always the case, we examine Monte Carlo…

Methodology · Statistics 2023-05-26 Yanbo Tang

Markov Chain Monte Carlo (MCMC) requires to evaluate the full data likelihood at different parameter values iteratively and is often computationally infeasible for large data sets. In this paper, we propose to approximate the log-likelihood…

Methodology · Statistics 2020-05-26 Guanyu Hu , HaiYing Wang