English
Related papers

Related papers: A Conceptual Introduction to Hamiltonian Monte Car…

200 papers

Orthogonal Monte Carlo (OMC) is a very effective sampling algorithm imposing structural geometric conditions (orthogonality) on samples for variance reduction. Due to its simplicity and superior performance as compared to its Quasi Monte…

Machine Learning · Computer Science 2020-05-29 Han Lin , Haoxian Chen , Tianyi Zhang , Clement Laroche , Krzysztof Choromanski

The past decades have seen enormous improvements in computational inference based on statistical models, with continual enhancement in a wide range of computational tools, in competition. In Bayesian inference, first and foremost, MCMC…

Computation · Statistics 2015-05-12 Peter J. Green , Krzysztof Łatuszyński , Marcelo Pereyra , Christian P. Robert

Monte Carlo methods play important part in modern statistical physics. The application of these methods suffer from two main difficulties.The first is caused by the relatively small number of particles that can participate in any numerical…

Statistical Mechanics · Physics 2007-05-23 A. Brandt , V. Ilyin

Although histogram methods have been extremely effective for analyzing data from Monte Carlo simulations, they do have certain limitations, including the range over which they are valid and the difficulties of combining data from…

Statistical Mechanics · Physics 2015-06-25 Robert H. Swendsen , Jian-Sheng Wang , Shing-Te Li , Brian Diggs , Christopher Genovese , Joseph B. Kadane

This work introduces a novel and efficient Bayesian federated learning algorithm, namely, the Federated Averaging stochastic Hamiltonian Monte Carlo (FA-HMC), for parameter estimation and uncertainty quantification. We establish rigorous…

Machine Learning · Computer Science 2024-07-10 Jiajun Liang , Qian Zhang , Wei Deng , Qifan Song , Guang Lin

Hamiltonian Monte Carlo (HMC) is arguably the dominant statistical inference algorithm used in most popular "first-order differentiable" Probabilistic Programming Languages (PPLs). However, the fact that HMC uses derivative information…

Computation · Statistics 2019-05-31 Bradley Gram-Hansen , Yuan Zhou , Tobias Kohn , Tom Rainforth , Hongseok Yang , Frank Wood

This paper surveys in detail the relations between numerical integration and the Hamiltonian (or hybrid) Monte Carlo method (HMC). Since the computational cost of HMC mainly lies in the numerical integrations, these should be performed as…

Probability · Mathematics 2020-07-21 Nawaf Bou-Rabee , Jesús María Sanz-Serna

This paper sets up a methodology for approximately solving optimal investment problems using duality methods combined with Monte Carlo simulations. In particular, we show how to tackle high dimensional problems in incomplete markets, where…

Computational Finance · Quantitative Finance 2013-05-16 L C G Rogers , Pawel Zaczkowski

Gradient-based Monte Carlo sampling algorithms, like Langevin dynamics and Hamiltonian Monte Carlo, are important methods for Bayesian inference. In large-scale settings, full-gradients are not affordable and thus stochastic gradients…

Machine Learning · Computer Science 2019-06-25 Zhize Li , Tianyi Zhang , Shuyu Cheng , Jun Zhu , Jian Li

We introduce a new class of Monte Carlo based approximations of expectations of random variables such that their laws are only available via certain discretizations. Sampling from the discretized versions of these laws can typically…

Computation · Statistics 2017-10-17 Dan Crisan , Pierre Del Moral , Jeremie Houssineau , Ajay Jasra

We present a Monte Carlo numerical investigation of the Hamiltonian Mean Field (HMF) model. We begin by discussing canonical Metropolis Monte Carlo calculations, in order to check the caloric curve of the HMF model and study finite size…

Statistical Mechanics · Physics 2009-11-10 Alessandro Pluchino , Giuseppe Andronico , Andrea Rapisarda

It has become increasingly feasible to use quantum Monte Carlo (QMC) methods to study correlated fermion systems for realistic Hamiltonians. We give a summary of these techniques targeted at researchers in the field of correlated electrons,…

Strongly Correlated Electrons · Physics 2016-08-24 Lucas K. Wagner , David M. Ceperley

We review a recent approach for the simulation of many-body interacting systems based on an efficient generalization of the Lanczos method for Quantum Monte Carlo simulations. This technique allows to perform systematic corrections to a…

Strongly Correlated Electrons · Physics 2007-05-23 Sandro Sorella

We consider the problem of sampling from posterior distributions for Bayesian models where some parameters are restricted to be orthogonal matrices. Such matrices are sometimes used in neural networks models for reasons of regularization…

Machine Learning · Statistics 2019-01-24 Viktor Yanush , Dmitry Kropotov

Diffusion generative models have excelled at diverse image generation and reconstruction tasks across fields. A less explored avenue is their application to discriminative tasks involving regression or classification problems. The…

Cosmology and Nongalactic Astrophysics · Physics 2025-02-26 Nayantara Mudur , Carolina Cuesta-Lazaro , Douglas P. Finkbeiner

Based on the principles of importance sampling and resampling, sequential Monte Carlo (SMC) encompasses a large set of powerful techniques dealing with complex stochastic dynamic systems. Many of these systems possess strong memory, with…

Methodology · Statistics 2013-02-22 Ming Lin , Rong Chen , Jun S. Liu

We investigate the effect of using local and non-local second derivative information on the performance of Hamiltonian Monte Carlo (HMC) sampling methods, for high-dimension non-Gaussian distributions, with application to Bayesian inference…

Computation · Statistics 2023-05-03 Mina Karimi , Kaushik Dayal , Matteo Pozzi

Traditional gradient-based sampling methods, like standard Hamiltonian Monte Carlo, require that the desired target distribution is continuous and differentiable. This limits the types of models one can define, although the presented models…

Computation · Statistics 2025-04-28 Jimmy Huy Tran , Tore Selland Kleppe

The Hybrid Monte Carlo (HMC) algorithm currently is the favorite scheme to simulate quantum chromodynamics including dynamical fermions. In this talk-which is intended for a non-expert audience--I want to bring together methodical and…

High Energy Physics - Lattice · Physics 2009-10-30 Thomas Lippert

A diffusion Monte Carlo algorithm is introduced that can determine the correct nodal structure of the wave function of a few-fermion system and its ground-state energy without an uncontrolled bias. This is achieved by confining signed…

Computational Physics · Physics 2020-02-05 Alexander A. Kunitsa , So Hirata