English
Related papers

Related papers: Zero Variance and Hamiltonian Monte Carlo Methods …

200 papers

Although Hamiltonian Monte Carlo has proven an empirical success, the lack of a rigorous theoretical understanding of the algorithm has in many ways impeded both principled developments of the method and use of the algorithm in practice. In…

Methodology · Statistics 2014-10-21 M. J. Betancourt , Simon Byrne , Samuel Livingstone , Mark Girolami

Bayesian hierarchical modeling is a popular approach to capturing unobserved heterogeneity across individual units. However, standard estimation methods such as Markov chain Monte Carlo (MCMC) can be impracticable for modeling outcomes from…

Methodology · Statistics 2014-11-04 Michael Braun , Paul Damien

One of the most demanding calculations is to generate random samples from a specified probability distribution (usually with an unknown normalizing prefactor) in a high-dimensional configuration space. One often has to resort to using a…

Computational Physics · Physics 2015-06-18 Youhan Fang , Jesus-Maria Sanz-Serna , Robert D. Skeel

Phylogenetic comparative methods correct for shared evolutionary history among a set of non-independent organisms by modeling sample traits as arising from a diffusion process along on the branches of a possibly unknown history. To…

Applications · Statistics 2020-09-30 Paul Bastide , Lam Si Tung Ho , Guy Baele , Philippe Lemey , Marc A Suchard

Estimation and prediction in high dimensional multivariate factor stochastic volatility models is an important and active research area because such models allow a parsimonious representation of multivariate stochastic volatility. Bayesian…

Computation · Statistics 2021-04-27 David Gunawan , Robert Kohn , David Nott

Gaussian process is a very promising novel technology that has been applied to both the regression problem and the classification problem. While for the regression problem it yields simple exact solutions, this is not the case for the…

Machine Learning · Statistics 2013-10-18 Amir F. Atiya , Hatem A. Fayed , Ahmed H. Abdel-Gawad

A new methodology for model determination in decomposable graphical Gaussian models is developed. The Bayesian paradigm is used and, for each given graph, a hyper inverse Wishart prior distribution on the covariance matrix is considered.…

Computation · Statistics 2015-03-13 Sophie Donnet , Jean-Michel Marin

Markov chain Monte Carlo (MCMC) algorithms are generally regarded as the gold standard technique for Bayesian inference. They are theoretically well-understood and conceptually simple to apply in practice. The drawback of MCMC is that in…

Computation · Statistics 2019-07-17 Christopher Nemeth , Paul Fearnhead

The Metropolis-Hastings (MH) algorithm is one of the most widely used Markov Chain Monte Carlo schemes for generating samples from Bayesian posterior distributions. The algorithm is asymptotically exact, flexible and easy to implement.…

Methodology · Statistics 2026-03-10 Estevão Prado , Christopher Nemeth , Chris Sherlock

A statistical learning approach for parametric PDEs related to Uncertainty Quantification is derived. The method is based on the minimization of an empirical risk on a selected model class and it is shown to be applicable to a broad range…

Numerical Analysis · Mathematics 2020-01-07 Martin Eigel , Reinhold Schneider , Philipp Trunschke , Sebastian Wolf

Hamiltonian Monte Carlo (HMC) is a Markov chain Monte Carlo method that allows to sample high dimensional probability measures. It relies on the integration of the Hamiltonian dynamics to propose a move which is then accepted or rejected…

Numerical Analysis · Mathematics 2023-08-08 Tony Lelièvre , Régis Santet , Gabriel Stoltz

Bayesian hierarchical linear models provide a natural framework to analyze nested and clustered data. Classical estimation with Markov chain Monte Carlo produces well calibrated posterior distributions but becomes computationally expensive…

Methodology · Statistics 2025-12-16 Cristian Parra-Aldana , Juan Sosa

Hamiltonian Monte Carlo (HMC) and related algorithms have become routinely used in Bayesian computation. In this article, we present a simple and provably accurate method to improve the efficiency of HMC and related algorithms with…

Computation · Statistics 2020-03-10 Akihiko Nishimura , David Dunson

In this paper, we propose a novel and generic family of multiple importance sampling estimators. We first revisit the celebrated balance heuristic estimator, a widely used Monte Carlo technique for the approximation of intractable…

Computation · Statistics 2019-04-09 Mateu Sbert , Víctor Elvira

Recently, the Hamilton Monte Carlo (HMC) has become widespread as one of the more reliable approaches to efficient sample generation processes. However, HMC is difficult to sample in a multimodal posterior distribution because the HMC chain…

Computation · Statistics 2020-06-22 Jonghyun Yun , Minsuk Shin , Ick Hoon Jin , Faming Liang

Intractable generative models are models for which the likelihood is unavailable but sampling is possible. Most approaches to parameter inference in this setting require the computation of some discrepancy between the data and the…

Computation · Statistics 2022-07-05 Ziang Niu , Johanna Meier , François-Xavier Briol

Hamiltonian Monte Carlo (HMC) is a popular Markov chain Monte Carlo (MCMC) algorithm that generates proposals for a Metropolis-Hastings algorithm by simulating the dynamics of a Hamiltonian system. However, HMC is sensitive to large time…

Machine Learning · Statistics 2016-09-15 Xiaoyu Lu , Valerio Perrone , Leonard Hasenclever , Yee Whye Teh , Sebastian J. Vollmer

We propose a generic approach for numerically efficient simulation from analytically intractable distributions with constrained support. Our approach relies upon Generalized Randomized Hamiltonian Monte Carlo (GRHMC) processes and combines…

Computation · Statistics 2024-06-03 Tore Selland Kleppe , Roman Liesenfeld

Hamiltonian Monte Carlo (HMC) has been widely adopted in the statistics community because of its ability to sample high-dimensional distributions much more efficiently than other Metropolis-based methods. Despite this, HMC often performs…

Computation · Statistics 2019-11-19 Arya A. Pourzanjani , Linda R. Petzold

A vital stage in the mathematical modelling of real-world systems is to calibrate a model's parameters to observed data. Likelihood-free parameter inference methods, such as Approximate Bayesian Computation, build Monte Carlo samples of the…

Computation · Statistics 2021-12-23 Thomas P Prescott , Ruth E Baker