English
Related papers

Related papers: Algorithmic warm starts for Hamiltonian Monte Carl…

200 papers

We propose a new computationally efficient sampling scheme for Bayesian inference involving high dimensional probability distributions. Our method maps the original parameter space into a low-dimensional latent space, explores the latent…

Computation · Statistics 2019-10-15 Babak Shahbaba , Luis Martinez Lomeli , Tian Chen , Shiwei Lan

In this paper we address the widely-experienced difficulty in tuning Hamiltonian-based Monte Carlo samplers. We develop an algorithm that allows for the adaptation of Hamiltonian and Riemann manifold Hamiltonian Monte Carlo samplers using…

Computation · Statistics 2013-02-26 ziyu wang , Shakir Mohamed , Nando de Freitas

We present a Monte Carlo numerical investigation of the Hamiltonian Mean Field (HMF) model. We begin by discussing canonical Metropolis Monte Carlo calculations, in order to check the caloric curve of the HMF model and study finite size…

Statistical Mechanics · Physics 2009-11-10 Alessandro Pluchino , Giuseppe Andronico , Andrea Rapisarda

We consider the problem of estimating expectations with respect to a target distribution with an unknown normalizing constant, and where even the unnormalized target needs to be approximated at finite resolution. Under such an assumption,…

Numerical Analysis · Mathematics 2023-06-29 Xinzhu Liang , Shangda Yang , Simon L. Cotter , Kody J. H. Law

We introduce the Hamiltonian Monte Carlo Particle Swarm Optimizer (HMC-PSO), an optimization algorithm that reaps the benefits of both Exponentially Averaged Momentum PSO and HMC sampling. The coupling of the position and velocity of each…

Machine Learning · Computer Science 2022-06-29 Omatharv Bharat Vaidya , Rithvik Terence DSouza , Snehanshu Saha , Soma Dhavala , Swagatam Das

In this article, we describe a {\tt R} package for sampling from an empirical likelihood-based posterior using a Hamiltonian Monte Carlo method. Empirical likelihood-based methodologies have been used in Bayesian modeling of many problems…

Other Statistics · Statistics 2022-09-07 Dang Trung Kien , Neo Han Wei , Sanjay Chaudhuri

Markov chain Monte Carlo (MCMC) sampling of densities restricted to linearly constrained domains is an important task arising in Bayesian treatment of inverse problems in the natural sciences. While efficient algorithms for uniform polytope…

We propose a modification of the Hybrid Monte Carlo (HMC) algorithm that overcomes the topological freezing of a two-dimensional $U(1)$ gauge theory with and without fermion content. This algorithm includes reversible jumps between…

High Energy Physics - Lattice · Physics 2023-05-09 David Albandea , Pilar Hernández , Alberto Ramos , Fernando Romero-López

In this paper, we discuss an extension of the Split Hamiltonian Monte Carlo (Split HMC) method for Gaussian process model (GPM). This method is based on splitting the Hamiltonian in a way that allows much of the movement around the state…

Computation · Statistics 2012-07-17 Shiwei Lan , Babak Shahbaba

We propose a new sampling method, the thermostat-assisted continuously-tempered Hamiltonian Monte Carlo, for Bayesian learning on large datasets and multimodal distributions. It simulates the Nos\'e-Hoover dynamics of a…

Machine Learning · Statistics 2019-01-29 Rui Luo , Jianhong Wang , Yaodong Yang , Zhanxing Zhu , Jun Wang

Piecewise-Deterministic Markov Processes (PDMPs) hold significant promise for sampling from complex probability distributions. However, their practical implementation is hindered by the need to compute model-specific bounds. Conversely,…

Computation · Statistics 2025-03-17 Augustin Chevallier , Sam Power , Matthew Sutton

The coalescence of binary neutron stars are one of the main sources of gravitational waves for ground-based gravitational wave detectors. As Bayesian inference for binary neutron stars is computationally expensive, more efficient and faster…

General Relativity and Quantum Cosmology · Physics 2019-11-20 Yann Bouffanais , Edward K. Porter

Accurate and efficient estimation of rare events probabilities is of significant importance, since often the occurrences of such events have widespread impacts. The focus in this work is on precisely quantifying these probabilities, often…

Methodology · Statistics 2023-05-23 Konstantinos G. Papakonstantinou , Hamed Nikbakht , Elsayed Eshra

Orthogonal Monte Carlo (OMC) is a very effective sampling algorithm imposing structural geometric conditions (orthogonality) on samples for variance reduction. Due to its simplicity and superior performance as compared to its Quasi Monte…

Machine Learning · Computer Science 2020-05-29 Han Lin , Haoxian Chen , Tianyi Zhang , Clement Laroche , Krzysztof Choromanski

We investigate the effect of using local and non-local second derivative information on the performance of Hamiltonian Monte Carlo (HMC) sampling methods, for high-dimension non-Gaussian distributions, with application to Bayesian inference…

Computation · Statistics 2023-05-03 Mina Karimi , Kaushik Dayal , Matteo Pozzi

Many random processes can be simulated as the output of a deterministic model accepting random inputs. Such a model usually describes a complex mathematical or physical stochastic system and the randomness is introduced in the input…

Machine Learning · Statistics 2012-11-21 A. Gokcen Mahmutoglu , Alper T. Erdogan , Alper Demir

Markov chain Monte Carlo algorithms are used to simulate from complex statistical distributions by way of a local exploration of these distributions. This local feature avoids heavy requests on understanding the nature of the target, but it…

Computation · Statistics 2018-04-12 Christian P. Robert , Victor Elvira , Nick Tawn , Changye Wu

Nested sampling is a powerful approach to Bayesian inference ultimately limited by the computationally demanding task of sampling from a heavily constrained probability distribution. An effective algorithm in its own right, Hamiltonian…

Data Analysis, Statistics and Probability · Physics 2015-03-02 M. J. Betancourt

Hamiltonian Monte Carlo is a popular sampling technique for smooth target densities. The scale lengths of the target have long been known to influence integration error and sampling efficiency. However, quantitative measures intrinsic to…

Computation · Statistics 2020-02-06 Ian Langmore , Michael Dikovsky , Scott Geraedts , Peter Norgaard , Rob Von Behren

The Metropolis-Hastings (MH) algorithm is the prototype for a class of Markov chain Monte Carlo methods that propose transitions between states and then accept or reject the proposal. These methods generate a correlated sequence of random…

Computational Physics · Physics 2011-05-12 Albert H. Mao , Rohit V. Pappu