English
Related papers

Related papers: Discrete Hamiltonian-Assisted Metropolis Sampling

200 papers

Markov chain Monte Carlo methods have become standard tools in statistics to sample from complex probability measures. Many available techniques rely on discrete-time reversible Markov chains whose transition kernels build up over the…

Methodology · Statistics 2017-02-21 Alexandre Bouchard-Côté , Sebastian J. Vollmer , Arnaud Doucet

Ensuring the safety of autonomous vehicles (AVs) requires both accurate estimation of their performance and efficient discovery of potential failure cases. This paper introduces Bayesian adaptive multifidelity sampling (BAMS), which…

Robotics · Computer Science 2024-11-28 Aman Sinha , Payam Nikdel , Supratik Paul , Shimon Whiteson

To sample from a given target distribution, Markov chain Monte Carlo (MCMC) sampling relies on constructing an ergodic Markov chain with the target distribution as its invariant measure. For any MCMC method, an important question is how to…

Probability · Mathematics 2023-08-15 Federica Milinanni , Pierre Nyquist

Stochastic gradients have been widely integrated into Langevin-based methods to improve their scalability and efficiency in solving large-scale sampling problems. However, the proximal sampler, which exhibits much faster convergence than…

Machine Learning · Statistics 2024-05-28 Xunpeng Huang , Difan Zou , Yi-An Ma , Hanze Dong , Tong Zhang

The Linear Parameter Varying Dynamical System (LPV-DS) is an effective approach that learns stable, time-invariant motion policies using statistical modeling and semi-definite optimization to encode complex motions for reactive robot…

Robotics · Computer Science 2024-03-26 Sunan Sun , Haihui Gao , Tianyu Li , Nadia Figueroa

When performing Bayesian inference using Sequential Monte Carlo (SMC) methods, two considerations arise: the accuracy of the posterior approximation and computational efficiency. To address computational demands, Sequential Monte Carlo…

Machine Learning · Statistics 2025-07-11 Joshua Murphy , Conor Rosato , Andrew Millard , Lee Devlin , Paul Horridge , Simon Maskell

Markov chain Monte Carlo (MCMC) methods have existed for a long time and the field is well-explored. The purpose of MCMC methods is to approximate a distribution through repeated sampling; most MCMC algorithms exhibit asymptotically optimal…

Computation · Statistics 2023-07-13 Fareed Sheriff

Sampling from the lattice Gaussian distribution is emerging as an important problem in coding and cryptography. In this paper, the classic Metropolis-Hastings (MH) algorithm from Markov chain Monte Carlo (MCMC) methods is adapted for…

Information Theory · Computer Science 2020-10-23 Zheng Wang , Cong Ling

In this paper, we introduce a new approach for integrating score-based models with the Metropolis-Hastings algorithm. While traditional score-based diffusion models excel in accurately learning the score function from data points, they lack…

Machine Learning · Computer Science 2025-04-01 Ahmed Aloui , Ali Hasan , Juncheng Dong , Zihao Wu , Vahid Tarokh

The Metropolis-Hastings algorithm allows one to sample asymptotically from any probability distribution $\pi$. There has been recently much work devoted to the development of variants of the MH update which can handle scenarios where such…

Computation · Statistics 2018-03-28 Christophe Andrieu , Arnaud Doucet , Sinan Yıldırım , Nicolas Chopin

Although the Metropolis algorithm is simple to implement, it often has difficulties exploring multimodal distributions. We propose the repelling-attracting Metropolis (RAM) algorithm that maintains the simple-to-implement nature of the…

Methodology · Statistics 2018-08-28 Hyungsuk Tak , Xiao-Li Meng , David A. van Dyk

This article is motivated by challenges in conducting Bayesian inferences on unknown discrete distributions, with a particular focus on count data. To avoid the computational disadvantages of traditional mixture models, we develop a novel…

Methodology · Statistics 2025-11-12 Davide Agnoletto , Tommaso Rigon , David B. Dunson

Efficient sampling from high-dimensional distributions is a challenging issue which is encountered in many large data recovery problems involving Markov chain Monte Carlo schemes. In this context, sampling using Hamiltonian dynamics is one…

Methodology · Statistics 2015-02-02 Lotfi Chaari , Jean-Yves Tourneret , Caroline Chaux , Hadj Batatia

Poisson log-linear models are ubiquitous in many applications, and one of the most popular approaches for parametric count regression. In the Bayesian context, however, there are no sufficient specific computational tools for efficient…

Computation · Statistics 2022-09-02 Laura D'Angelo , Antonio Canale

Particle Marginal Metropolis-Hastings (PMMH) is a general approach to Bayesian inference when the likelihood is intractable, but can be estimated unbiasedly. Our article develops an efficient PMMH method that scales up better to higher…

Computation · Statistics 2023-05-10 David Gunawan , Pratiti Chatterjee , Robert Kohn

Importance sampling (IS) is a powerful Monte Carlo (MC) methodology for approximating integrals, for instance in the context of Bayesian inference. In IS, the samples are simulated from the so-called proposal distribution, and the choice of…

Machine Learning · Computer Science 2022-09-29 Ali Mousavi , Reza Monsefi , Víctor Elvira

Hamiltonian Monte Carlo (HMC) samples efficiently from high-dimensional posterior distributions with proposed parameter draws obtained by iterating on a discretized version of the Hamiltonian dynamics. The iterations make HMC…

Computation · Statistics 2019-05-03 Khue-Dung Dang , Matias Quiroz , Robert Kohn , Minh-Ngoc Tran , Mattias Villani

We provide a clarification of the description of Langevin diffusions on Riemannian manifolds and of the measure underlying the invariant density. As a result we propose a new position-dependent Metropolis-adjusted Langevin algorithm (MALA)…

Methodology · Statistics 2014-08-15 Tatiana Xifara , Chris Sherlock , Samuel Livingstone , Simon Byrne , Mark Girolami

Hamiltonian Monte Carlo (HMC) is a Markov chain Monte Carlo (MCMC) algorithm that avoids the random walk behavior and sensitivity to correlated parameters that plague many MCMC methods by taking a series of steps informed by first-order…

Computation · Statistics 2015-03-19 Matthew D. Hoffman , Andrew Gelman

Hamiltonian Monte Carlo (HMC) is a state-of-the-art Markov chain Monte Carlo sampling algorithm for drawing samples from smooth probability densities over continuous spaces. We study the variant most widely used in practice, Metropolized…

Machine Learning · Statistics 2021-01-12 Yuansi Chen , Raaz Dwivedi , Martin J. Wainwright , Bin Yu