中文
相关论文

相关论文: Gradient-free Hamiltonian Monte Carlo with Efficie…

200 篇论文

Hamiltonian Monte Carlo (HMC) is a powerful Markov chain Monte Carlo (MCMC) method for performing approximate inference in complex probabilistic models of continuous variables. In common with many MCMC methods, however, the standard HMC…

统计计算 · 统计学 2017-04-12 Matthew M. Graham , Amos J. Storkey

The Hamiltonian Monte Carlo (HMC) sampling algorithm exploits Hamiltonian dynamics to construct efficient Markov Chain Monte Carlo (MCMC), which has become increasingly popular in machine learning and statistics. Since HMC uses the gradient…

机器学习 · 计算机科学 2019-06-04 Minghao Gu , Shiliang Sun

In this paper we address the widely-experienced difficulty in tuning Hamiltonian-based Monte Carlo samplers. We develop an algorithm that allows for the adaptation of Hamiltonian and Riemann manifold Hamiltonian Monte Carlo samplers using…

统计计算 · 统计学 2013-02-26 ziyu wang , Shakir Mohamed , Nando de Freitas

Hamiltonian Monte Carlo (HMC) is a premier Markov Chain Monte Carlo (MCMC) algorithm for continuous target distributions. Its full potential can only be unleashed when its problem-dependent hyperparameters are tuned well. The adaptation of…

统计计算 · 统计学 2022-05-10 Pavel Sountsov , Matt D. Hoffman

Hamiltonian Monte Carlo (HMC) is a state of the art method for sampling from distributions with differentiable densities, but can converge slowly when applied to challenging multimodal problems. Running HMC with a time varying Hamiltonian,…

机器学习 · 统计学 2026-02-26 Reuben Cohn-Gordon , Uroš Seljak , Dries Sels

Traditional Markov Chain Monte Carlo methods suffer from low acceptance rate, slow mixing and low efficiency in high dimensions. Hamiltonian Monte Carlo resolves this issue by avoiding the random walk. Hamiltonian Monte Carlo (HMC) is a…

天体物理学 · 物理学 2008-11-26 Amir Hajian

Hamiltonian Monte Carlo (HMC) is a Markov chain Monte Carlo (MCMC) algorithm that avoids the random walk behavior and sensitivity to correlated parameters that plague many MCMC methods by taking a series of steps informed by first-order…

统计计算 · 统计学 2015-03-19 Matthew D. Hoffman , Andrew Gelman

Hamiltonian Monte Carlo (HMC) is a powerful Markov chain Monte Carlo (MCMC) algorithm for estimating expectations with respect to continuous un-normalized probability distributions. MCMC estimators typically have higher variance than…

统计计算 · 统计学 2020-03-04 Dan Piponi , Matthew D. Hoffman , Pavel Sountsov

The paper proposes a Riemannian Manifold Hamiltonian Monte Carlo sampler to resolve the shortcomings of existing Monte Carlo algorithms when sampling from target densities that may be high dimensional and exhibit strong correlations. The…

统计计算 · 统计学 2019-12-18 Mark Girolami , Ben Calderhead , Siu A. Chin

Many recent Markov chain Monte Carlo (MCMC) samplers leverage continuous dynamics to define a transition kernel that efficiently explores a target distribution. In tandem, a focus has been on devising scalable variants that subsample the…

统计理论 · 数学 2015-11-03 Yi-An Ma , Tianqi Chen , Emily B. Fox

We introduce a gradient-based learning method to automatically adapt Markov chain Monte Carlo (MCMC) proposal distributions to intractable targets. We define a maximum entropy regularised objective function, referred to as generalised speed…

机器学习 · 统计学 2020-01-07 Michalis K. Titsias , Petros Dellaportas

Bayesian max-margin models have shown superiority in various practical applications, such as text categorization, collaborative prediction, social network link prediction and crowdsourcing, and they conjoin the flexibility of Bayesian…

机器学习 · 统计学 2016-10-19 Wenbo Hu , Jun Zhu , Bo Zhang

The Hamiltonian Monte Carlo (HMC) algorithm is a powerful Markov Chain Monte Carlo (MCMC) method that uses Hamiltonian dynamics to generate samples from a target distribution. To fully exploit its potential, we must understand how…

统计计算 · 统计学 2025-01-27 Abraham Granados , Isaías Bañales

In Bayesian inference, Hamiltonian Monte Carlo (HMC) is a popular Markov Chain Monte Carlo (MCMC) algorithm known for its efficiency in sampling from complex probability distributions. However, its application to models with latent…

统计计算 · 统计学 2025-04-15 Alaa Amri , Víctor Elvira , Amy L. Wilson

A Kernel Adaptive Metropolis-Hastings algorithm is introduced, for the purpose of sampling from a target distribution with strongly nonlinear support. The algorithm embeds the trajectory of the Markov chain into a reproducing kernel Hilbert…

Hamiltonian Monte Carlo is a prominent Markov Chain Monte Carlo algorithm, which employs symplectic integrators to sample from high dimensional target distributions in many applications, such as statistical mechanics, Bayesian statistics…

数值分析 · 数学 2025-02-13 Geoffrey McGregor , Andy T. S. Wan

Bayesian formulation of modern day signal processing problems has called for improved Markov chain Monte Carlo (MCMC) sampling algorithms for inference. The need for efficient sampling techniques has become indispensable for high…

统计计算 · 统计学 2025-10-28 Apratim Shukla , Dootika Vats , Eric C. Chi

This paper focuses on variational inference with intractable likelihood functions that can be unbiasedly estimated. A flexible variational approximation based on Gaussian mixtures is developed, by adopting the mixture population Monte Carlo…

数值分析 · 数学 2021-12-02 Zhijian He , Shifeng Huo , Tianhui Yang

With the recently increased interest in probabilistic models, the efficiency of an underlying sampler becomes a crucial consideration. Hamiltonian Monte Carlo (HMC) is one popular option for models of this kind. Performance of the method,…

Hamiltonian Monte Carlo (HMC) is a powerful and accurate method to sample from the posterior distribution in Bayesian inference. However, HMC techniques are computationally demanding for Bayesian neural networks due to the high…

机器学习 · 统计学 2025-09-11 Ponkrshnan Thiagarajan , Tamer A. Zaki , Michael D. Shields