中文
相关论文

相关论文: Gradient-free Hamiltonian Monte Carlo with Efficie…

200 篇论文

Many machine learning problems involve Monte Carlo gradient estimators. As a prominent example, we focus on Monte Carlo variational inference (MCVI) in this paper. The performance of MCVI crucially depends on the variance of its stochastic…

机器学习 · 统计学 2018-07-05 Alexander Buchholz , Florian Wenzel , Stephan Mandt

We present a new Subset Simulation approach using Hamiltonian neural network-based Monte Carlo sampling for reliability analysis. The proposed strategy combines the superior sampling of the Hamiltonian Monte Carlo method with…

In this work we present a new and efficient Bayesian method for nonlinear three dimensional large scale structure inference. We employ a Hamiltonian Monte Carlo (HMC) sampler to obtain samples from a multivariate highly non-Gaussian…

宇宙学与河外天体物理 · 物理学 2015-05-14 J. Jasche , F. S. Kitaura

Many problems in the physical sciences, machine learning, and statistical inference necessitate sampling from a high-dimensional, multi-modal probability distribution. Markov Chain Monte Carlo (MCMC) algorithms, the ubiquitous tool for this…

数据分析、统计与概率 · 物理学 2022-05-12 Marylou Gabrié , Grant M. Rotskoff , Eric Vanden-Eijnden

We present an efficient algorithm for maximum likelihood estimation (MLE) of exponential family models, with a general parametrization of the energy function that includes neural networks. We exploit the primal-dual view of the MLE with a…

机器学习 · 计算机科学 2020-04-01 Bo Dai , Zhen Liu , Hanjun Dai , Niao He , Arthur Gretton , Le Song , Dale Schuurmans

In the last few decades, Markov chain Monte Carlo (MCMC) methods have been widely applied to Bayesian updating of structural dynamic models in the field of structural health monitoring. Recently, several MCMC algorithms have been developed…

应用统计 · 统计学 2026-04-29 Xianghao Meng , James L. Beck , Yong Huang , Hui Li

Riemannian manifold Hamiltonian Monte Carlo (RMHMC) is a sampling algorithm that seeks to adapt proposals to the local geometry of the posterior distribution. The specific form of the Hamiltonian used in RMHMC necessitates {\it…

统计计算 · 统计学 2021-11-22 James A. Brofos , Roy R. Lederman

In this paper, we propose Barrier Hamiltonian Monte Carlo (BHMC), a version of the HMC algorithm which aims at sampling from a Gibbs distribution $\pi$ on a manifold $\mathrm{M}$, endowed with a Hessian metric $\mathfrak{g}$ derived from a…

机器学习 · 统计学 2023-10-31 Maxence Noble , Valentin De Bortoli , Alain Durmus

Hamiltonian Monte Carlo (HMC) is a state-of-the-art Markov chain Monte Carlo sampling algorithm for drawing samples from smooth probability densities over continuous spaces. We study the variant most widely used in practice, Metropolized…

机器学习 · 统计学 2021-01-12 Yuansi Chen , Raaz Dwivedi , Martin J. Wainwright , Bin Yu

In this work, we introduce three algorithmic improvements to reduce the cost and improve the scaling of orbital space variational Monte Carlo (VMC). First, we show that by appropriately screening the one- and two-electron integrals of the…

化学物理 · 物理学 2018-07-30 Iliya Sabzevari , Sandeep Sharma

Markov chain Monte Carlo (MCMC) algorithms have long been the main workhorses of Bayesian inference. Among them, Hamiltonian Monte Carlo (HMC) has recently become very popular due to its efficiency resulting from effective use of the…

统计计算 · 统计学 2021-06-18 Ossi Räisä , Antti Koskela , Antti Honkela

The need to calibrate increasingly complex statistical models requires a persistent effort for further advances on available, computationally intensive Monte Carlo methods. We study here an advanced version of familiar Markov Chain Monte…

统计方法学 · 统计学 2015-03-20 Alexandros Beskos , Konstantinos Kalogeropoulos , Erik Pazos

A Monte Carlo algorithm is said to be adaptive if it automatically calibrates its current proposal distribution using past simulations. The choice of the parametric family that defines the set of proposal distributions is critical for good…

统计理论 · 数学 2011-11-11 Christian Schäfer , Nicolas Chopin

Hamiltonian Monte Carlo (HMC) has become routinely used for sampling from posterior distributions. Its extension Riemann manifold HMC (RMHMC) modifies the proposal kernel through distortion of local distances by a Riemannian metric. The…

统计计算 · 统计学 2017-02-21 Akihiko Nishimura , David Dunson

State space models (SSM) have been widely applied for the analysis and visualization of large sequential datasets. Sequential Monte Carlo (SMC) is a very popular particle-based method to sample latent states from intractable posteriors.…

机器学习 · 计算机科学 2019-01-07 Duo Xu

The Hamiltonian Monte Carlo method generates samples by introducing a mechanical system that explores the target density. For distributions on manifolds it is not always simple to perform the mechanics as a result of the lack of global…

统计计算 · 统计学 2019-04-22 Alessandro Barp , Anthony Kennedy , Mark Girolami

Tuning the durations of the Hamiltonian flow in Hamiltonian Monte Carlo (also called Hybrid Monte Carlo) (HMC) involves a tradeoff between computational cost and sampling quality, which is typically challenging to resolve in a satisfactory…

概率论 · 数学 2017-09-08 Nawaf Bou-Rabee , Jesus Maria Sanz-Serna

The Hamiltonian Monte Carlo (HMC) method has been recognized as a powerful sampling tool in computational statistics. We show that performance of HMC can be significantly improved by incorporating importance sampling and an irreversible…

统计计算 · 统计学 2019-07-26 Tijana Radivojević , Elena Akhmatskaya

Bayesian inference in the presence of an intractable likelihood function is computationally challenging. When following a Markov chain Monte Carlo (MCMC) approach to approximate the posterior distribution in this context, one typically…

统计方法学 · 统计学 2019-10-03 Johan Alenlöv , Arnaud Doucet , Fredrik Lindsten

We present a scalable Bayesian framework for the analysis of confocal fluorescence spectroscopy data, addressing key limitations in traditional fluorescence correlation spectroscopy methods. Our framework captures molecular motion,…

数值分析 · 数学 2024-11-07 Daniel McBride , Ioannis Sgouralis