中文
相关论文

相关论文: Gradient-free Hamiltonian Monte Carlo with Efficie…

200 篇论文

Recently, Stochastic Gradient Markov Chain Monte Carlo (SG-MCMC) methods have been proposed for scaling up Monte Carlo computations to large data problems. Whilst these approaches have proven useful in many applications, vanilla SG-MCMC…

机器学习 · 统计学 2016-12-13 Umut Şimşekli , Roland Badeau , A. Taylan Cemgil , Gaël Richard

We propose a generic approach for numerically efficient simulation from analytically intractable distributions with constrained support. Our approach relies upon Generalized Randomized Hamiltonian Monte Carlo (GRHMC) processes and combines…

统计计算 · 统计学 2024-06-03 Tore Selland Kleppe , Roman Liesenfeld

Hamiltonian Monte Carlo (HMC) is a Markov chain Monte Carlo method that allows to sample high dimensional probability measures. It relies on the integration of the Hamiltonian dynamics to propose a move which is then accepted or rejected…

数值分析 · 数学 2023-08-08 Tony Lelièvre , Régis Santet , Gabriel Stoltz

We construct asymptotic arguments for the relative efficiency of rejection-free Monte Carlo (MC) methods compared to the standard MC method. We find that the efficiency is proportional to $\exp{({const} \beta)}$ in the Ising, $\sqrt{\beta}$…

统计力学 · 物理学 2009-11-11 H. Watanabe , S. Yukawa , M. A. Novotny , N. Ito

We develop Microcanonical Hamiltonian Monte Carlo (MCHMC), a class of models which follow a fixed energy Hamiltonian dynamics, in contrast to Hamiltonian Monte Carlo (HMC), which follows canonical distribution with different energy levels.…

统计计算 · 统计学 2026-05-29 Jakob Robnik , G. Bruno De Luca , Eva Silverstein , Uroš Seljak

This paper discusses the irreducibility and geometric ergodicity of the Hamiltonian Monte Carlo (HMC) algorithm. We consider cases where the number of steps of the symplectic integrator is either fixed or random. Under mild conditions on…

统计计算 · 统计学 2019-05-14 Alain Durmus , Eric Moulines , Eero Saksman

Orthogonal Monte Carlo (OMC) is a very effective sampling algorithm imposing structural geometric conditions (orthogonality) on samples for variance reduction. Due to its simplicity and superior performance as compared to its Quasi Monte…

机器学习 · 计算机科学 2020-05-29 Han Lin , Haoxian Chen , Tianyi Zhang , Clement Laroche , Krzysztof Choromanski

We propose a general way to construct an effective Hamiltonian in the Self-learning Monte Carlo method (SLMC), which speeds up Monte Carlo simulations by training an effective model to propose uncorrelated configurations in the Markov…

强关联电子 · 物理学 2020-03-11 Yuki Nagai , Masahiko Okumura , Akinori Tanaka

Hamiltonian Monte Carlo (HMC) has been widely adopted in the statistics community because of its ability to sample high-dimensional distributions much more efficiently than other Metropolis-based methods. Despite this, HMC often performs…

统计计算 · 统计学 2019-11-19 Arya A. Pourzanjani , Linda R. Petzold

Hamiltonian Monte Carlo (HMC) is a powerful algorithm to sample latent variables from Bayesian models. The advent of probabilistic programming languages (PPLs) frees users from writing inference algorithms and lets users focus on modeling.…

机器学习 · 计算机科学 2023-06-05 Jinlin Lai , Javier Burroni , Hui Guan , Daniel Sheldon

Efficient sampling from high-dimensional distributions is a challenging issue which is encountered in many large data recovery problems involving Markov chain Monte Carlo schemes. In this context, sampling using Hamiltonian dynamics is one…

统计方法学 · 统计学 2015-02-02 Lotfi Chaari , Jean-Yves Tourneret , Caroline Chaux , Hadj Batatia

Multiple kernel clustering (MKC) is committed to achieving optimal information fusion from a set of base kernels. Constructing precise and local kernel matrices is proved to be of vital significance in applications since the unreliable…

机器学习 · 计算机科学 2022-07-08 Liang Li , Siwei Wang , Xinwang Liu , En Zhu , Li Shen , Kenli Li , Keqin Li

There is a lack of methodological results to design efficient Markov chain Monte Carlo (MCMC) algorithms for statistical models with discrete-valued high-dimensional parameters. Motivated by this consideration, we propose a simple framework…

统计计算 · 统计学 2017-11-21 Giacomo Zanella

Bayesian modelling and computational inference by Markov chain Monte Carlo (MCMC) is a principled framework for large-scale uncertainty quantification, though is limited in practice by computational cost when implemented in the simplest…

统计计算 · 统计学 2020-09-21 Colin Fox , Tiangang Cui , Markus Neumayer

We investigate the application of randomized quasi-Monte Carlo (RQMC) methods in random feature approximations for kernel-based learning. Compared to the classical Monte Carlo (MC) approach \citep{rahimi2007random}, RQMC improves the…

统计方法学 · 统计学 2025-09-09 Yian Huang , Zhen Huang

Value function based reinforcement learning (RL) algorithms, for example, $Q$-learning, learn optimal policies from datasets of actions, rewards, and state transitions. However, when the underlying state transition dynamics are stochastic…

机器学习 · 计算机科学 2022-03-29 Udari Madhushani , Biswadip Dey , Naomi Ehrich Leonard , Amit Chakraborty

A novel class of non-reversible Markov chain Monte Carlo schemes relying on continuous-time piecewise-deterministic Markov Processes has recently emerged. In these algorithms, the state of the Markov process evolves according to a…

统计方法学 · 统计学 2018-05-16 Paul Vanetti , Alexandre Bouchard-Côté , George Deligiannidis , Arnaud Doucet

Hamiltonian Monte Carlo (HMC) improves the computational efficiency of the Metropolis algorithm by reducing its random walk behavior. Riemannian Manifold HMC (RMHMC) further improves HMC's performance by exploiting the geometric properties…

统计计算 · 统计学 2015-06-22 Shiwei Lan , Vassilios Stathopoulos , Babak Shahbaba , Mark Girolami

In this work, we introduce a novel class of adaptive Monte Carlo methods, called adaptive independent sticky MCMC algorithms, for efficient sampling from a generic target probability density function (pdf). The new class of algorithms…

统计计算 · 统计学 2025-04-09 L. Martino , R. Casarin , F. Leisen , D. Luengo

Hamiltonian Monte Carlo (HMC) is a powerful Markov Chain Monte Carlo (MCMC) method for sampling from complex high-dimensional continuous distributions. However, in many situations it is necessary or desirable to combine HMC with other…

统计计算 · 统计学 2022-01-24 Guangyao Zhou