中文
相关论文

相关论文: The No-U-Turn Sampler: Adaptively Setting Path Len…

200 篇论文

In this work we present a non-reversible, tuning- and rejection-free Markov chain Monte Carlo which naturally fits in the framework of hit-and-run. The sampler only requires access to the gradient of the log-density function, hence the…

统计计算 · 统计学 2018-10-31 Amir Sepehri , Jelena Markovic

We demonstrate the use of a variational method to determine a quantitative lower bound on the rate of convergence of Markov Chain Monte Carlo (MCMC) algorithms as a function of the target density and proposal density. The bound relies on…

数据分析、统计与概率 · 物理学 2013-05-29 Fergal P. Casey , Joshua J. Waterfall , Ryan N. Gutenkunst , Christopher R. Myers , James P. Sethna

Markov Chain Monte Carlo (MCMC) is a class of algorithms to sample complex and high-dimensional probability distributions. The Metropolis-Hastings (MH) algorithm, the workhorse of MCMC, provides a simple recipe to construct reversible…

We propose a new framework for Hamiltonian Monte Carlo (HMC) on truncated probability distributions with smooth underlying density functions. Traditional HMC requires computing the gradient of potential function associated with the target…

机器学习 · 统计学 2017-09-12 Kexin Yi , Finale Doshi-Velez

Markov Chain Monte Carlo algorithms, the method of choice to sample from generic high-dimensional distributions, are rarely used for continuous one-dimensional distributions, for which more effective approaches are usually available (e.g.…

统计计算 · 统计学 2024-12-10 Ari Pakman

We explore the construction of new symplectic numerical integration schemes to be used in Hamiltonian Monte Carlo and study their efficiency. Two integration schemes from Blanes et al. (2014), and a new scheme based on optimal acceptance…

统计计算 · 统计学 2016-08-26 Janne Mannseth , Tore Selland Kleppe , Hans J. Skaug

In this work, we introduce the No-Underrun Sampler (NURS), a locally-adaptive, gradient-free Markov chain Monte Carlo method that blends ideas from Hit-and-Run and the No-U-Turn Sampler. NURS dynamically adapts to the local scale of the…

统计理论 · 数学 2025-02-27 Nawaf Bou-Rabee , Bob Carpenter , Sifan Liu , Stefan Oberdörster

Markov Chain Monte Carlo (MCMC) algorithms are routinely used to draw samples from distributions with intractable normalization constants. However, standard MCMC algorithms do not apply to doubly-intractable distributions in which there are…

统计计算 · 统计学 2012-07-02 Iain Murray , Zoubin Ghahramani , David MacKay

Hamiltonian Monte Carlo (HMC) exploits Hamiltonian dynamics to construct efficient proposals for Markov chain Monte Carlo (MCMC). In this paper, we present a generalization of HMC which exploits \textit{non-canonical} Hamiltonian dynamics.…

机器学习 · 统计学 2017-08-22 Nilesh Tripuraneni , Mark Rowland , Zoubin Ghahramani , Richard Turner

We explore the use of Hamiltonian Monte Carlo (HMC) sampling as a probabilistic last layer approach for deep neural networks (DNNs). While HMC is widely regarded as a gold standard for uncertainty estimation, the computational demands limit…

机器学习 · 计算机科学 2025-07-15 Koen Vellenga , H. Joe Steinhauer , Göran Falkman , Jonas Andersson , Anders Sjögren

Federated learning performed by a decentralized networks of agents is becoming increasingly important with the prevalence of embedded software on autonomous devices. Bayesian approaches to learning benefit from offering more information as…

机器学习 · 计算机科学 2021-07-16 Vyacheslav Kungurtsev , Adam Cobb , Tara Javidi , Brian Jalaian

We consider the recently introduced Transformation-based Markov Chain Monte Carlo (TMCMC) (Dutta and Bhattacharya (2014)), a methodology that is designed to update all the parameters simultaneously using some simple deterministic…

统计方法学 · 统计学 2017-01-24 Kushal Kumar Dey , Sourabh Bhattacharya

An irreversible Markov-chain Monte Carlo (MCMC) algorithm with skew detailed balance conditions originally proposed by Turitsyn et al. is extended to general discrete systems on the basis of the Metropolis-Hastings scheme. To evaluate the…

统计力学 · 物理学 2016-04-21 Yuji Sakai , Koji Hukushima

Employing Bayesian inference to calibrate constitutive model parameters has grown substantially in recent years. Among the available techniques, Markov Chain Monte Carlo (MCMC) sampling remains one of the most widely used approaches for…

计算工程、金融与科学 · 计算机科学 2026-04-02 Aricia Rinkens , Rodrigo L. S. Silva , Erik Quaeghebeur , Nick Jaensson , Clemens Verhoosel

In this work we present a new and efficient Bayesian method for nonlinear three dimensional large scale structure inference. We employ a Hamiltonian Monte Carlo (HMC) sampler to obtain samples from a multivariate highly non-Gaussian…

宇宙学与河外天体物理 · 物理学 2015-05-14 J. Jasche , F. S. Kitaura

The number of low-energy constants (LECs) in chiral effective field theory ($\chi$EFT) grows rapidly with increasing chiral order, necessitating the use of Markov chain Monte Carlo techniques for sampling their posterior probability density…

核理论 · 物理学 2024-07-29 Isak Svensson , Andreas Ekström , Christian Forssén

Hamiltonian Monte Carlo (HMC) improves the computational efficiency of the Metropolis algorithm by reducing its random walk behavior. Riemannian Manifold HMC (RMHMC) further improves HMC's performance by exploiting the geometric properties…

统计计算 · 统计学 2015-06-22 Shiwei Lan , Vassilios Stathopoulos , Babak Shahbaba , Mark Girolami

Pulsar timing arrays (PTAs) detect low-frequency gravitational waves (GWs) by looking for correlated deviations in pulse arrival times. Current Bayesian searches use Markov Chain Monte Carlo (MCMC) methods, which struggle to sample the…

天体物理仪器与方法 · 物理学 2023-03-08 Gabriel E. Freedman , Aaron D. Johnson , Rutger van Haasteren , Sarah J. Vigeland

The Metropolis-Hastings (MH) algorithm is the prototype for a class of Markov chain Monte Carlo methods that propose transitions between states and then accept or reject the proposal. These methods generate a correlated sequence of random…

计算物理 · 物理学 2011-05-12 Albert H. Mao , Rohit V. Pappu

We propose a fast stochastic Hamilton Monte Carlo (HMC) method, for sampling from a smooth and strongly log-concave distribution. At the core of our proposed method is a variance reduction technique inspired by the recent advance in…

机器学习 · 统计学 2020-10-20 Difan Zou , Pan Xu , Quanquan Gu