中文
相关论文

相关论文: Optimal scaling for partially updating MCMC algori…

200 篇论文

Hamiltonian Monte Carlo (HMC) is a powerful Markov Chain Monte Carlo (MCMC) method for sampling from complex high-dimensional continuous distributions. However, in many situations it is necessary or desirable to combine HMC with other…

统计计算 · 统计学 2022-01-24 Guangyao Zhou

Estimation in the deformable template model is a big challenge in image analysis. The issue is to estimate an atlas of a population. This atlas contains a template and the corresponding geometrical variability of the observed shapes. The…

统计理论 · 数学 2013-09-09 Stéphanie Allassonniere , Estelle Kuhn

The adaptive Metropolis (AM) algorithm of Haario, Saksman and Tamminen [Bernoulli 7 (2001) 223-242] uses the estimated covariance of the target distribution in the proposal distribution. This paper introduces a new robust adaptive…

统计计算 · 统计学 2011-05-30 Matti Vihola

We present a novel Metropolis-Hastings method for large datasets that uses small expected-size minibatches of data. Previous work on reducing the cost of Metropolis-Hastings tests yield variable data consumed per sample, with only constant…

机器学习 · 计算机科学 2017-07-11 Daniel Seita , Xinlei Pan , Haoyu Chen , John Canny

Based on the algorithm Informed Importance Tempering (IIT) proposed by Li et al. (2023) we propose an algorithm that uses an adaptive bounded balancing function. We argue why implementing parallel tempering where each replica uses a…

We present a two-stage Metropolis-Hastings algorithm for sampling probabilistic models, whose log-likelihood is computationally expensive to evaluate, by using a surrogate Gaussian Process (GP) model. The key feature of the approach, and…

机器学习 · 统计学 2021-09-29 Alessio Benavoli , Jason Wyse , Arthur White

It is well known in many settings that reversible Langevin diffusions in confining potentials converge to equilibrium exponentially fast. Adding irreversible perturbations to the drift of a Langevin diffusion that maintain the same…

统计方法学 · 统计学 2019-07-02 Michela Ottobre , Natesh S. Pillai , Konstantinos Spiliopoulos

To sample from a given target distribution, Markov chain Monte Carlo (MCMC) sampling relies on constructing an ergodic Markov chain with the target distribution as its invariant measure. For any MCMC method, an important question is how to…

概率论 · 数学 2023-08-15 Federica Milinanni , Pierre Nyquist

Latent variable models are widely used in social and behavioural sciences, including education, psychology, and political science. With the increasing availability of large and complex datasets, high-dimensional latent variable models have…

统计计算 · 统计学 2025-12-09 Motonori Oka , Yunxiao Chen , Irini Moustaki

For random-walk Metropolis (RWM) and parallel tempering (PT) algorithms, an asymptotic acceptance rate of around 0.234 is known to be optimal in certain high-dimensional limits. However, its practical relevance is uncertain due to…

统计计算 · 统计学 2025-08-05 Aidan Li , Liyan Wang , Tianye Dou , Jeffrey S. Rosenthal

Many modern applications collect highly imbalanced categorical data, with some categories relatively rare. Bayesian hierarchical models combat data sparsity by borrowing information, while also quantifying uncertainty. However, posterior…

统计理论 · 数学 2017-06-27 James E. Johndrow , Aaron Smith , Natesh Pillai , David B. Dunson

A Kernel Adaptive Metropolis-Hastings algorithm is introduced, for the purpose of sampling from a target distribution with strongly nonlinear support. The algorithm embeds the trajectory of the Markov chain into a reproducing kernel Hilbert…

Sampling from heavy-tailed and multimodal distributions is challenging when neither the target density nor the proposal density can be evaluated, as in $\alpha$-stable L\'evy-driven fractional Langevin algorithms. While the target…

机器学习 · 统计学 2026-02-03 Ahmed Aloui , Junyi Liao , Ali Hasan , Jose Blanchet , Vahid Tarokh

The Markov chain Monte Carlo method (MCMC), especially the Metropolis-Hastings (MH) algorithm, is a widely used technique for sampling from a target probability distribution $P$ on a state space $\Omega$ and applied to various problems such…

量子物理 · 物理学 2023-03-13 Koichi Miyamoto

The Hastings algorithm is a key tool in computational science. While mathematically justified by detailed balance, it can be conceptually difficult to grasp. Here, we present two complementary and intuitive ways to derive and understand the…

统计计算 · 统计学 2019-08-07 David D. L. Minh , Do Le , Minh

Markov Chain Monte Carlo (MCMC) algorithms are routinely used to draw samples from distributions with intractable normalization constants. However, standard MCMC algorithms do not apply to doubly-intractable distributions in which there are…

统计计算 · 统计学 2012-07-02 Iain Murray , Zoubin Ghahramani , David MacKay

The Metropolis algorithm (MA) is a classic stochastic local search heuristic. It avoids getting stuck in local optima by occasionally accepting inferior solutions. To better and in a rigorous manner understand this ability, we conduct a…

神经与进化计算 · 计算机科学 2023-05-16 Benjamin Doerr , Taha El Ghazi El Houssaini , Amirhossein Rajabi , Carsten Witt

A classical approach for approximating expectations of functions w.r.t. partially known distributions is to compute the average of function values along a trajectory of a Metropolis-Hastings (MH) Markov chain. A key part in the MH algorithm…

统计计算 · 统计学 2020-02-20 Daniel Rudolf , Björn Sprungk

This paper introduces a new Markov Chain Monte Carlo method for Bayesian variable selection in high dimensional settings. The algorithm is a Hastings-Metropolis sampler with a proposal mechanism which combines a Metropolis Adjusted Langevin…

统计理论 · 数学 2015-09-14 Amandine Schreck , Gersende Fort , Sylvain Le Corff , Eric Moulines

We propose a new method called the Metropolis-adjusted Mirror Langevin algorithm for approximate sampling from distributions whose support is a compact and convex set. This algorithm adds an accept-reject filter to the Markov chain induced…

统计计算 · 统计学 2024-06-24 Vishwak Srinivasan , Andre Wibisono , Ashia Wilson