English
Related papers

Related papers: A multiple-try Metropolis-Hastings algorithm with …

200 papers

The multiple-try Metropolis (MTM) algorithm is an extension of the Metropolis-Hastings (MH) algorithm by selecting the proposed state among multiple trials according to some weight function. Although MTM has gained great popularity owing to…

Methodology · Statistics 2022-10-17 Hyunwoong Chang , Changwoo J. Lee , Zhao Tang Luo , Huiyan Sang , Quan Zhou

We explore a general framework in Markov chain Monte Carlo (MCMC) sampling where sequential proposals are tried as a candidate for the next state of the Markov chain. This sequential-proposal framework can be applied to various existing…

Computation · Statistics 2019-08-21 Joonha Park , Yves F. Atchadé

Traditional methods for unsupervised learning of finite mixture models require to evaluate the likelihood of all components of the mixture. This becomes computationally prohibitive when the number of components is large, as it is, for…

Machine Learning · Computer Science 2021-10-12 Milan Papež , Tomáš Pevný , Václav Šmídl

Over the last decades, various "non-linear" MCMC methods have arisen. While appealing for their convergence speed and efficiency, their practical implementation and theoretical study remain challenging. In this paper, we introduce a…

Statistics Theory · Mathematics 2022-08-04 Grégoire Clarté , Antoine Diez , Jean Feydy

The computation of Bayesian estimates of system parameters and functions of them on the basis of observed system performance data is a common problem within system identification. This is a previously studied issue where stochastic…

Computation · Statistics 2018-05-09 Johan Dahlin , Adrian Wills , Brett Ninness

The problem of optimally scaling the proposal distribution in a Markov chain Monte Carlo algorithm is critical to the quality of the generated samples. Much work has gone into obtaining such results for various Metropolis-Hastings (MH)…

Computation · Statistics 2022-02-07 Sanket Agrawal , Dootika Vats , Krzysztof Łatuszyński , Gareth O. Roberts

We construct an adaptive independent Metropolis-Hastings sampler that uses a mixture of normals as a proposal distribution. To take full advantage of the potential of adaptive sampling our algorithm updates the mixture of normals…

Computation · Statistics 2008-01-15 P. Giordani , R. Kohn

The Metropolis-Hastings algorithm is a cornerstone of Markov Chain Monte Carlo methods, underpinning a wide range of applications in computational physics, Bayesian inference, and machine learning. Quantum variants of Metropolis-Hastings…

Quantum Physics · Physics 2026-05-07 Miguel Carrasco-Arango , Rosa M. Badia , Artur Garcia-Saez

A Kernel Adaptive Metropolis-Hastings algorithm is introduced, for the purpose of sampling from a target distribution with strongly nonlinear support. The algorithm embeds the trajectory of the Markov chain into a reproducing kernel Hilbert…

Machine Learning · Statistics 2014-06-16 Dino Sejdinovic , Heiko Strathmann , Maria Lomeli Garcia , Christophe Andrieu , Arthur Gretton

We show that for any multiple-try Metropolis algorithm, one can always accept the proposal and evaluate the importance weight that is needed to correct for the bias without extra computational cost. This results in a general, convenient,…

Computation · Statistics 2024-10-03 Guanxun Li , Aaron Smith , Quan Zhou

Couplings play a central role in the analysis of Markov chain Monte Carlo algorithms and appear increasingly often in the algorithms themselves, e.g. in convergence diagnostics, parallelization, and variance reduction techniques. Existing…

Computation · Statistics 2020-10-20 John O'Leary , Guanyang Wang , Pierre E. Jacob

Sampling from the lattice Gaussian distribution is emerging as an important problem in coding and cryptography. In this paper, the classic Metropolis-Hastings (MH) algorithm from Markov chain Monte Carlo (MCMC) methods is adapted for…

Information Theory · Computer Science 2020-10-23 Zheng Wang , Cong Ling

Monte Carlo (MC) sampling methods are widely applied in Bayesian inference, system simulation and optimization problems. The Markov Chain Monte Carlo (MCMC) algorithms are a well-known class of MC methods which generate a Markov chain with…

Methodology · Statistics 2024-06-21 Luca Martino , Victor Elvira

State-space models (SSMs) are commonly used to model time series data where the observations depend on an unobserved latent process. However, inference on the model parameters of an SSM can be challenging, especially when the likelihood of…

Computation · Statistics 2023-08-08 Mary Llewellyn , Ruth King , Víctor Elvira , Gordon Ross

Multiple-try Metropolis (MTM) is a popular Markov chain Monte Carlo method with the appealing feature of being amenable to parallel computing. At each iteration, it samples several candidates for the next state of the Markov chain and…

Computation · Statistics 2023-08-25 Philippe Gagnon , Florian Maire , Giacomo Zanella

We develop a new Markov chain on graph partitions that makes relatively global moves yet is computationally feasible to be used as the proposal in the Metropolis-Hastings method. Our resulting algorithm can be made reversible and able to…

Data Structures and Algorithms · Computer Science 2021-05-11 Eric Autrey , Daniel Carter , Gregory Herschlag , Zach Hunter , Jonathan C. Mattingly

Many applications in signal processing require the estimation of some parameters of interest given a set of observed data. More specifically, Bayesian inference needs the computation of {\it a-posteriori} estimators which are often…

Computation · Statistics 2022-01-21 Luca Martino

The Metropolis-Hastings (MH) algorithm is the prototype for a class of Markov chain Monte Carlo methods that propose transitions between states and then accept or reject the proposal. These methods generate a correlated sequence of random…

Computational Physics · Physics 2011-05-12 Albert H. Mao , Rohit V. Pappu

We introduce a Metropolis-Hastings Markov chain for Boltzmann distributions of classical spin systems. It relies on approximate tensor network contractions to propose correlated collective updates at each step of the evolution. We present…

We perform Markov chain Monte Carlo simulations for a Bayesian inference of the GJR-GARCH model which is one of asymmetric GARCH models. The adaptive construction scheme is used for the construction of the proposal density in the…

Computational Finance · Quantitative Finance 2010-12-30 Tetsuya Takaishi