English
Related papers

Related papers: An Asymptotically Efficient Metropolis-Hastings Sa…

200 papers

We analyse computational efficiency of Metropolis-Hastings algorithms with stochastic AR(1) process proposals. These proposals include, as a subclass, discretized Langevin diffusion (e.g. MALA) and discretized Hamiltonian dynamics (e.g.…

Computation · Statistics 2016-05-23 Richard A. Norton , Colin Fox

We propose an adaptive independent Metropolis--Hastings algorithm with the ability to learn from all previous proposals in the chain except the current location. It is an extension of the independent Metropolis--Hastings algorithm.…

Probability · Mathematics 2009-03-04 Lars Holden , Ragnar Hauge , Marit Holden

Sampling from distributions of implicitly defined shapes enables analysis of various energy functionals used for image segmentation. Recent work describes a computationally efficient Metropolis-Hastings method for accomplishing this task.…

Computer Vision and Pattern Recognition · Computer Science 2012-05-17 Jason Chang , John W. Fisher

Markov chain Monte Carlo (MCMC) methods are one of the most popular classes of algorithms for sampling from a target probability distribution. A rising trend in recent years consists in analyzing the convergence of MCMC algorithms using…

Probability · Mathematics 2025-04-30 Federica Milinanni

Particle Metropolis-Hastings enables Bayesian parameter inference in general nonlinear state space models (SSMs). However, in many implementations a random walk proposal is used and this can result in poor mixing if not tuned correctly…

Computation · Statistics 2016-03-11 Johan Dahlin , Fredrik Lindsten , Thomas B. Schön

The Multiple-try Metropolis (MTM) method is an interesting extension of the classical Metropolis-Hastings algorithm. However, theoretical understandings of its convergence behavior as well as whether and how it may help are still unknown.…

Computation · Statistics 2023-02-06 Xiaodong Yang , Jun S. Liu

We construct an adaptive independent Metropolis-Hastings sampler that uses a mixture of normals as a proposal distribution. To take full advantage of the potential of adaptive sampling our algorithm updates the mixture of normals…

Computation · Statistics 2008-01-15 P. Giordani , R. Kohn

The multiple-try Metropolis (MTM) algorithm is an extension of the Metropolis-Hastings (MH) algorithm by selecting the proposed state among multiple trials according to some weight function. Although MTM has gained great popularity owing to…

Methodology · Statistics 2022-10-17 Hyunwoong Chang , Changwoo J. Lee , Zhao Tang Luo , Huiyan Sang , Quan Zhou

We show that it is feasible to carry out exact Bayesian inference for non-Gaussian state space models using an adaptive Metropolis Hastings sampling scheme with the likelihood approximated by the particle filter. Furthermore, an adapyive…

Computation · Statistics 2009-11-03 Ralph Silva , Paolo Giordani , Robert Kohn , Mike Pitt

Experimental calibration of dynamic thermal models is required for model predictive control and characterization of building energy performance. In these applications, the uncertainty assessment of the parameter estimates is decisive; this…

Applications · Statistics 2019-04-25 L. Raillon , Christian Ghiaus

Yang et al. (2016) proved that the symmetric random walk Metropolis--Hastings algorithm for Bayesian variable selection is rapidly mixing under mild high-dimensional assumptions. We propose a novel MCMC sampler using an informed proposal…

Methodology · Statistics 2022-04-26 Quan Zhou , Jun Yang , Dootika Vats , Gareth O. Roberts , Jeffrey S. Rosenthal

We analyse computational efficiency of Metropolis-Hastings algorithms with AR(1) process proposals. These proposals include, as a subclass, discretized Langevin diffusion (e.g. MALA) and discretized Hamiltonian dynamics (e.g. HMC). By…

Probability · Mathematics 2015-01-15 Richard A. Norton , Colin Fox

Structure learning via MCMC sampling is known to be very challenging because of the enormous search space and the existence of Markov equivalent DAGs. Theoretical results on the mixing behavior are lacking. In this work, we prove the rapid…

Statistics Theory · Mathematics 2023-04-07 Quan Zhou , Hyunwoong Chang

We propose a new sampling algorithm combining two quite powerful ideas in the Markov chain Monte Carlo literature -- adaptive Metropolis sampler and two-stage Metropolis-Hastings sampler. The proposed sampling method will be particularly…

Computation · Statistics 2021-01-05 Anirban Mondal , Kai Yin , Abhijit Mandal

We consider the application of active subspaces to inform a Metropolis-Hastings algorithm, thereby aggressively reducing the computational dimension of the sampling problem. We show that the original formulation, as proposed by Constantine,…

Computation · Statistics 2017-12-08 Ingmar Schuster , Paul G. Constantine , T. J. Sullivan

Deterministic compartmental models are predominantly used in the modeling of infectious diseases, though stochastic models are considered more realistic, yet are complicated to estimate due to missing data. In this paper we present a novel…

Computation · Statistics 2022-06-22 Shuying Wang , Stephen G. Walker

The ability to generate samples of the random effects from their conditional distributions is fundamental for inference in mixed effects models. Random walk Metropolis is widely used to perform such sampling, but this method is known to…

Methodology · Statistics 2019-10-29 Belhal Karimi , Marc Lavielle , Eric Moulines

We study the computational complexity of a Metropolis-Hastings algorithm for Bayesian community detection. We first establish a posterior strong consistency result for a natural prior distribution on stochastic block models under the…

Statistics Theory · Mathematics 2018-11-08 Bumeng Zhuo , Chao Gao

Relational learning can be used to augment one data source with other correlated sources of information, to improve predictive accuracy. We frame a large class of relational learning problems as matrix factorization problems, and propose a…

Machine Learning · Computer Science 2012-03-19 Ajit P. Singh , Geoffrey Gordon

To sample from a given target distribution, Markov chain Monte Carlo (MCMC) sampling relies on constructing an ergodic Markov chain with the target distribution as its invariant measure. For any MCMC method, an important question is how to…

Probability · Mathematics 2023-08-15 Federica Milinanni , Pierre Nyquist