English
Related papers

Related papers: Accelerating Metropolis-Hastings algorithms by Del…

200 papers

Markov Chain Monte Carlo methods are widely used in signal processing and communications for statistical inference and stochastic optimization. In this work, we introduce an efficient adaptive Metropolis-Hastings algorithm to draw samples…

Computation · Statistics 2016-03-17 David Luengo , Luca Martino

We analyse computational efficiency of Metropolis-Hastings algorithms with AR(1) process proposals. These proposals include, as a subclass, discretized Langevin diffusion (e.g. MALA) and discretized Hamiltonian dynamics (e.g. HMC). By…

Probability · Mathematics 2015-01-15 Richard A. Norton , Colin Fox

It has become increasingly easy nowadays to collect approximate posterior samples via fast algorithms such as variational Bayes, but concerns exist about the estimation accuracy. It is tempting to build solutions that exploit approximate…

Computation · Statistics 2024-06-17 Leo L. Duan , Anirban Bhattacharya

In this paper, we shall optimize the efficiency of Metropolis algorithms for multidimensional target distributions with scaling terms possibly depending on the dimension. We propose a method for determining the appropriate form for the…

Probability · Mathematics 2007-10-25 Mylène Bédard

The general applicability and ease of use of the pseudo-marginal Metropolis--Hastings (PMMH) algorithm, and particle Metropolis--Hastings in particular, makes it a popular method for inference on discretely observed Markovian stochastic…

Statistics Theory · Mathematics 2024-11-19 Chris Sherlock

It is commonly admitted that non-reversible Markov chain Monte Carlo (MCMC) algorithms usually yield more accurate MCMC estimators than their reversible counterparts. In this note, we show that in addition to their variance reduction…

Computation · Statistics 2019-08-27 Marie Vialaret , Florian Maire

We propose a new class of learning algorithms that combines variational approximation and Markov chain Monte Carlo (MCMC) simulation. Naive algorithms that use the variational approximation as proposal distribution can perform poorly…

Machine Learning · Computer Science 2013-01-14 Nando de Freitas , Pedro Hojen-Sorensen , Michael I. Jordan , Stuart Russell

Many modern applications collect highly imbalanced categorical data, with some categories relatively rare. Bayesian hierarchical models combat data sparsity by borrowing information, while also quantifying uncertainty. However, posterior…

Statistics Theory · Mathematics 2017-06-27 James E. Johndrow , Aaron Smith , Natesh Pillai , David B. Dunson

Yang et al. (2016) proved that the symmetric random walk Metropolis--Hastings algorithm for Bayesian variable selection is rapidly mixing under mild high-dimensional assumptions. We propose a novel MCMC sampler using an informed proposal…

Methodology · Statistics 2022-04-26 Quan Zhou , Jun Yang , Dootika Vats , Gareth O. Roberts , Jeffrey S. Rosenthal

Motivated by applications in machine learning and statistics, we study distributed optimization problems over a network of processors, where the goal is to optimize a global objective composed of a sum of local functions. In these problems,…

Optimization and Control · Mathematics 2019-05-14 Thinh T. Doan , Carolyn L. Beck , R. Srikant

We present a novel Metropolis-Hastings method for large datasets that uses small expected-size minibatches of data. Previous work on reducing the cost of Metropolis-Hastings tests yield variable data consumed per sample, with only constant…

Machine Learning · Computer Science 2017-07-11 Daniel Seita , Xinlei Pan , Haoyu Chen , John Canny

Motivated by applications of distributed linear estimation, distributed control and distributed optimization, we consider the question of designing linear iterative algorithms for computing the average of numbers in a network. Specifically,…

Information Theory · Computer Science 2009-08-28 Kyomin Jung , Devavrat Shah , Jinwoo Shin

The popularity of Adaptive MCMC has been fueled on the one hand by its success in applications, and on the other hand, by mathematically appealing and computationally straightforward optimisation criteria for the Metropolis algorithm…

Computation · Statistics 2018-01-30 Cyril Chimisov , Krzysztof Latuszynski , Gareth Roberts

Traditional methods for unsupervised learning of finite mixture models require to evaluate the likelihood of all components of the mixture. This becomes computationally prohibitive when the number of components is large, as it is, for…

Machine Learning · Computer Science 2021-10-12 Milan Papež , Tomáš Pevný , Václav Šmídl

The Hastings algorithm is a key tool in computational science. While mathematically justified by detailed balance, it can be conceptually difficult to grasp. Here, we present two complementary and intuitive ways to derive and understand the…

Computation · Statistics 2019-08-07 David D. L. Minh , Do Le , Minh

In engineering examples, one often encounters the need to sample from unnormalized distributions with complex shapes that may also be implicitly defined through a physical or numerical simulation model, making it computationally expensive…

Methodology · Statistics 2024-11-27 Promit Chakroborty , Michael D. Shields

Can we make Bayesian posterior MCMC sampling more efficient when faced with very large datasets? We argue that computing the likelihood for N datapoints in the Metropolis-Hastings (MH) test to reach a single binary decision is…

Machine Learning · Computer Science 2014-02-17 Anoop Korattikara , Yutian Chen , Max Welling

With the development of machine learning and Big Data, the concepts of linear and non-linear optimization techniques are becoming increasingly valuable for many quantitative disciplines. Problems of that nature are typically solved using…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-21 Wiktor Maj

We consider a generalization of the standard Metropolis algorithm acceptance/rejection decision rule and numerically explore its properties using auxiliary field quantum Monte Carlo. The generalization involves a free parameter which, given…

Strongly Correlated Electrons · Physics 2007-05-23 C. L. Martin , R. M. Fye

In this paper we introduce a new sampling algorithm which has the potential to be adopted as a universal replacement to the Metropolis--Hastings algorithm. It is related to the slice sampler, and motivated by an algorithm which is…

Computation · Statistics 2020-10-19 Yanxin Li , Stephen G. Walker