English
Related papers

Related papers: Adaptive tempered reversible jump algorithm for Ba…

200 papers

The availability of data sets with large numbers of variables is rapidly increasing. The effective application of Bayesian variable selection methods for regression with these data sets has proved difficult since available Markov chain…

Computation · Statistics 2019-05-08 Jim Griffin , Krys Latuszynski , Mark Steel

Bayesian neural learning feature a rigorous approach to estimation and uncertainty quantification via the posterior distribution of weights that represent knowledge of the neural network. This not only provides point estimates of optimal…

Machine Learning · Computer Science 2018-11-13 Rohitash Chandra , Konark Jain , Ratneel V. Deo , Sally Cripps

Reversible jump Markov chain Monte Carlo (RJMCMC) extends ordinary MCMC methods for use in Bayesian multimodel inference. We show that RJMCMC can be implemented as Gibbs sampling with alternating updates of a model indicator and a…

Computation · Statistics 2011-05-27 Richard J. Barker , William A. Link

Replica exchange Monte Carlo (reMC), also known as parallel tempering, is an important technique for accelerating the convergence of the conventional Markov Chain Monte Carlo (MCMC) algorithms. However, such a method requires the evaluation…

Machine Learning · Statistics 2021-03-23 Wei Deng , Qi Feng , Liyao Gao , Faming Liang , Guang Lin

Classic inversion methods adjust a model with a predefined number of parameters to the observed data. With transdimensional inversion algorithms such as the reversible-jump Markov Chain Monte Carlo (rjMCMC), it is possible to vary this…

Geophysics · Physics 2019-09-02 Márk Somogyvári , Sebastian Reich

We propose a novel reversible jump Markov chain Monte Carlo (MCMC) simulated annealing algorithm to optimize radial basis function (RBF) networks. This algorithm enables us to maximize the joint posterior distribution of the network…

Machine Learning · Computer Science 2013-01-18 Christophe Andrieu , Nando de Freitas , Arnaud Doucet

Adaptive and interacting Markov Chains Monte Carlo (MCMC) algorithms are a novel class of non-Markovian algorithms aimed at improving the simulation efficiency for complicated target distributions. In this paper, we study a general…

Statistics Theory · Mathematics 2011-07-15 Gersende Fort , Eric Moulines , Pierre Priouret , Pierre Vandekerkhove

This paper proposes a new randomized strategy for adaptive MCMC using Bayesian optimization. This approach applies to non-differentiable objective functions and trades off exploration and exploitation to reduce the number of potentially…

Computation · Statistics 2011-11-01 Nimalan Mahendran , Ziyu Wang , Firas Hamze , Nando de Freitas

The reversible jump Markov chain Monte Carlo (RJMCMC) method offers an across-model simulation approach for Bayesian estimation and model comparison, by exploring the sampling space that consists of several models of possibly varying…

Methodology · Statistics 2018-10-16 Lampros Bouranis , Nial Friel , Florian Maire

Bayesian inference for exponential family random graph models (ERGMs) is a doubly-intractable problem because of the intractability of both the likelihood and posterior normalizing factor. Auxiliary variable based Markov Chain Monte Carlo…

Computation · Statistics 2020-07-15 Fan Yin , Carter T. Butts

In the context of Bayesian inversion for scientific and engineering modeling, Markov chain Monte Carlo sampling strategies are the benchmark due to their flexibility and robustness in dealing with arbitrary posterior probability density…

Computation · Statistics 2021-12-07 Han Lu , Mohammad Khalil , Thomas Catanach , Jiefu Chen , Xuqing Wu , Xin Fu , Cosmin Safta , Yueqin Huang

Markov chain Monte Carlo algorithms have important applications in counting problems and in machine learning problems, settings that involve estimating quantities that are difficult to compute exactly. How much can quantum computers speed…

Quantum Physics · Physics 2020-02-10 Aram W. Harrow , Annie Y. Wei

In this paper, we introduce a reversible version of a genetically modified mode jumping Markov chain Monte Carlo algorithm (GMJMCMC) for inference on posterior model probabilities in complex model spaces, where the number of explanatory…

Methodology · Statistics 2021-10-18 Aliaksandr Hubin , Florian Frommlet , Geir Storvik

When targeting a distribution that is artificially invariant under some permutations, Markov chain Monte Carlo (MCMC) algorithms face the label-switching problem, rendering marginal inference particularly cumbersome. Such a situation…

Computation · Statistics 2016-08-14 Rémi Bardenet , Olivier Cappé , Gersende Fort , Balázs Kégl

Typical geophysical inversion problems are ill-posed, non-linear and non-unique. Sometimes the problem is trans-dimensional, where the number of unknown parameters is one of the unknowns, which makes the inverse problem even more…

Geophysics · Physics 2010-02-25 Xiaolin Luo

Model comparison for the purposes of selection, averaging and validation is a problem found throughout statistics. Within the Bayesian paradigm, these problems all require the calculation of the posterior probabilities of models within a…

Methodology · Statistics 2015-06-08 Yan Zhou , Adam M Johansen , John A D Aston

Bayesian mixture models are widely applied for unsupervised learning and exploratory data analysis. Markov chain Monte Carlo based on Gibbs sampling and split-merge moves are widely used for inference in these models. However, both methods…

Machine Learning · Statistics 2014-06-03 Tue Herlau , Morten Mørup , Yee Whye Teh , Mikkel N. Schmidt

Due to the need for robust uncertainty quantification, Bayesian neural learning has gained attention in the era of deep learning and big data. Markov Chain Monte-Carlo (MCMC) methods typically implement Bayesian inference which faces…

Machine Learning · Computer Science 2020-05-15 Rohitash Chandra , Konark Jain , Arpit Kapoor , Ashray Aman

We consider versions of the Metropolis algorithm which avoid the inefficiency of rejections. We first illustrate that a natural Uniform Selection Algorithm might not converge to the correct distribution. We then analyse the use of Markov…

Statistics Theory · Mathematics 2024-04-04 J. S. Rosenthal , A. Dote , K. Dabiri , H. Tamura , S. Chen , A. Sheikholeslami

Developing efficient MCMC algorithms is indispensable in Bayesian inference. In parallel tempering, multiple interacting MCMC chains run to more efficiently explore the state space and improve performance. The multiple chains advance…

Computation · Statistics 2021-09-15 A. Marie d'Avigneau , S. S. Singh , L. M. Murray