English
Related papers

Related papers: On the convergence of the Metropolis algorithm wit…

200 papers

The purpose of this paper is to introduce a new Markov chain Monte Carlo method and exhibit its efficiency by simulation and high-dimensional asymptotic theory. Key fact is that our algorithm has a reversible proposal transition kernel,…

Methodology · Statistics 2014-12-22 Kengo Kamatani

Couplings play a central role in the analysis of Markov chain Monte Carlo algorithms and appear increasingly often in the algorithms themselves, e.g. in convergence diagnostics, parallelization, and variance reduction techniques. Existing…

Computation · Statistics 2020-10-20 John O'Leary , Guanyang Wang , Pierre E. Jacob

Uncertainty estimation is a key issue when considering the application of deep neural network methods in science and engineering. In this work, we introduce a novel algorithm that quantifies epistemic uncertainty via Monte Carlo sampling…

Machine Learning · Statistics 2024-12-06 Sebastian Bieringer , Gregor Kasieczka , Maximilian F. Steffen , Mathias Trabs

Hamiltonian Monte Carlo (HMC) has been progressively incorporated within the statistician's toolbox as an alternative sampling method in settings when standard Metropolis-Hastings is inefficient. HMC generates a Markov chain on an augmented…

Computation · Statistics 2026-02-09 Julien Stoehr , Alan Benson , Nial Friel

Markov chain Monte Carlo (MCMC) methods are widely used in machine learning. One of the major problems with MCMC is the question of how to design chains that mix fast over the whole state space; in particular, how to select the parameters…

Machine Learning · Computer Science 2019-07-16 Kiarash Shaloudegi , András György

The Metropolis-Hastings (MH) algorithm is the prototype for a class of Markov chain Monte Carlo methods that propose transitions between states and then accept or reject the proposal. These methods generate a correlated sequence of random…

Computational Physics · Physics 2011-05-12 Albert H. Mao , Rohit V. Pappu

We describe ergodic properties of some Metropolis-Hastings (MH) algorithms for heavy-tailed target distributions. The analysis usually falls into sub-geometric ergodicity framework but we prove that the mixed preconditioned Crank-Nicolson…

Methodology · Statistics 2016-02-10 Kengo Kamatani

We prove explicit, i.e. non-asymptotic, error bounds for Markov chain Monte Carlo methods. The problem is to compute the expectation of a function f with respect to a measure {\pi}. Different convergence properties of Markov chains imply…

Probability · Mathematics 2020-04-07 Daniel Rudolf

We present a Markov Chain Monte Carlo algorithm based on the Metropolis algorithm for simulation of the flow of two immiscible fluids in a porous medium under macroscopic steady-state conditions using a dynamical pore network model that…

Fluid Dynamics · Physics 2016-12-20 Isha Savani , Santanu Sinha , Alex Hansen , Dick Bedeaux , Signe Kjelstrup , Morten Vassvik

Probabilistic programming languages can simplify the development of machine learning techniques, but only if inference is sufficiently scalable. Unfortunately, Bayesian parameter estimation for highly coupled models such as regressions and…

Machine Learning · Statistics 2015-03-10 Yutian Chen , Vikash Mansinghka , Zoubin Ghahramani

Hamiltonian Monte Carlo (HMC) is a popular Markov chain Monte Carlo (MCMC) algorithm that generates proposals for a Metropolis-Hastings algorithm by simulating the dynamics of a Hamiltonian system. However, HMC is sensitive to large time…

Machine Learning · Statistics 2016-09-15 Xiaoyu Lu , Valerio Perrone , Leonard Hasenclever , Yee Whye Teh , Sebastian J. Vollmer

Couplings play a central role in the analysis of Markov chain convergence and in the construction of novel Markov chain Monte Carlo estimators, diagnostics, and variance reduction techniques. The set of possible couplings is often…

Statistics Theory · Mathematics 2023-01-09 John O'Leary , Guanyang Wang

In this paper we address the problem of Monte Carlo approximation of posterior probability distributions in stochastic kinetic models (SKMs). SKMs are multivariate Markov jump processes that model the interactions among species in…

Methodology · Statistics 2014-04-22 Eugenia Koblents , Joaquín Míguez

Presented in this paper is a Markov chain Monte Carlo (MCMC) routine for conducting coherent parameter estimation for interferometric gravitational wave observations of an inspiral of binary compact objects using data from multiple…

General Relativity and Quantum Cosmology · Physics 2008-11-26 Christian Röver , Renate Meyer , Nelson Christensen

Federated learning performed by a decentralized networks of agents is becoming increasingly important with the prevalence of embedded software on autonomous devices. Bayesian approaches to learning benefit from offering more information as…

Machine Learning · Computer Science 2021-07-16 Vyacheslav Kungurtsev , Adam Cobb , Tara Javidi , Brian Jalaian

Global search and optimization of long-duration, low-thrust spacecraft trajectories with the indirect method is challenging due to a complex solution space and the difficulty of generating good initial guesses for the costate variables.…

Earth and Planetary Astrophysics · Physics 2025-10-06 Jannik Graebner , Ryne Beeson

The Markov Chain Monte Carlo method is the dominant paradigm for posterior computation in Bayesian analysis. It is common to control computation time by making approximations to the Markov transition kernel. Comparatively little attention…

Computation · Statistics 2017-08-30 James E. Johndrow , Jonathan C. Mattingly , Sayan Mukherjee , David Dunson

MCMC methods (Monte Carlo Markov Chain) are a class of methods used to perform simulations per a probability distribution $P$. These methods are often used when we have difficulties to directly sample per a given probability distribution…

Methodology · Statistics 2014-01-21 Papa Ngom , Badiassiatta Don Bosco Diatta

Sequential Monte Carlo Samplers are a class of stochastic algorithms for Monte Carlo integral estimation w.r.t. probability distributions, which combine elements of Markov chain Monte Carlo methods and importance sampling/resampling…

Probability · Mathematics 2007-05-23 Andreas Eberle , Carlo Marinelli

I show how Markov chain sampling with the Metropolis-Hastings algorithm can be modified so as to take bigger steps when the distribution being sampled from has the characteristic that its density can be quickly recomputed for a new point if…

Statistics Theory · Mathematics 2007-06-13 Radford M. Neal