English
Related papers

Related papers: Delayed rejection schemes for efficient Markov-Cha…

200 papers

Monte Carlo simulations are widely used in many areas including particle accelerators. In this lecture, after a short introduction and reviewing of some statistical backgrounds, we will discuss methods such as direct inversion, rejection…

Computational Physics · Physics 2020-06-19 Ji Qiang

Monte Carlo methods represent the "de facto" standard for approximating complicated integrals involving multidimensional target distributions. In order to generate random realizations from the target distribution, Monte Carlo techniques use…

Computation · Statistics 2022-01-21 L. Martino , V. Elvira , D. Luengo , J. Corander

There is a tension between robustness and efficiency when designing Markov chain Monte Carlo (MCMC) sampling algorithms. Here we focus on robustness with respect to tuning parameters, showing that more sophisticated algorithms tend to be…

Computation · Statistics 2020-05-12 Samuel Livingstone , Giacomo Zanella

Evaluating the degree of partisan districting (Gerrymandering) in a statistical framework typically requires an ensemble of districting plans which are drawn from a prescribed probability distribution that adheres to a realistic and…

Computation · Statistics 2020-08-19 Gregory Herschlag , Jonathan C. Mattingly , Matthias Sachs , Evan Wyse

Sampling problems are promising candidates for demonstrating quantum advantage, and one approach known as quantum-enhanced Markov chain Monte Carlo [Layden, D. et al., Nature 619, 282-287 (2023)] uses quantum samples as a proposal…

Quantum Physics · Physics 2026-04-23 Yuya Kawamata , Yuichiro Nakano , Keisuke Fujii

Markov chain Monte Carlo methods have become popular in statistics as versatile techniques to sample from complicated probability distributions. In this work, we propose a method to parameterize and train transition kernels of Markov chains…

Machine Learning · Computer Science 2024-06-05 Evgenii Egorov , Ricardo Valperga , Efstratios Gavves

We consider posterior sampling in the very common Bayesian hierarchical model in which observed data depends on high-dimensional latent variables that, in turn, depend on relatively few hyperparameters. When the full conditional over the…

Computation · Statistics 2016-10-24 Richard A. Norton , J. Andres Christen , Colin Fox

We are concerned with a novel Bayesian statistical framework for the characterization of natural subsurface formations, a very challenging task. Because of the large dimension of the stochastic space of the prior distribution in the…

Numerical Analysis · Mathematics 2023-02-23 Alsadig Ali , Abdullah Al-Mamun , Felipe Pereira , Arunasalam Rahunanthan

We investigate the properties of the Hybrid Monte-Carlo algorithm (HMC) in high dimensions. HMC develops a Markov chain reversible w.r.t. a given target distribution $\Pi$ by using separable Hamiltonian dynamics with potential $-\log\Pi$.…

Many applications in signal processing require the estimation of some parameters of interest given a set of observed data. More specifically, Bayesian inference needs the computation of {\it a-posteriori} estimators which are often…

Computation · Statistics 2022-01-21 Luca Martino

In dynamic Monte Carlo simulations, using for example the Metropolis dynamic, it is often required to simulate for long times and to simulate large systems. We present an overview of advanced algorithms to simulate for larger times and to…

Statistical Mechanics · Physics 2007-05-23 M. A. Novotny , Alice K. Kolakowska , G. Korniss

Markov Chain Monte Carlo (MCMC) methods such as Gibbs sampling are finding widespread use in applied statistics and machine learning. These often lead to difficult computational problems, which are increasingly being solved on parallel and…

Machine Learning · Statistics 2018-06-05 Alexander Terenin , Eric P. Xing

In Bayesian phylogenetics, our goal is to estimate the posterior distribution over phylogenetic trees. Markov chain Monte Carlo methods are widely used to approximate the phylogenetic posterior distributions. For large-scale sequence data,…

Methodology · Statistics 2026-05-12 Wentao Yu , Shijia Wang

Incorporating information about the target distribution in proposal mechanisms generally produces efficient Markov chain Monte Carlo algorithms (or at least, algorithms that are more efficient than uninformed counterparts). For instance, it…

Computation · Statistics 2021-08-27 Philippe Gagnon

Standard Markov chain Monte Carlo methods struggle to explore distributions that are concentrated in the neighbourhood of low-dimensional structures. These pathologies naturally occur in a number of situations. For example, they are common…

Computation · Statistics 2021-12-02 Khai Xiang Au , Matthew M. Graham , Alexandre H. Thiery

Markov Chain Monte Carlo (MCMC) algorithms are often used for approximate inference inside learning, but their slow mixing can be difficult to diagnose and the approximations can seriously degrade learning. To alleviate these issues, we…

Machine Learning · Computer Science 2015-02-25 Jacob Steinhardt , Percy Liang

A Kernel Adaptive Metropolis-Hastings algorithm is introduced, for the purpose of sampling from a target distribution with strongly nonlinear support. The algorithm embeds the trajectory of the Markov chain into a reproducing kernel Hilbert…

Machine Learning · Statistics 2014-06-16 Dino Sejdinovic , Heiko Strathmann , Maria Lomeli Garcia , Christophe Andrieu , Arthur Gretton

We propose a sequential Markov chain Monte Carlo (SMCMC) algorithm to sample from a sequence of probability distributions, corresponding to posterior distributions at different times in on-line applications. SMCMC proceeds as in usual MCMC…

Statistics Theory · Mathematics 2013-08-20 Yun Yang , David B. Dunson

A large class of spatial models contains intractable normalizing functions, such as spatial lattice models, interaction spatial point processes, and social network models. Bayesian inference for such models is challenging since the…

Methodology · Statistics 2026-01-05 Jong Hyeon Lee , Jongmin Kim , Heesang Lee , Jaewoo Park

In this paper, we address technical difficulties that arise when applying Markov chain Monte Carlo (MCMC) to hierarchical models designed to perform clustering in the space of latent parameters of subject-wise generative models.…

Quantitative Methods · Quantitative Biology 2020-12-15 Yu Yao , Klaas E. Stephan