English
Related papers

Related papers: Particle Gibbs without the Gibbs bit

200 papers

Metropolis Hastings nested sampling evolves a Markov chain, accepting new points along the chain according to a version of the Metropolis Hastings acceptance ratio, which has been modified to satisfy the nested sampling likelihood…

Computation · Statistics 2020-02-12 Kamran Javid

In this paper we describe how MAP inference can be used to sample efficiently from Gibbs distributions. Specifically, we provide means for drawing either approximate or unbiased samples from Gibbs' distributions by introducing low…

Machine Learning · Computer Science 2013-10-01 Tamir Hazan , Subhransu Maji , Tommi Jaakkola

Diffusion models provide expressive priors for forecasting trajectories of dynamical systems, but are typically unreliable in the sparse data regime. Physics-informed machine learning (PIML) improves reliability in such settings; however,…

Machine Learning · Computer Science 2026-01-30 Kaiyuan Tan , Kendra Givens , Peilun Li , Thomas Beckers

Particle filtering methods are widely applied in sequential state estimation within nonlinear non-Gaussian state space model. However, the traditional particle filtering methods suffer the weight degeneracy in the high-dimensional state…

Computation · Statistics 2021-11-22 Yu Han , Kazuyuki Nakamura

State space models contain time-indexed parameters, termed states, as well as static parameters, simply termed parameters. The problem of inferring both static parameters as well as states simultaneously, based on time-indexed observations,…

Computation · Statistics 2021-05-28 Anthony Ebert , Pierre Pudlo , Kerrie Mengersen , Paul Wu , Christopher Drovandi

We develop efficient simulation techniques for Bayesian inference on switching GARCH models. Our contribution to existing literature is manifold. First, we discuss different multi-move sampling techniques for Markov Switching (MS) state…

Statistics Theory · Mathematics 2012-12-24 Monica Billio , Roberto Casarin , Anthony Osuntuyi

Likelihood-free methods such as approximate Bayesian computation (ABC) have extended the reach of statistical inference to problems with computationally intractable likelihoods. Such approaches perform well for small-to-moderate dimensional…

Computation · Statistics 2019-06-12 G. S. Rodrigues , D. J. Nott , S. A. Sisson

Hamiltonian dynamics can be used to produce distant proposals for the Metropolis algorithm, thereby avoiding the slow exploration of the state space that results from the diffusive behaviour of simple random-walk proposals. Though…

Computation · Statistics 2021-06-30 Radford M. Neal

Gibbs sampling is the de facto Markov chain Monte Carlo method used for inference and learning on large scale graphical models. For complicated factor graphs with lots of factors, the performance of Gibbs sampling can be limited by the…

Machine Learning · Computer Science 2018-06-19 Christopher De Sa , Vincent Chen , Wing Wong

In the realm of statistical learning, the increasing volume of accessible data and increasing model complexity necessitate robust methodologies. This paper explores two branches of robust Bayesian methods in response to this trend. The…

Methodology · Statistics 2024-12-02 Masahiro Tanaka

The pseudo-marginal algorithm is a variant of the Metropolis--Hastings algorithm which samples asymptotically from a probability distribution when it is only possible to estimate unbiasedly an unnormalized version of its density.…

Computation · Statistics 2019-12-04 Sebastian M. Schmon , George Deligiannidis , Arnaud Doucet , Michael K. Pitt

Coulomb and log-gases are exchangeable singular Boltzmann-Gibbs measures appearing in mathematical physics at many places, in particular in random matrix theory. We explore experimentally an efficient numerical method for simulating such…

Probability · Mathematics 2019-02-28 Djalil Chafaï , Grégoire Ferré

Computing the marginal likelihood or evidence is one of the core challenges in Bayesian analysis. While there are many established methods for estimating this quantity, they predominantly rely on using a large number of posterior samples…

Computation · Statistics 2021-02-26 Eric Chuu , Debdeep Pati , Anirban Bhattacharya

MCMC methods (Monte Carlo Markov Chain) are a class of methods used to perform simulations per a probability distribution $P$. These methods are often used when we have difficulties to directly sample per a given probability distribution…

Methodology · Statistics 2014-01-21 Papa Ngom , Badiassiatta Don Bosco Diatta

This paper addresses the problem of estimating the Potts parameter B jointly with the unknown parameters of a Bayesian model within a Markov chain Monte Carlo (MCMC) algorithm. Standard MCMC methods cannot be applied to this problem because…

Computation · Statistics 2015-06-05 Marcelo Pereyra , Nicolas Dobigeon , Hadj Batatia , Jean-Yves Tourneret

We study the problem of sampling from and preparing quantum Gibbs states of local commuting Hamiltonians on hypercubic lattices of arbitrary dimension. We prove that any such Gibbs state which satisfies a clustering condition that we coin…

Quantum Physics · Physics 2026-04-21 Ángela Capel , Paul Gondolf , Jan Kochanowski , Cambyse Rouzé

A Riemannian geometric framework for Markov chain Monte Carlo (MCMC) is developed where using the Fisher-Rao metric on the manifold of probability density functions (pdfs), informed proposal densities for Metropolis-Hastings (MH) algorithms…

Methodology · Statistics 2024-11-08 Vivekananda Roy

We develop a novel advanced Particle Markov chain Monte Carlo algorithm that is capable of sampling from the posterior distribution of non-linear state space models for both the unobserved latent states and the unknown model parameters. We…

Methodology · Statistics 2015-03-17 Gareth W. Peters , Geoff R. Hosack , Keith R. Hayes

We introduce a Path Integral Monte Carlo (PIMC) approach that uses the angular momentum representation for the description of interacting rotor systems. Such a choice of representation allows the calculation of momentum properties without…

Chemical Physics · Physics 2025-10-22 Estêvão de Oliveira , Muhammad Shaeer Moeed , Pierre-Nicholas Roy

The iterated conditional sequential Monte Carlo (i-CSMC) algorithm from Andrieu, Doucet and Holenstein (2010) is an MCMC approach for efficiently sampling from the joint posterior distribution of the $T$ latent states in challenging…

Computation · Statistics 2021-08-24 Axel Finke , Alexandre H. Thiery