English
Related papers

Related papers: Particle Metropolis-Hastings using gradient and He…

200 papers

We present a new multiple-try Metropolis-Hastings algorithm designed to be especially beneficial when a tailored proposal distribution is available. The algorithm is based on a given acyclic graph $G$, where one of the nodes in $G$, $k$…

Computation · Statistics 2018-07-06 Xin Luo , Håkon Tjelmeland

We propose a new class of learning algorithms that combines variational approximation and Markov chain Monte Carlo (MCMC) simulation. Naive algorithms that use the variational approximation as proposal distribution can perform poorly…

Machine Learning · Computer Science 2013-01-14 Nando de Freitas , Pedro Hojen-Sorensen , Michael I. Jordan , Stuart Russell

High-throughput characterization often requires estimating parameters and model dimension from experimental data of limited quantity and quality. Such data may result in an ill-posed inverse problem, where multiple sets of parameters and…

Quantum Physics · Physics 2026-04-08 Abigail N. Poteshman , Jiwon Yun , Tim H. Taminiau , Giulia Galli

Convergence analysis of Markov chain Monte Carlo methods in high-dimensional statistical applications is increasingly recognized. In this paper, we develop general mixing time bounds for Metropolis-Hastings algorithms on discrete spaces by…

Computation · Statistics 2025-07-29 Hyunwoong Chang , Quan Zhou

In this article we consider Bayesian parameter inference associated to partially-observed stochastic processes that start from a set B0 and are stopped or killed at the first hitting time of a known set A. Such processes occur naturally…

Computation · Statistics 2012-01-19 Ajay Jasra , Nikolas Kantas

Performing Bayesian inference via Markov chain Monte Carlo (MCMC) can be exceedingly expensive when posterior evaluations invoke the evaluation of a computationally expensive model, such as a system of partial differential equations. In…

Computation · Statistics 2017-12-27 Patrick Conrad , Andrew Davis , Youssef Marzouk , Natesh Pillai , Aaron Smith

We develop a novel advanced Particle Markov chain Monte Carlo algorithm that is capable of sampling from the posterior distribution of non-linear state space models for both the unobserved latent states and the unknown model parameters. We…

Methodology · Statistics 2015-03-17 Gareth W. Peters , Geoff R. Hosack , Keith R. Hayes

Nonlinear non-Gaussian state-space models arise in numerous applications in statistics and signal processing. In this context, one of the most successful and popular approximation techniques is the Sequential Monte Carlo (SMC) algorithm,…

Computation · Statistics 2016-04-20 Francois Septier , Gareth W. Peters

Stochastic gradient Markov chain Monte Carlo (MCMC) algorithms have received much attention in Bayesian computing for big data problems, but they are only applicable to a small class of problems for which the parameter space has a fixed…

Computation · Statistics 2020-02-10 Qifan Song , Yan Sun , Mao Ye , Faming Liang

This work focuses on sampling from hidden Markov models (Cappe et al, 2005) whose observations have intractable density functions. We develop a new sequential Monte Carlo (Doucet et al, 2000 and Gordon et al, 1993) algorithm and a new…

Methodology · Statistics 2013-08-22 Adam Persing , Ajay Jasra

We introduce Markov chain Monte Carlo (MCMC) algorithms based on numerical approximations of piecewise-deterministic Markov processes obtained with the framework of splitting schemes. We present unadjusted as well as adjusted algorithms,…

Probability · Mathematics 2025-11-04 Andrea Bertazzi , Paul Dobson , Pierre Monmarché

In MCMC methods, such as the Metropolis-Hastings (MH) algorithm, the Gibbs sampler, or recent adaptive methods, many different strategies can be proposed, often associated in practice to unknown rates of convergence. In this paper we…

Statistics Theory · Mathematics 2007-06-13 Didier Chauveau , Pierre Vandekerkhove

We consider state and parameter estimation for a dynamical system having both time-varying and time-invariant parameters. It has been shown that the robustness of the Markov Chain Monte Carlo (MCMC) algorithm for estimating time-invariant…

Computational Engineering, Finance, and Science · Computer Science 2022-10-18 Philippe Bisaillon , Brandon Robinson , Mohammad Khalil , Chris L. Pettit , Dominique Poirel , Abhijit Sarkar

We introduce a general framework that constructs estimators with reduced variance for random walk Metropolis and Metropolis-adjusted Langevin algorithms. The resulting estimators require negligible computational cost and are derived in a…

Methodology · Statistics 2022-03-07 Angelos Alexopoulos , Petros Dellaportas , Michalis K. Titsias

Tasks such as record linkage and multi-target tracking, which involve reconstructing the set of objects that underlie some observed data, are particularly challenging for probabilistic inference. Recent work has achieved efficient and…

Artificial Intelligence · Computer Science 2012-07-02 Brian Milch , Stuart Russell

Bayesian computation crucially relies on Markov chain Monte Carlo (MCMC) algorithms. In the case of massive data sets, running the Metropolis-Hastings sampler to draw from the posterior distribution becomes prohibitive due to the large…

Computation · Statistics 2015-12-07 Roberto Casarin , Radu V. Craiu , Fabrizio Leisen

We propose a new computationally efficient sampling scheme for Bayesian inference involving high dimensional probability distributions. Our method maps the original parameter space into a low-dimensional latent space, explores the latent…

Computation · Statistics 2019-10-15 Babak Shahbaba , Luis Martinez Lomeli , Tian Chen , Shiwei Lan

The Metropolis-Hastings method is often used to construct a Markov chain with a given $\pi$ as its stationary distribution. The method works even if $\pi$ is known only up to an intractable constant of proportionality. Polynomial time…

Statistics Theory · Mathematics 2019-09-27 David Pollard , Dana Yang

The state estimation problem for nonlinear systems with stochastic uncertainties can be formulated in the Bayesian framework, where the objective is to replace the state completely by its probability density function. Without the…

Optimization and Control · Mathematics 2024-04-04 Lukas Ecker , Kurt Schlacher

While recent work has shown that scores from models trained by the ubiquitous masked language modeling (MLM) objective effectively discriminate probable from improbable sequences, it is still an open question if these MLMs specify a…

Machine Learning · Computer Science 2022-03-16 Kartik Goyal , Chris Dyer , Taylor Berg-Kirkpatrick