English
Related papers

Related papers: Augmentation Schemes for Particle MCMC

200 papers

This work presents an efficient approach for accelerating multilevel Markov Chain Monte Carlo (MCMC) sampling for large-scale problems using low-fidelity machine learning models. While conventional techniques for large-scale Bayesian…

Machine Learning · Statistics 2024-05-21 Sohail Reddy , Hillary Fairbanks

In lattice quantum field theory studies, parameters defining the lattice theory must be tuned toward criticality to access continuum physics. Commonly used Markov chain Monte Carlo (MCMC) methods suffer from critical slowing down in this…

High Energy Physics - Lattice · Physics 2021-06-04 Gurtej Kanwar

This paper presents a joint optimisation framework for optimal estimation and stochastic optimal control with imperfect information. It provides a estimation and control scheme that can be decomposed into a classical optimal estimation step…

Optimization and Control · Mathematics 2023-03-27 Emilien Flayac , Karim Dahia , Bruno Hérissé , Frédéric Jean

We develop a simulation-based method for the online updating of Gaussian process regression and classification models. Our method exploits sequential Monte Carlo to produce a fast sequential design algorithm for these models relative to the…

Computation · Statistics 2010-07-07 Robert B. Gramacy , Nicholas G. Polson

Generalized linear mixed models (GLMM) are used for inference and prediction in a wide range of different applications providing a powerful scientific tool. An increasing number of sources of data are becoming available, introducing a…

Computation · Statistics 2019-03-19 Aliaksandr Hubin , Geir Storvik

The Pairwise Markov Chain (PMC) is a probabilistic graphical model extending the well-known Hidden Markov Model. This model, although highly effective for many tasks, has been scarcely utilized for continuous value prediction. This is…

Machine Learning · Statistics 2025-08-12 Elie Azeraf

An introduction to the use of linchpin variables in Markov chain Monte Carlo (MCMC) is provided. Before the widespread adoption of MCMC methods, conditional sampling using linchpin variables was essentially the only practical approach for…

Computation · Statistics 2022-10-26 Dootika Vats , Felipe Acosta , Mark L. Huber , Galin L. Jones

The stochastic volatility model is a popular tool for modeling the volatility of assets. The model is a nonlinear and non-Gaussian state space model, and consequently is difficult to fit. Many approaches, both classical and Bayesian, have…

Methodology · Statistics 2019-07-22 Chen Gong , David S. Stoffer

Markov Chain Monte Carlo (MCMC) is a well-established family of algorithms primarily used in Bayesian statistics to sample from a target distribution when direct sampling is challenging. Existing work on Bayesian decision trees uses MCMC.…

Computation · Statistics 2023-01-24 Efthyvoulos Drousiotis , Paul G. Spirakis , Simon Maskell

A novel computationally efficient Markov chain Monte Carlo (MCMC) scheme for latent Gaussian models (LGMs) is proposed in this paper. The sampling scheme is a two block Gibbs sampling scheme designed to exploit the model structure of LGMs.…

Computation · Statistics 2015-06-23 Óli Páll Geirsson , Birgir Hrafnkelsson , Daniel Simpson , Helgi Sigurðarson

This paper presents a seamless algorithm for the application of the multilevel Monte Carlo (MLMC) method to the ensemble transform particle filter (ETPF). The algorithm uses a combination of optimal coupling transformations between coarse…

Numerical Analysis · Mathematics 2017-06-15 Alastair Gregory , Colin Cotter

Poyiadjis et al. (2011) show how particle methods can be used to estimate both the score and the observed information matrix for state space models. These methods either suffer from a computational cost that is quadratic in the number of…

Computation · Statistics 2015-09-07 Christopher Nemeth , Paul Fearnhead , Lyudmila Mihaylova

Sequential Monte Carlo squared (SMC$^2$) methods can be used for parameter inference of intractable likelihood state-space models. These methods replace the likelihood with an unbiased particle filter estimator, similarly to particle Markov…

Computation · Statistics 2022-10-24 Imke Botha , Robert Kohn , Leah South , Christopher Drovandi

We propose a sequential Markov chain Monte Carlo (SMCMC) algorithm to sample from a sequence of probability distributions, corresponding to posterior distributions at different times in on-line applications. SMCMC proceeds as in usual MCMC…

Statistics Theory · Mathematics 2013-08-20 Yun Yang , David B. Dunson

Parametric Markov chains occur quite naturally in various applications: they can be used for a conservative analysis of probabilistic systems (no matter how the parameter is chosen, the system works to specification); they can be used to…

Logic in Computer Science · Computer Science 2018-11-05 Paul Gainer , Ernst Moritz Hahn , Sven Schewe

Nonlinear non-Gaussian state-space models arise in numerous applications in statistics and signal processing. In this context, one of the most successful and popular approximation techniques is the Sequential Monte Carlo (SMC) algorithm,…

Computation · Statistics 2016-04-20 Francois Septier , Gareth W. Peters

Tasks such as record linkage and multi-target tracking, which involve reconstructing the set of objects that underlie some observed data, are particularly challenging for probabilistic inference. Recent work has achieved efficient and…

Artificial Intelligence · Computer Science 2012-07-02 Brian Milch , Stuart Russell

We consider the problem of designing efficient particle filters for twisted Feynman--Kac models. Particle filters using twisted models can deliver low error approximations of statistical quantities and such twisting functions can be learnt…

Methodology · Statistics 2022-08-09 Joshua J Bon , Christopher Drovandi , Anthony Lee

Nonlinear model predictive control (NMPC) has gained widespread use in many applications. Its formulation traditionally involves repetitively solving a nonlinear constrained optimization problem online. In this paper, we investigate NMPC…

Systems and Control · Electrical Eng. & Systems 2022-05-11 Iman Askari , Shen Zeng , Huazhen Fang

We present a general framework for accelerating a large class of widely used Markov chain Monte Carlo (MCMC) algorithms. Our approach exploits fast, iterative approximations to the target density to speculatively evaluate many potential…

Machine Learning · Statistics 2014-03-31 Elaine Angelino , Eddie Kohler , Amos Waterland , Margo Seltzer , Ryan P. Adams