English
Related papers

Related papers: Implicit particle methods and their connection wit…

200 papers

This paper presents a seamless algorithm for the application of the multilevel Monte Carlo (MLMC) method to the ensemble transform particle filter (ETPF). The algorithm uses a combination of optimal coupling transformations between coarse…

Numerical Analysis · Mathematics 2017-06-15 Alastair Gregory , Colin Cotter

Compared to the wide array of advanced Monte Carlo methods supported by modern probabilistic programming languages (PPLs), PPL support for variational inference (VI) is less developed: users are typically limited to a predefined selection…

Programming Languages · Computer Science 2024-06-25 McCoy R. Becker , Alexander K. Lew , Xiaoyan Wang , Matin Ghavami , Mathieu Huot , Martin C. Rinard , Vikash K. Mansinghka

Twisted particle filters are a class of sequential Monte Carlo methods recently introduced by Whiteley and Lee to improve the efficiency of marginal likelihood estimation in state-space models. The purpose of this article is to extend the…

Computation · Statistics 2024-10-30 Juha Ala-Luhtala , Nick Whiteley , Kari Heine , Robert Piche

In simulation-based inferences for partially observed Markov process models (POMP), the by-product of the Monte Carlo filtering is an approximation of the log likelihood function. Recently, iterated filtering [14, 13] has originally been…

Methodology · Statistics 2018-02-26 Dao Nguyen

We present ImplicitSLIM, a novel unsupervised learning approach for sparse high-dimensional data, with applications to collaborative filtering. Sparse linear methods (SLIM) and their variations show outstanding performance, but they are…

Information Retrieval · Computer Science 2024-06-04 Ilya Shenbin , Sergey Nikolenko

We consider the problem of designing efficient particle filters for twisted Feynman--Kac models. Particle filters using twisted models can deliver low error approximations of statistical quantities and such twisting functions can be learnt…

Methodology · Statistics 2022-08-09 Joshua J Bon , Christopher Drovandi , Anthony Lee

We present an offline, iterated particle filter to facilitate statistical inference in general state space hidden Markov models. Given a model and a sequence of observations, the associated marginal likelihood L is central to…

Computation · Statistics 2016-06-16 Pieralberto Guarniero , Adam M. Johansen , Anthony Lee

In this paper, we propose a meshfree approximation method for the implicit filter developed in [2], which is a novel numerical algorithm for nonlinear filtering problems. The implicit filter approximates conditional distributions in the…

Numerical Analysis · Mathematics 2015-08-05 Feng Bao , Yanzhao Cao , Clayton Webster , Guannan Zhang

This is a short review of Monte Carlo methods for approximating filter distributions in state space models. The basic algorithm and different strategies to reduce imbalance of the weights are discussed. Finally, methods for more difficult…

Statistics Theory · Mathematics 2013-10-01 Hans R. Künsch

Probabilistic modeling provides the capability to represent and manipulate uncertainty in data, models, predictions and decisions. We are concerned with the problem of learning probabilistic models of dynamical systems from measured data.…

Computation · Statistics 2018-03-14 Thomas B. Schön , Andreas Svensson , Lawrence Murray , Fredrik Lindsten

Based on an idea in [4] we propose a new iterative multiplicative filtering algorithm for label assignment matrices which can be used for the supervised partitioning of data. Starting with a row-normalized matrix containing the averaged…

Numerical Analysis · Mathematics 2018-12-10 Ronny Bergmann , Jan Henrik Fitschen , Johannes Persch , Gabriele Steidl

Several quantities important in condensed matter physics, quantum information, and quantum chemistry, as well as quantities required in meta-optimization of machine learning algorithms, can be expressed as gradients of implicitly defined…

Quantum Physics · Physics 2022-11-28 Shahnawaz Ahmed , Nathan Killoran , Juan Felipe Carrasquilla Álvarez

A series of novel filters for probabilistic inference that propose an alternative way of performing Bayesian updates, called particle flow filters, have been attracting recent interest. These filters provide approximate solutions to…

Methodology · Statistics 2017-03-24 Flávio Eler De Melo , Simon Maskell , Matteo Fasiolo , Fred Daum

Particle Filtering (PF) methods are an established class of procedures for performing inference in non-linear state-space models. Resampling is a key ingredient of PF, necessary to obtain low variance likelihood and states estimates.…

Machine Learning · Statistics 2021-07-01 Adrien Corenflos , James Thornton , George Deligiannidis , Arnaud Doucet

Particle filtering methods can be applied to estimation problems in discrete spaces on bounded domains, to sample from and marginalise over unknown hidden states. As in continuous settings, problems such as particle degradation can arise:…

Particle MCMC involves using a particle filter within an MCMC algorithm. For inference of a model which involves an unobserved stochastic process, the standard implementation uses the particle filter to propose new values for the stochastic…

Computation · Statistics 2016-09-26 Paul Fearnhead , Loukia Meligkotsidou

Automatic differentiation (AD) has driven recent advances in machine learning, including deep neural networks and Hamiltonian Markov Chain Monte Carlo methods. Partially observed nonlinear stochastic dynamical systems have proved resistant…

Methodology · Statistics 2024-07-04 Kevin Tan , Giles Hooker , Edward L. Ionides

Implicit samplers are algorithms for producing independent, weighted samples from multi-variate probability distributions. These are often applied in Bayesian data assimilation algorithms. We use Laplace asymptotic expansions to analyze two…

Numerical Analysis · Mathematics 2014-10-24 Jonathan Goodman , Kevin K. Lin , Matthias Morzfeld

Pre-filtering and post-filtering steps can be added to many of the traditional numerical methods to generate new, higher order methods with strong stability properties. Presented in this paper are a variable step pre-filter and post-filter…

Numerical Analysis · Mathematics 2025-04-02 Stephen M. McGovern

Differentiable particle filters combine the flexibility of neural networks with the probabilistic nature of sequential Monte Carlo methods. However, traditional approaches rely on the availability of labelled data, i.e., the ground truth…

Machine Learning · Computer Science 2024-05-03 Jiaxi Li , John-Joseph Brady , Xiongjie Chen , Yunpeng Li