English
Related papers

Related papers: The iterated auxiliary particle filter

200 papers

We introduce a probabilistic approach to the LMS filter. By means of an efficient approximation, this approach provides an adaptable step-size LMS algorithm together with a measure of uncertainty about the estimation. In addition, the…

Machine Learning · Statistics 2016-04-11 Jesus Fernandez-Bes , Víctor Elvira , Steven Van Vaerenbergh

Bayesian inference for models that have an intractable partition function is known as a doubly intractable problem, where standard Monte Carlo methods are not applicable. The past decade has seen the development of auxiliary variable Monte…

Computation · Statistics 2017-10-13 Richard G. Everitt , Dennis Prangle , Philip Maybank , Mark Bell

Parameter estimation connects mathematical models to real-world data and decision making across many scientific and industrial applications. Standard approaches such as maximum likelihood estimation and Markov chain Monte Carlo estimate…

Methodology · Statistics 2026-02-06 Matthew J Simpson , James S Bennett , Alexander Johnston , Ruth E Baker

The classical sparse parameter identification methods are usually based on the iterative basis selection such as greedy algorithms, or the numerical optimization of regularized cost functions such as LASSO and Bayesian posterior probability…

Systems and Control · Electrical Eng. & Systems 2026-05-05 Yanxin Fu , Wenxiao Zhao

Sequential Monte Carlo methods, also known as particle methods, are a widely used set of computational tools for inference in non-linear non-Gaussian state-space models. In many applications it may be necessary to compute the sensitivity,…

Statistics Theory · Mathematics 2011-06-14 Pierre Del Moral , Arnaud Doucet , Sumeetpal Singh

We introduce a new embarrassingly parallel parameter learning algorithm for Markov random fields with untied parameters which is efficient for a large class of practical models. Our algorithm parallelizes naturally over cliques and, for…

Machine Learning · Statistics 2014-02-06 Yariv Dror Mizrahi , Misha Denil , Nando de Freitas

We consider chemical reaction networks modeled by a discrete state and continuous in time Markov process for the vector copy number of the species and provide a novel particle filter method for state and parameter estimation based on exact…

Molecular Networks · Quantitative Biology 2021-02-24 Muruhan Rathinam , Mingkai Yu

Bayesian inference in state-space models is challenging due to high-dimensional state trajectories. A viable approach is particle Markov chain Monte Carlo, combining MCMC and sequential Monte Carlo to form "exact approximations" to…

Computation · Statistics 2022-10-27 Anna Wigren , Riccardo Sven Risuleo , Lawrence Murray , Fredrik Lindsten

Nonlinear filtering is the problem of online estimation of a dynamic hidden variable from incoming data and has vast applications in different fields, ranging from engineering, machine learning, economic science and natural sciences. We…

Methodology · Statistics 2019-11-19 Anna Kutschireiter , Simone Carlo Surace , Jean-Pascal Pfister

Sequential Monte Carlo methods have been a major breakthrough in the field of numerical signal processing for stochastic dynamical state-space systems with partial and noisy observations. However, these methods still present certain…

Applications · Statistics 2023-12-14 Samuel Nyobe , Fabien Campillo , Serge Moto , Vivien Rossi

Sequential Monte Carlo (SMC), or particle filtering, is widely used in nonlinear state-space systems, but its performance often suffers from poorly approximated proposal and state-transition distributions. This work introduces a…

Machine Learning · Computer Science 2026-05-14 Wessel L. van Nierop , Nir Shlezinger , Ruud J. G. van Sloun

When inferring parameters from a Gaussian-distributed data set by computing a likelihood, a covariance matrix is needed that describes the data errors and their correlations. If the covariance matrix is not known a priori, it may be…

Cosmology and Nongalactic Astrophysics · Physics 2016-01-27 Elena Sellentin , Alan F. Heavens

Likelihood-free inference (LFI) methods, such as approximate Bayesian computation, have become commonplace for conducting inference in complex models. Many approaches are based on summary statistics or discrepancies derived from synthetic…

Methodology · Statistics 2025-06-06 David T. Frazier , Christopher Drovandi , Lucas Kock , David J. Nott

We consider the filtering of continuous-time finite-state hidden Markov models, where the rate and observation matrices depend on unknown time-dependent parameters, for which no prior or stochastic model is available. We quantify and…

Probability · Mathematics 2021-03-17 Andrew L. Allan

Models implicitly defined through a random simulator of a process have become widely used in scientific and industrial applications in recent years. However, simulation-based inference methods for such implicit models, like approximate…

Methodology · Statistics 2025-04-17 Joonha Park

The particle filter is one of the most successful methods for state inference and identification of general non-linear and non-Gaussian models. However, standard particle filters suffer from degeneracy of the particle weights, in particular…

Computation · Statistics 2022-10-27 Anna Wigren , Lawrence Murray , Fredrik Lindsten

Particle filters flexibly represent multiple posterior modes nonparametrically, via a collection of weighted samples, but have classically been applied to tracking problems with known dynamics and observation likelihoods. Such generative…

Machine Learning · Computer Science 2024-04-16 Ali Younis , Erik Sudderth

This paper presents a novel online identification algorithm for nonlinear regression models. The online identification problem is challenging due to the presence of nonlinear structure in the models. Previous works usually ignore the…

Optimization and Control · Mathematics 2022-07-21 Guang-Yong Chen , Min Gan , Jing Chen , Long Chen

State space models have long played an important role in signal processing. The Gaussian case can be treated algorithmically using the famous Kalman filter. Similarly since the 1970s there has been extensive application of Hidden Markov…

Statistics Theory · Mathematics 2007-06-13 Peter Bickel , Yaacov Ritov , Tobias Rydén

Hierarchical parametric models consisting of observable and latent variables are widely used for unsupervised learning tasks. For example, a mixture model is a representative hierarchical model for clustering. From the statistical point of…

Machine Learning · Statistics 2014-01-24 Keisuke Yamazaki