English
Related papers

Related papers: MCMC for non-linear state space models using ensem…

200 papers

Being the most classical generative model for serial data, state-space models (SSM) are fundamental in AI and statistical machine learning. In SSM, any form of parameter learning or latent state inference typically involves the computation…

Machine Learning · Statistics 2024-07-04 Alessandro Mastrototaro , Jimmy Olsson

This paper develops a novel sequential Monte Carlo (SMC) approach for joint state and parameter estimation that can deal efficiently with abruptly changing parameters which is a common case when tracking maneuvering targets. The approach…

Computation · Statistics 2015-10-12 Christopher Nemeth , Paul Fearnhead , Lyudmila Mihaylova

Neuronal ensemble inference is a significant problem in the study of biological neural networks. Various methods have been proposed for ensemble inference from experimental data of neuronal activity. Among them, Bayesian inference approach…

Disordered Systems and Neural Networks · Physics 2021-06-03 Shun Kimura , Keisuke Ota , Koujin Takeda

A state-space model is a time-series model that has an unobserved latent process from which we take noisy measurements over time. The observations are conditionally independent given the latent process and the latent process itself is…

Methodology · Statistics 2025-10-07 Paul Fearnhead , Chris Sherlock

The parameters of a discrete stationary Markov model are transition probabilities between states. Traditionally, data consist in sequences of observed states for a given number of individuals over the whole observation period. In such a…

Computation · Statistics 2012-04-30 Alberto Pasanisi , Shuai Fu , Nicolas Bousquet

Markov chain Monte Carlo (MCMC) is the predominant tool used in Bayesian parameter estimation for hierarchical models. When the model expands due to an increasing number of hierarchical levels, number of groups at a particular level, or…

Computation · Statistics 2016-06-22 Will Landau , Jarad Niemi

We present an efficient algorithm for the inference of stochastic block models in large networks. The algorithm can be used as an optimized Markov chain Monte Carlo (MCMC) method, with a fast mixing time and a much reduced susceptibility to…

Data Analysis, Statistics and Probability · Physics 2014-01-14 Tiago P. Peixoto

Bayesian inference for factorial hidden Markov models is challenging due to the exponentially sized latent variable space. Standard Monte Carlo samplers can have difficulties effectively exploring the posterior landscape and are often…

Computation · Statistics 2019-02-28 Kaspar Märtens , Michalis K Titsias , Christopher Yau

Nonlinear non-Gaussian state-space models arise in numerous applications in statistics and signal processing. In this context, one of the most successful and popular approximation techniques is the Sequential Monte Carlo (SMC) algorithm,…

Computation · Statistics 2016-04-20 Francois Septier , Gareth W. Peters

Many problems of practical interest rely on Continuous-time Markov chains~(CTMCs) defined over combinatorial state spaces, rendering the computation of transition probabilities, and hence probabilistic inference, difficult or impossible…

One of the key challenges in identifying nonlinear and possibly non-Gaussian state space models (SSMs) is the intractability of estimating the system state. Sequential Monte Carlo (SMC) methods, such as the particle filter (introduced more…

The Markov chain Monte Carlo method (MCMC), especially the Metropolis-Hastings (MH) algorithm, is a widely used technique for sampling from a target probability distribution $P$ on a state space $\Omega$ and applied to various problems such…

Quantum Physics · Physics 2023-03-13 Koichi Miyamoto

Probabilistic programming languages can simplify the development of machine learning techniques, but only if inference is sufficiently scalable. Unfortunately, Bayesian parameter estimation for highly coupled models such as regressions and…

Machine Learning · Statistics 2015-03-10 Yutian Chen , Vikash Mansinghka , Zoubin Ghahramani

Advances in digital sensors, digital data storage and communications have resulted in systems being capable of accumulating large collections of data. In the light of dealing with the challenges that massive data present, this work proposes…

Computation · Statistics 2015-12-09 Allan De Freitas , François Septier , Lyudmila Mihaylova

Markov Chain Monte Carlo (MCMC) proves to be powerful for Bayesian inference and in particular for exoplanet radial velocity fitting because MCMC provides more statistical information and makes better use of data than common approaches like…

Instrumentation and Methods for Astrophysics · Physics 2014-01-30 Fengji Hou , Jonathan Goodman , David W. Hogg , Jonathan Weare , Christian Schwab

Particle Markov Chain Monte Carlo methods are used to carry out inference in non-linear and non-Gaussian state space models, where the posterior density of the states is approximated using particles. Current approaches usually perform…

Computation · Statistics 2019-09-30 Eduardo F. Mendes , Christopher K. Carter , David Gunawan , Robert Kohn

Finite element model updating is challenging because 1) the problem is oftentimes underdetermined while the measurements are limited and/or incomplete; 2) many combinations of parameters may yield responses that are similar with respect to…

Applications · Statistics 2021-07-28 Kai Zhou , Jiong Tang

This paper concerns the use of sequential Monte Carlo methods (SMC) for smoothing in general state space models. A well-known problem when applying the standard SMC technique in the smoothing mode is that the resampling mechanism introduces…

Statistics Theory · Mathematics 2008-03-06 Jimmy Olsson , Olivier Cappé , Randal Douc , Eric Moulines

Hidden Markov models (HMMs) offer a robust and efficient framework for analyzing time series data, modelling both the underlying latent state progression over time and the observation process, conditional on the latent state. However, a…

Applications · Statistics 2024-07-19 Ioannis Rotous , Alex Diana , Alessio Farcomeni , Eleni Matechou , Andréa Thiebault

This work presents an efficient approach for accelerating multilevel Markov Chain Monte Carlo (MCMC) sampling for large-scale problems using low-fidelity machine learning models. While conventional techniques for large-scale Bayesian…

Machine Learning · Statistics 2024-05-21 Sohail Reddy , Hillary Fairbanks