English
Related papers

Related papers: Online Variational Sequential Monte Carlo

200 papers

We present a variational method for online state estimation and parameter learning in state-space models (SSMs), a ubiquitous class of latent variable models for sequential data. As per standard batch variational techniques, we use…

Machine Learning · Statistics 2022-06-16 Andrew Campbell , Yuyang Shi , Tom Rainforth , Arnaud Doucet

This article addresses online variational estimation in parametric state-space models. We propose a new procedure for efficiently computing the evidence lower bound and its gradient in a streaming-data setting, where observations arrive…

Methodology · Statistics 2026-02-09 Mathis Chagneux , Mathias Müller , Pierre Gloaguen , Sylvain Le Corff , Jimmy Olsson

We introduce methodology for real-time inference in general-state-space hidden Markov models. Specifically, we extend recent advances in controlled sequential Monte Carlo (CSMC) methods-originally proposed for offline smoothing-to the…

Computation · Statistics 2025-08-04 Liwen Xue , Axel Finke , Adam M. Johansen

Nonlinear state-space models are powerful tools to describe dynamical structures in complex time series. In a streaming setting where data are processed one sample at a time, simultaneous inference of the state and its nonlinear dynamics…

Machine Learning · Statistics 2023-06-06 Yuan Zhao , Josue Nassar , Ian Jordan , Mónica Bugallo , Il Memming Park

Bayesian phylogenetic inference is often conducted via local or sequential search over topologies and branch lengths using algorithms such as random-walk Markov chain Monte Carlo (MCMC) or Combinatorial Sequential Monte Carlo (CSMC).…

Machine Learning · Statistics 2021-06-21 Antonio Khalil Moretti , Liyi Zhang , Christian A. Naesseth , Hadiah Venner , David Blei , Itsik Pe'er

State space models (SSM) have been widely applied for the analysis and visualization of large sequential datasets. Sequential Monte Carlo (SMC) is a very popular particle-based method to sample latent states from intractable posteriors.…

Machine Learning · Computer Science 2019-01-07 Duo Xu

Many recent advances in large scale probabilistic inference rely on variational methods. The success of variational approaches depends on (i) formulating a flexible parametric family of distributions, and (ii) optimizing the parameters to…

Machine Learning · Statistics 2018-02-22 Christian A. Naesseth , Scott W. Linderman , Rajesh Ranganath , David M. Blei

We propose sequential Monte Carlo (SMC) methods for sampling the posterior distribution of state-space models under highly informative observation regimes, a situation in which standard SMC methods can perform poorly. A special case is…

Computation · Statistics 2015-07-10 Pierre Del Moral , Lawrence M. Murray

Sequential Monte Carlo (SMC) algorithms represent a suite of robust computational methodologies utilized for state estimation and parameter inference within dynamical systems, particularly in real-time or online environments where data…

Latent state space systems are ubiquitous in statistical modelling, arising naturally when a time series is observed through a noisy measurement function, however training deep state space models (DSSM) at scale remains difficult. Two…

Machine Learning · Computer Science 2026-05-21 John-Joseph Brady , Nikolas Nusken , Yunpeng Li

We present a scalable approach to performing approximate fully Bayesian inference in generic state space models. The proposed method is an alternative to particle MCMC that provides fully Bayesian inference of both the dynamic latent states…

Machine Learning · Statistics 2019-02-13 Marcel Hirt , Petros Dellaportas

In this article we focus on dynamic network data which describe interactions among a fixed population through time. We model this data using the latent space framework, in which the probability of a connection forming is expressed as a…

Methodology · Statistics 2021-12-21 Kathryn Turnbull , Christopher Nemeth , Matthew Nunes , Tyler McCormick

We present an original simulation-based method to estimate likelihood ratios efficiently for general state-space models. Our method relies on a novel use of the conditional Sequential Monte Carlo (cSMC) algorithm introduced in…

Methodology · Statistics 2018-09-10 Sinan Yıldırım , Christophe Andrieu , Arnaud Doucet

Many kinds of data can be represented as a network or graph. It is crucial to infer the latent structure underlying such a network and to predict unobserved links in the network. Mixed Membership Stochastic Blockmodel (MMSB) is a promising…

Social and Information Networks · Computer Science 2013-12-10 Tomoki Kobayashi , Koji Eguchi

Sequential Monte Carlo (SMC) methods are not only a popular tool in the analysis of state space models, but offer an alternative to MCMC in situations where Bayesian inference must proceed via simulation. This paper introduces a new SMC…

Computation · Statistics 2010-05-11 Paul Fearnhead , Benjamin M. Taylor

We develop and describe online algorithms for performing online semiparametric regression analyses. Earlier work on this topic is in Luts, Broderick & Wand (J. Comput. Graph. Statist., 2014) where online mean field variational Bayes was…

Methodology · Statistics 2024-08-28 Marianne Menictas , Chris J. Oates , Matt P. Wand

Sequential Monte Carlo (SMC) methods are a widely used set of computational tools for inference in non-linear non-Gaussian state-space models. We propose a new SMC algorithm to compute the expectation of additive functionals recursively.…

Methodology · Statistics 2010-12-27 Pierre Del Moral , Arnaud Doucet , Sumeetpal Singh

Sequential Monte Carlo (SMC) methods are a class of techniques to sample approximately from any sequence of probability distributions using a combination of importance sampling and resampling steps. This paper is concerned with the…

Statistics Theory · Mathematics 2012-03-05 Pierre Del Moral , Arnaud Doucet , Ajay Jasra

We propose a sequential Markov chain Monte Carlo (SMCMC) algorithm to sample from a sequence of probability distributions, corresponding to posterior distributions at different times in on-line applications. SMCMC proceeds as in usual MCMC…

Statistics Theory · Mathematics 2013-08-20 Yun Yang , David B. Dunson

Model comparison for the purposes of selection, averaging and validation is a problem found throughout statistics. Within the Bayesian paradigm, these problems all require the calculation of the posterior probabilities of models within a…

Methodology · Statistics 2015-06-08 Yan Zhou , Adam M Johansen , John A D Aston
‹ Prev 1 2 3 10 Next ›