English
Related papers

Related papers: Rao-Blackwellized Particle Smoothing as Message Pa…

200 papers

The Bayesian smoothing equations are generally intractable for systems described by nonlinear stochastic differential equations and discrete-time measurements. Gaussian approximations are a computationally efficient way to approximate the…

Dynamical Systems · Mathematics 2016-04-05 Juha Ala-Luhtala , Simo Särkkä , Robert Piché

State-space smoothing has found many applications in science and engineering. Under linear and Gaussian assumptions, smoothed estimates can be obtained using efficient recursions, for example Rauch-Tung-Striebel and Mayne-Fraser algorithms.…

Optimization and Control · Mathematics 2016-09-27 A. Y. Aravkin , J. V. Burke , L. Ljung , A. Lozano , G. Pillonetto

Time series forecasting is an active research topic in academia as well as industry. Although we see an increasing amount of adoptions of machine learning methods in solving some of those forecasting challenges, statistical methods remain…

Computation · Statistics 2021-01-26 Edwin Ng , Zhishi Wang , Huigang Chen , Steve Yang , Slawek Smyl

Probabilistic graphical models compactly represent joint distributions by decomposing them into factors over subsets of random variables. In Bayesian networks, the factors are conditional probability distributions. For many problems, common…

Machine Learning · Computer Science 2018-08-21 Weirui Kong , Wenyi Wang

Spatio-temporal forecasting has numerous applications in analyzing wireless, traffic, and financial networks. Many classical statistical models often fall short in handling the complexity and high non-linearity present in time-series data.…

Machine Learning · Statistics 2021-06-14 Soumyasundar Pal , Liheng Ma , Yingxue Zhang , Mark Coates

We propose a novel piecewise smooth image model with piecewise constant local parameters that are automatically adapted to each image. Technically, the model is formulated in terms of factor graphs with NUP (normal with unknown parameters)…

Image and Video Processing · Electrical Eng. & Systems 2026-01-19 Tianyang Wang , Ender Konukoglu , Hans-Andrea Loeliger

We present a novel algorithm, an adaptive-lag smoother, approximating efficiently, in an online fashion, sequences of expectations under the marginal smoothing distributions in general state-space models. The algorithm evolves recursively a…

Computation · Statistics 2019-10-23 Johan Alenlöv , Jimmy Olsson

In state space models, smoothing refers to the task of estimating a latent stochastic process given noisy measurements related to the process. We propose an unbiased estimator of smoothing expectations. The lack-of-bias property has…

Methodology · Statistics 2018-09-07 Pierre E. Jacob , Fredrik Lindsten , Thomas B. Schön

We present a filtering framework for online joint state estimation and parameter identification in nonlinear, time-varying systems. The algorithm uses Rao-Blackwellization technique to infer joint state-parameter posteriors efficiently. In…

Systems and Control · Electrical Eng. & Systems 2026-03-25 Milad Banitalebi Dehkordi , Manas Mejari , Dario Piga

Functional principal components analysis is a popular tool for inference on functional data. Standard approaches rely on an eigendecomposition of a smoothed covariance surface in order to extract the orthonormal functions representing the…

Methodology · Statistics 2021-04-02 Tui H. Nolan , Jeff Goldsmith , David Ruppert

For challenging state estimation problems arising in domains like vision and robotics, particle-based representations attractively enable temporal reasoning about multiple posterior modes. Particle smoothers offer the potential for more…

Machine Learning · Computer Science 2025-02-18 Ali Younis , Erik B. Sudderth

Suppose X is a multivariate diffusion process that is observed discretely in time. At each observation time, a transformation of the state of the process is observed with noise. The smoothing problem consists of recovering the path of the…

Computation · Statistics 2024-09-04 Marcin Mider , Moritz Schauer , Frank van der Meulen

This paper considers the problem of iterative Bayesian smoothing in nonlinear state-space models with additive noise using Gaussian approximations. Iterative methods are known to improve smoothed estimates but are not guaranteed to…

Optimization and Control · Mathematics 2025-02-11 Jakob Lindqvist , Simo Särkkä , Ángel F. García-Fernández , Matti Raitoharju , Lennart Svensson

Multiple generalized additive models (GAMs) are a type of distributional regression wherein parameters of probability distributions depend on predictors through smooth functions, with selection of the degree of smoothness via $L_2$…

Machine Learning · Statistics 2018-09-26 Yousra El-Bachir , Anthony C. Davison

We consider approximate maximum likelihood parameter estimation in nonlinear state-space models. We discuss both direct optimization of the likelihood and expectation--maximization (EM). For EM, we also give closed-form expressions for the…

Methodology · Statistics 2015-11-03 Juho Kokkala , Arno Solin , Simo Särkkä

We provide a new strategy built on the divide-and-conquer approach by Lindsten et al. (2017) to investigate the smoothing problem in a hidden Markov model. We employ this approach to decompose a hidden Markov model into sub-models with…

Methodology · Statistics 2018-08-28 Dong Ding , Axel Gandy

We propose a new sampling-based approach for approximate inference in filtering problems. Instead of approximating conditional distributions with a finite set of states, as done in particle filters, our approach approximates the…

Machine Learning · Computer Science 2020-03-03 Xuan Su , Wee Sun Lee , Zhen Zhang

The factor graph approach to discrete-time linear Gaussian state space models is well developed. The paper extends this approach to continuous-time linear systems/filters that are driven by white Gaussian noise. By Gaussian message passing,…

Information Theory · Computer Science 2013-01-22 Lukas Bolliger , Hans-Andrea Loeliger , Christian Vogel

We extend the linear mixed-effects state model to accommodate the correlated individuals and investigate its parameter and state estimation based on disturbance smoothing in this paper. For parameter estimation, EM and score based…

Methodology · Statistics 2014-09-03 Jie Zhou , Aiping Tang

Smoothing is a technique that estimates the state of a system using measurement information both prior and posterior to the estimation time. Two notable examples of this technique are the Rauch-Tung-Striebel and Mayne-Fraser-Potter…

Quantum Physics · Physics 2021-09-24 Kiarn T. Laverick