English
Related papers

Related papers: Sampling-Free Probabilistic Deep State-Space Model…

200 papers

Gaussian process state-space models (GPSSMs) provide a principled and flexible approach to modeling the dynamics of a latent state, which is observed at discrete-time points via a likelihood model. However, inference in GPSSMs is…

Machine Learning · Computer Science 2023-07-18 Xuhui Fan , Edwin V. Bonilla , Terence J. O'Kane , Scott A. Sisson

We introduce a new version of deep state-space models (DSSMs) that combines a recurrent neural network with a state-space framework to forecast time series data. The model estimates the observed series as functions of latent variables that…

Machine Learning · Statistics 2022-05-20 Haoxuan Wu , David S. Matteson , Martin T. Wells

Gaussian state space models have been used for decades as generative models of sequential data. They admit an intuitive probabilistic interpretation, have a simple functional form, and enjoy widespread adoption. We introduce a unified…

Machine Learning · Statistics 2016-12-06 Rahul G. Krishnan , Uri Shalit , David Sontag

Time-varying linear state-space models are powerful tools for obtaining mathematically interpretable representations of neural signals. For example, switching and decomposed models describe complex systems using latent variables that evolve…

This paper proposes an online learning method of Gaussian process state-space model (GP-SSM). GP-SSM is a probabilistic representation learning scheme that represents unknown state transition and/or measurement models as Gaussian processes…

Robotics · Computer Science 2024-10-30 Soon-Seo Park , Young-Jin Park , Youngjae Min , Han-Lim Choi

We introduce a novel unsupervised learning method for time series data with latent dynamical structure: the recognition-parametrized Gaussian state space model (RP-GSSM). The RP-GSSM is a probabilistic model that learns Markovian Gaussian…

Machine Learning · Computer Science 2025-05-30 Samo Hromadka , Kai Biegun , Lior Fox , James Heald , Maneesh Sahani

The Gaussian process state space model (GPSSM) is a non-linear dynamical system, where unknown transition and/or measurement mappings are described by GPs. Most research in GPSSMs has focussed on the state estimation problem, i.e.,…

Machine Learning · Statistics 2017-11-08 Stefanos Eleftheriadis , Thomas F. W. Nicholson , Marc Peter Deisenroth , James Hensman

Modeling dynamical systems, both for control purposes and to make predictions about their behavior, is ubiquitous in science and engineering. Predictive state representations (PSRs) are a recently introduced class of models for…

Artificial Intelligence · Computer Science 2012-07-19 Satinder Singh , Michael James , Matthew Rudary

Markov state models (MSMs) have been successful in computing metastable states, slow relaxation timescales and associated structural changes, and stationary or kinetic experimental observables of complex molecules from large amounts of…

Chemical Physics · Physics 2015-06-17 Frank Noe , Hao Wu , Jan-Hendrik Prinz , Nuria Plattner

We propose a new variational inference algorithm for learning in Gaussian Process State-Space Models (GPSSMs). Our algorithm enables learning of unstable and partially observable systems, where previous algorithms fail. Our main algorithmic…

Machine Learning · Computer Science 2020-06-11 Silvan Melchior , Sebastian Curi , Felix Berkenkamp , Andreas Krause

Gaussian process state-space models (GPSSMs) offer a principled framework for learning and inference in nonlinear dynamical systems with uncertainty quantification. However, existing GPSSMs are limited by the use of multiple independent…

Machine Learning · Statistics 2025-12-11 Zhidi Lin , Ying Li , Feng Yin , Juan Maroñas , Alexandre H. Thiéry

State space models are well-known for their versatility in modeling dynamic systems that arise in various scientific disciplines. Although parametric state space models are well studied, nonparametric approaches are much less explored in…

Methodology · Statistics 2015-07-23 Satyaki Mazumder , Sourabh Bhattacharya

Literatures in state space models focus on parametric inference and prediction, which fail if the state space model is not fully specified and the maximum likelihood estimation does not work. In this paper, we assume the state transition…

Statistics Theory · Mathematics 2020-12-15 Yunyi Zhang , Tingting Wang , Dimitris N. Politis

Models of dynamical systems based on predictive state representations (PSRs) are defined strictly in terms of observable quantities, in contrast with traditional models (such as Hidden Markov Models) that use latent variables or statespace…

Artificial Intelligence · Computer Science 2012-07-09 Matthew Rudary , Satinder Singh , David Wingate

We consider the problem of sequential estimation of the unknowns of state-space and deep state-space models that include estimation of functions and latent processes of the models. The proposed approach relies on Gaussian and deep Gaussian…

Machine Learning · Computer Science 2024-03-26 Yuhao Liu , Marzieh Ajirak , Petar Djuric

Nonlinear stochastic motion presents significant challenges for Bayesian particle tracking. To address this challenge, this paper proposes a framework to construct an invertible transformation that maps the nonlinear state-space model (SSM)…

Methodology · Statistics 2026-04-13 Yonatan L. Ashenafi

In this paper, a sampling-based Stochastic Model Predictive Control algorithm is proposed for discrete-time linear systems subject to both parametric uncertainties and additive disturbances. One of the main drivers for the development of…

State-space models are successfully used in many areas of science, engineering and economics to model time series and dynamical systems. We present a fully Bayesian approach to inference \emph{and learning} (i.e. state estimation and system…

Machine Learning · Statistics 2013-12-18 Roger Frigola , Fredrik Lindsten , Thomas B. Schön , Carl E. Rasmussen

The Gaussian process state-space model (GPSSM) has attracted extensive attention for modeling complex nonlinear dynamical systems. However, the existing GPSSM employs separate Gaussian processes (GPs) for each latent state dimension,…

Machine Learning · Computer Science 2023-09-06 Zhidi Lin , Juan Maroñas , Ying Li , Feng Yin , Sergios Theodoridis

State Space Models (SSMs), particularly recent selective variants like Mamba, have emerged as a leading architecture for sequence modeling, challenging the dominance of Transformers. However, the success of these state-of-the-art models…

Machine Learning · Computer Science 2025-08-06 Yiyi Wang , Jian'an Zhang , Hongyi Duan , Haoyang Liu , Qingyang Li