English
Related papers

Related papers: Closed-form Inference and Prediction in Gaussian P…

200 papers

State-space models have been successfully used for more than fifty years in different areas of science and engineering. We present a procedure for efficient variational Bayesian learning of nonlinear state-space models based on sparse…

Machine Learning · Computer Science 2014-11-04 Roger Frigola , Yutian Chen , Carl E. Rasmussen

Switching dynamical systems provide a powerful, interpretable modeling framework for inference in time-series data in, e.g., the natural sciences or engineering applications. Since many areas, such as biology or discrete-event systems, are…

Machine Learning · Computer Science 2021-09-30 Lukas Köhs , Bastian Alt , Heinz Koeppl

The goal of system identification is to learn about underlying physics dynamics behind the time-series data. To model the probabilistic and nonparametric dynamics model, Gaussian process (GP) have been widely used; GP can estimate the…

Machine Learning · Statistics 2018-11-22 Young-Jin Park , Han-Lim Choi

Subspace-valued functions arise in a wide range of problems, including parametric reduced order modeling (PROM). In PROM, each parameter point can be associated with a subspace, which is used for Petrov-Galerkin projections of large system…

Statistics Theory · Mathematics 2021-07-13 Ruda Zhang , Simon Mak , David Dunson

Variational inference techniques based on inducing variables provide an elegant framework for scalable posterior estimation in Gaussian process (GP) models. Besides enabling scalability, one of their main advantages over sparse…

Machine Learning · Statistics 2021-02-24 Simone Rossi , Markus Heinonen , Edwin V. Bonilla , Zheyang Shen , Maurizio Filippone

Model Predictive Control evolved as the state of the art paradigm for safety critical control tasks. Control-as-Inference approaches thereof model the constrained optimization problem as a probabilistic inference problem. The constraints…

Optimization and Control · Mathematics 2025-11-21 Jörn Tebbe , Andreas Besginow , Markus Lange-Hegermann

Sequential Bayesian Filtering aims to estimate the current state distribution of a Hidden Markov Model, given the past observations. The problem is well-known to be intractable for most application domains, except in notable cases such as…

Machine Learning · Statistics 2024-02-16 Théophile Cantelobre , Carlo Ciliberto , Benjamin Guedj , Alessandro Rudi

Continuous-time state-space models (SSMs) are flexible tools for analysing irregularly sampled sequential observations that are driven by an underlying state process. Corresponding applications typically involve restrictive assumptions…

Methodology · Statistics 2020-10-29 Sina Mews , Roland Langrock , Marius Ötting , Houda Yaqine , Jost Reinecke

We consider the problem of sequential estimation of the unknowns of state-space and deep state-space models that include estimation of functions and latent processes of the models. The proposed approach relies on Gaussian and deep Gaussian…

Machine Learning · Computer Science 2024-03-26 Yuhao Liu , Marzieh Ajirak , Petar Djuric

Accurate learning of system dynamics is becoming increasingly crucial for advanced control and decision-making in engineering. However, real-world systems often exhibit multiple channels and highly nonlinear transition dynamics, challenging…

Machine Learning · Statistics 2025-10-20 Tengjie Zheng , Jilan Mei , Di Wu , Lin Cheng , Shengping Gong

Deep Gaussian Processes (DGPs) are hierarchical generalizations of Gaussian Processes that combine well calibrated uncertainty estimates with the high flexibility of multilayer models. One of the biggest challenges with these models is that…

Machine Learning · Statistics 2018-11-13 Marton Havasi , José Miguel Hernández-Lobato , Juan José Murillo-Fuentes

Many real-world dynamical systems can be described as State-Space Models (SSMs). In this formulation, each observation is emitted by a latent state, which follows first-order Markovian dynamics. A Probabilistic Deep SSM (ProDSSM)…

Machine Learning · Computer Science 2023-09-18 Andreas Look , Melih Kandemir , Barbara Rakitsch , Jan Peters

We implement a wireless indoor navigation system based on the variational Gaussian process state-space model (GPSSM) with smartphone-collected WiFi received signal strength (RSS) and inertial measurement unit (IMU) readings. We adapt the…

Signal Processing · Electrical Eng. & Systems 2020-03-19 Ang Xie , Feng Yin , Bo Ai , Shuguang Cui

Gaussian processes (GPs) are Bayesian nonparametric models for function approximation with principled predictive uncertainty estimates. Deep Gaussian processes (DGPs) are multilayer generalizations of GPs that can represent complex marginal…

Machine Learning · Statistics 2024-09-20 Qiuxian Meng , Yongyou Zhang

Differential equations are important mechanistic models that are integral to many scientific and engineering applications. With the abundance of available data there has been a growing interest in data-driven physics-informed models.…

Machine Learning · Computer Science 2025-02-04 Oliver Hamelijnck , Arno Solin , Theodoros Damoulas

The Gaussian process latent variable model (GPLVM) is a popular probabilistic method used for nonlinear dimension reduction, matrix factorization, and state-space modeling. Inference for GPLVMs is computationally tractable only when the…

Machine Learning · Statistics 2023-06-16 Michael Minyi Zhang , Gregory W. Gundersen , Barbara E. Engelhardt

Gaussian processes are valuable tools for non-parametric modelling, where typically an assumption of stationarity is employed. While removing this assumption can improve prediction, fitting such models is challenging. In this work,…

Computation · Statistics 2019-05-02 Karla Monterrubio-Gómez , Lassi Roininen , Sara Wade , Theo Damoulas , Mark Girolami

Gaussian-process state-space models (GP-SSMs) provide a flexible nonparametric alternative for modeling time-series dynamics that are nonlinear or difficult to specify parametrically. While the Kalman filter is effective for linear-Gaussian…

Methodology · Statistics 2025-12-02 Genshiro Kitagawa

In this paper we present a novel inference methodology to perform Bayesian inference for spatiotemporal Cox processes where the intensity function depends on a multivariate Gaussian process. Dynamic Gaussian processes are introduced to…

Methodology · Statistics 2019-03-12 Flávio B. Gonçalves , Dani Gamerman

Switching dynamical systems are an expressive model class for the analysis of time-series data. As in many fields within the natural and engineering sciences, the systems under study typically evolve continuously in time, it is natural to…

Machine Learning · Computer Science 2022-05-19 Lukas Köhs , Bastian Alt , Heinz Koeppl