English
Related papers

Related papers: State-space deep Gaussian processes with applicati…

200 papers

Gaussian processes (GPs) are distributions over functions, which provide a Bayesian nonparametric approach to regression and classification. In spite of their success, GPs have limited use in some applications, for example, in some cases a…

Machine Learning · Computer Science 2020-05-28 Alessio Benavoli , Dario Azzimonti , Dario Piga

Deep Gaussian processes (DGPs) can model complex marginal densities as well as complex mappings. Non-Gaussian marginals are essential for modelling real-world data, and can be generated from the DGP by incorporating uncorrelated variables…

Machine Learning · Statistics 2019-05-15 Hugh Salimbeni , Vincent Dutordoir , James Hensman , Marc Peter Deisenroth

Mechanistic knowledge about the physical world is virtually always expressed via partial differential equations (PDEs). Recently, there has been a surge of interest in probabilistic PDE solvers -- Bayesian statistical models mostly based on…

Machine Learning · Computer Science 2025-03-12 Tim Weiland , Marvin Pförtner , Philipp Hennig

Inverse problems with spatiotemporal observations are ubiquitous in scientific studies and engineering applications. In these spatiotemporal inverse problems, observed multivariate time series are used to infer parameters of physical or…

Methodology · Statistics 2022-04-26 Shiwei Lan , Shuyi Li , Mirjeta Pasha

Deep Gaussian processes (DGPs) provide a Bayesian non-parametric alternative to standard parametric deep learning models. A DGP is formed by stacking multiple GPs resulting in a well-regularized composition of functions. The Bayesian…

Machine Learning · Statistics 2018-06-06 Vinayak Kumar , Vaibhav Singh , P. K. Srijith , Andreas Damianou

We provide a comprehensive overview and tooling for GP modeling with non-Gaussian likelihoods using state space methods. The state space formulation allows for solving one-dimensional GP models in $\mathcal{O}(n)$ time and memory…

Machine Learning · Statistics 2018-07-06 Hannes Nickisch , Arno Solin , Alexander Grigorievskiy

This paper is concerned with regularized extensions of hierarchical non-stationary temporal Gaussian processes (NSGPs) in which the parameters (e.g., length-scale) are modeled as GPs. In particular, we consider two commonly used NSGP…

Methodology · Statistics 2021-05-21 Zheng Zhao , Rui Gao , Simo Särkkä

In this paper we introduce a novel model for Gaussian process (GP) regression in the fully Bayesian setting. Motivated by the ideas of sparsification, localization and Bayesian additive modeling, our model is built around a recursive…

Statistics Theory · Mathematics 2022-06-06 Hengrui Luo , Giovanni Nattino , Matthew T. Pratola

Gaussian processes provide a compact representation for modeling and estimating an unknown function, that can be updated as new measurements of the function are obtained. This paper extends this powerful framework to the case where the…

Systems and Control · Electrical Eng. & Systems 2023-11-30 Jilles van Hulst , Roy van Zuijlen , Duarte Antunes , W. P. M. H. , Heemels

This paper proposes a novel low-rank approximation to the multivariate State-Space Model. The Stochastic Partial Differential Equation (SPDE) approach is applied component-wise to the independent-in-time Mat\'ern Gaussian innovation term in…

The solutions of Hamiltonian equations are known to describe the underlying phase space of a mechanical system. In this article, we propose a novel spatio-temporal model using a strategic modification of the Hamiltonian equations,…

Methodology · Statistics 2026-02-17 Satyaki Mazumder , Sayantan Banerjee , Sourabh Bhattacharya

In this paper, we present a new statistical approach to the problem of incorporating experimental observations into a mathematical model described by linear partial differential equations (PDEs) to improve the prediction of the state of a…

Analysis of PDEs · Mathematics 2014-05-30 Ngoc-Cuong Nguyen , Jaime Peraire

An important class of spatio-temporal models is constructed by leveraging the hierarchical structure of dynamical (or, state-space) models. This paper proposes a new statistical dynamical model for spatio-temporal processes motivated by…

Methodology · Statistics 2026-05-11 Yutong Zhang , Xiao Liu

Gaussian process state-space models (GP-SSMs) are a very flexible family of models of nonlinear dynamical systems. They comprise a Bayesian nonparametric representation of the dynamics of the system and additional (hyper-)parameters…

Machine Learning · Statistics 2013-12-18 Roger Frigola , Fredrik Lindsten , Thomas B. Schön , Carl E. Rasmussen

Deep generative models have emerged as state-of-the-art for solving inverse problems, but applying them to inverse problems for PDEs, like electrical impedance tomography (EIT) remains challenging. Because physical domains are naturally…

Image and Video Processing · Electrical Eng. & Systems 2026-05-20 Giovanni S. Alberti , Damiana Lazzaro , Serena Morigi , Matteo Santacesaria , Shibo Wang

Heteroscedastic regression considering the varying noises among observations has many applications in the fields like machine learning and statistics. Here we focus on the heteroscedastic Gaussian process (HGP) regression which integrates…

Machine Learning · Statistics 2020-01-22 Haitao Liu , Yew-Soon Ong , Jianfei Cai

Gaussian Process State Space Models (GP-SSMs) are a non-parametric model class suitable to represent nonlinear dynamics. They become increasingly popular in data-driven modeling approaches, i.e. when no first-order physics-based models are…

Systems and Control · Computer Science 2018-11-19 Thomas Beckers , Sandra Hirche

In this work, a Gaussian process regression(GPR) model incorporated with given physical information in partial differential equations(PDEs) is developed: physics-assisted Gaussian processes(PAGP). The targets of this model can be divided…

Machine Learning · Statistics 2022-04-07 Jiahao Zhang , Shiqi Zhang , Guang Lin

This paper presents a deep Gaussian process (DGP) model with a recurrent architecture for speech sequence modeling. DGP is a Bayesian deep model that can be trained effectively with the consideration of model complexity and is a kernel…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-24 Tomoki Koriyama , Hiroshi Saruwatari

We introduce a class of scalable Bayesian hierarchical models for the analysis of massive geostatistical datasets. The underlying idea combines ideas on high-dimensional geostatistics by partitioning the spatial domain and modeling the…

Methodology · Statistics 2020-10-09 Michele Peruzzi , Sudipto Banerjee , Andrew O. Finley