English
Related papers

Related papers: Inference of dynamic systems from noisy and sparse…

200 papers

In this paper we present a novel inference methodology to perform Bayesian inference for spatiotemporal Cox processes where the intensity function depends on a multivariate Gaussian process. Dynamic Gaussian processes are introduced to…

Methodology · Statistics 2019-03-12 Flávio B. Gonçalves , Dani Gamerman

Gaussian processes allow for flexible specification of prior assumptions of unknown dynamics in state space models. We present a procedure for efficient Bayesian learning in Gaussian process state space models, where the representation is…

Computation · Statistics 2016-04-18 Andreas Svensson , Arno Solin , Simo Särkkä , Thomas B. Schön

State-space models are successfully used in many areas of science, engineering and economics to model time series and dynamical systems. We present a fully Bayesian approach to inference \emph{and learning} (i.e. state estimation and system…

Machine Learning · Statistics 2013-12-18 Roger Frigola , Fredrik Lindsten , Thomas B. Schön , Carl E. Rasmussen

Effective forces -- derived from experimental or {\it in silico} molecular dynamics time traces -- are critical in developing reduced and computationally efficient descriptions of otherwise complex dynamical problems. Thus, designing…

Biological Physics · Physics 2019-08-29 J Shepard Bryan , Ioannis Sgouralis , Steve Pressé

We evaluate the robustness of a probabilistic formulation of system identification (ID) to sparse, noisy, and indirect data. Specifically, we compare estimators of future system behavior derived from the Bayesian posterior of a learning…

Machine Learning · Statistics 2023-01-02 Nicholas Galioto , Alex Gorodetsky

Recent machine learning advances have proposed black-box estimation of unknown continuous-time system dynamics directly from data. However, earlier works are based on approximative ODE solutions or point estimates. We propose a novel…

Machine Learning · Computer Science 2022-07-19 Pashupati Hegde , Çağatay Yıldız , Harri Lähdesmäki , Samuel Kaski , Markus Heinonen

Gaussian process modulated Poisson processes provide a flexible framework for modelling spatiotemporal point patterns. So far this had been restricted to one dimension, binning to a pre-determined grid, or small data sets of up to a few…

Machine Learning · Statistics 2018-04-04 S. T. John , James Hensman

Gaussian processes (GPs) are widely used in nonparametric regression, classification and spatio-temporal modeling, motivated in part by a rich literature on theoretical properties. However, a well known drawback of GPs that limits their use…

Methodology · Statistics 2011-06-29 Anjishnu Banerjee , David Dunson , Surya Tokdar

Solving Bayesian inference problems approximately with variational approaches can provide fast and accurate results. Capturing correlation within the approximation requires an explicit parametrization. This intrinsically limits this…

Machine Learning · Statistics 2020-01-31 Jakob Knollmüller , Torsten A. Enßlin

Gaussian processes are used in many machine learning applications that rely on uncertainty quantification. Recently, computational tools for working with these models in geometric settings, such as when inputs lie on a Riemannian manifold,…

Machine Learning · Statistics 2023-10-31 Paul Rosa , Viacheslav Borovitskiy , Alexander Terenin , Judith Rousseau

Multiscale dynamical systems characterized by interacting fast and slow processes are ubiquitous across scientific domains, from climate dynamics to fluid mechanics. Accurate modeling of such systems requires capturing both the long-term…

Chaotic Dynamics · Physics 2025-11-07 Giulio Del Felice , Ludovico Theo Giorgini

This paper presents a machine learning framework (GP-NODE) for Bayesian systems identification from partial, noisy and irregular observations of nonlinear dynamical systems. The proposed method takes advantage of recent developments in…

Machine Learning · Computer Science 2021-03-08 Mohamed Aziz Bhouri , Paris Perdikaris

Sparse Gaussian Processes are a key component of high-throughput Bayesian optimisation (BO) loops -- an increasingly common setting where evaluation budgets are large and highly parallelised. By using representative subsets of the available…

Machine Learning · Computer Science 2022-07-14 Henry B. Moss , Sebastian W. Ober , Victor Picheny

Our ability to predict, control, and ultimately understand complex systems rests on discovering the equations that govern their dynamics. Identifying these equations directly from noisy, limited observations has therefore become a central…

Machine Learning · Computer Science 2026-04-16 Yuzheng Zhang , Weizhen Li , Rui Carvalho

A fully Bayesian treatment of complicated predictive models (such as deep neural networks) would enable rigorous uncertainty quantification and the automation of higher-level tasks including model selection. However, the intractability of…

The application of Stochastic Differential Equations (SDEs) to the analysis of temporal data has attracted increasing attention, due to their ability to describe complex dynamics with physically interpretable equations. In this paper, we…

Machine Learning · Statistics 2017-08-09 Constantino A. García , Abraham Otero , Paulo Félix , Jesús Presedo , David G. Márquez

We introduce a new interpretation of sparse variational approximations for Gaussian processes using inducing points, which can lead to more scalable algorithms than previous methods. It is based on decomposing a Gaussian process as a sum of…

Machine Learning · Statistics 2024-02-27 Jiaxin Shi , Michalis K. Titsias , Andriy Mnih

This work brings together two powerful concepts in Gaussian processes: the variational approach to sparse approximation and the spectral representation of Gaussian processes. This gives rise to an approximation that inherits the benefits of…

Machine Learning · Statistics 2017-11-09 James Hensman , Nicolas Durrande , Arno Solin

Multi-task learning models using Gaussian processes (GP) have been developed and successfully applied in various applications. The main difficulty with this approach is the computational cost of inference using the union of examples from…

Machine Learning · Computer Science 2012-11-29 Yuyang Wang , Roni Khardon

Deep Gaussian processes (DGPs) can model complex marginal densities as well as complex mappings. Non-Gaussian marginals are essential for modelling real-world data, and can be generated from the DGP by incorporating uncorrelated variables…

Machine Learning · Statistics 2019-05-15 Hugh Salimbeni , Vincent Dutordoir , James Hensman , Marc Peter Deisenroth