English
Related papers

Related papers: Black-Box Inference for Non-Linear Latent Force Mo…

200 papers

We focus on variational inference in dynamical systems where the discrete time transition function (or evolution rule) is modelled by a Gaussian process. The dominant approach so far has been to use a factorised posterior distribution,…

Machine Learning · Statistics 2018-12-17 Alessandro Davide Ialongo , Mark van der Wilk , James Hensman , Carl Edward Rasmussen

We examine an analytic variational inference scheme for the Gaussian Process State Space Model (GPSSM) - a probabilistic model for system identification and time-series modelling. Our approach performs variational inference over both the…

Machine Learning · Statistics 2018-12-11 Alessandro Davide Ialongo , Mark van der Wilk , Carl Edward Rasmussen

While stochastic variational inference is relatively well known for scaling inference in Bayesian probabilistic models, related methods also offer ways to circumnavigate the approximation of analytically intractable expectations. The key…

Machine Learning · Statistics 2015-09-08 David A. Knowles

We present a class of algorithms for state estimation in nonlinear, non-Gaussian state-space models. Our approach is based on a variational Lagrangian formulation that casts Bayesian inference as a sequence of entropic trust-region updates…

Machine Learning · Computer Science 2025-11-20 Hany Abdulsamad , Ángel F. García-Fernández , Simo Särkkä

System identification of complex and nonlinear systems is a central problem for model predictive control and model-based reinforcement learning. Despite their complexity, such systems can often be approximated well by a set of linear…

Machine Learning · Statistics 2019-05-30 Philip Becker-Ehmck , Jan Peters , Patrick van der Smagt

Modelling the behaviour of highly nonlinear dynamical systems with robust uncertainty quantification is a challenging task which typically requires approaches specifically designed to address the problem at hand. We introduce a…

Machine Learning · Statistics 2024-01-25 Thomas Baldwin-McDonald , Mauricio A. Álvarez

Many software engineering tasks, such as testing, and anomaly detection can benefit from the ability to infer a behavioral model of the software.Most existing inference approaches assume access to code to collect execution sequences. In…

Machine Learning · Computer Science 2021-10-13 Foozhan Ataiefard , Mohammad Jafar Mashhadi , Hadi Hemmati , Niel Walkinshaw

We study the problem of predictive runtime monitoring of black-box dynamical systems with quantitative safety properties. The black-box setting stipulates that the exact semantics of the dynamical system and the controller are unknown, and…

Systems and Control · Electrical Eng. & Systems 2024-12-24 Thomas A. Henzinger , Fabian Kresse , Kaushik Mallik , Emily Yu , Đorđe Žikelić

Latent force models (LFM) are principled approaches to incorporating solutions to differential equations within non-parametric inference methods. Unfortunately, the development and application of LFMs can be inhibited by their computational…

Machine Learning · Statistics 2014-05-30 Steven Reece , Stephen Roberts , Siddhartha Ghosh , Alex Rogers , Nicholas Jennings

Inferring dynamical models from low-resolution temporal data continues to be a significant challenge in biophysics, especially within transcriptomics, where separating molecular programs from noise remains an important open problem. We…

Machine Learning · Computer Science 2023-10-05 Victor Chardès , Suryanarayana Maddu , Michael J. Shelley

The identification of Linear Time-Varying (LTV) systems from input-output data is a fundamental yet challenging ill-posed inverse problem. This work introduces a unified Bayesian framework that models the system's impulse response, $h(t,…

Machine Learning · Statistics 2026-04-01 Yaniv Shulman

Parameter inference for stochastic differential equations is challenging due to the presence of a latent diffusion process. Working with an Euler-Maruyama discretisation for the diffusion, we use variational inference to jointly learn the…

Computation · Statistics 2018-05-15 Thomas Ryder , Andrew Golightly , A. Stephen McGough , Dennis Prangle

Audio effects are extensively used at every stage of audio and music content creation. The majority of differentiable audio effects modeling approaches fall into the black-box or gray-box paradigms; and most models have been proposed and…

Sound · Computer Science 2025-02-21 Marco Comunità , Christian J. Steinmetz , Joshua D. Reiss

The present paper is motivated by one of the most fundamental challenges in inverse problems, that of quantifying model discrepancies and errors. While significant strides have been made in calibrating model parameters, the overwhelming…

Computational Physics · Physics 2018-03-08 Lukas Bruder , Phaedon-Stelios Koutsourelakis

We identify a new variational inference scheme for dynamical systems whose transition function is modelled by a Gaussian process. Inference in this setting has either employed computationally intensive MCMC methods, or relied on…

Machine Learning · Statistics 2019-06-14 Alessandro Davide Ialongo , Mark van der Wilk , James Hensman , Carl Edward Rasmussen

We study the problem of modeling a non-linear dynamical system when given a time series by deriving equations directly from the data. Despite the fact that time series data are given as input, models for dynamics and estimation algorithms…

Machine Learning · Computer Science 2025-04-16 Ren Fujiwara , Yasuko Matsubara , Yasushi Sakurai

A latent force model is a Gaussian process with a covariance function inspired by a differential operator. Such covariance function is obtained by performing convolution integrals between Green's functions associated to the differential…

Machine Learning · Statistics 2021-04-20 Cristian Guarnizo , Mauricio A. Álvarez

The Dynamical Gaussian Process Latent Variable Models provide an elegant non-parametric framework for learning the low dimensional representations of the high-dimensional time-series. Real world observational studies, however, are often…

Machine Learning · Computer Science 2019-09-26 Thanh Le , Vasant Honavar

We introduce Latent Gaussian Process Regression which is a latent variable extension allowing modelling of non-stationary multi-modal processes using GPs. The approach is built on extending the input space of a regression problem with a…

Machine Learning · Statistics 2017-09-19 Erik Bodin , Neill D. F. Campbell , Carl Henrik Ek

This article establishes the foundation for a new theory of invariant/integral manifolds for non-autonomous dynamical systems. Current rigorous support for dimensional reduction modelling of slow-fast systems is limited by the rare events…

Dynamical Systems · Mathematics 2022-06-01 A. J. Roberts