English
Related papers

Related papers: A Probabilistic State Space Model for Joint Infere…

200 papers

We formulate probabilistic numerical approximations to solutions of ordinary differential equations (ODEs) as problems in Gaussian process (GP) regression with non-linear measurement functions. This is achieved by defining the measurement…

Methodology · Statistics 2019-04-25 Filip Tronarp , Hans Kersting , Simo Särkkä , Philipp Hennig

Neural ordinary differential equations (ODEs) are widely recognized as the standard for modeling physical mechanisms, which help to perform approximate inference in unknown physical or biological environments. In partially observable (PO)…

Machine Learning · Computer Science 2023-10-31 Xuanle Zhao , Duzhen Zhang , Liyuan Han , Tielin Zhang , Bo Xu

The interpretation of numerical methods, such as finite difference methods for differential equations, as point estimators allows for formal statistical quantification of the error due to discretisation in the numerical context. Competing…

Methodology · Statistics 2018-05-23 Junyang Wang , Jon Cockayne , Chris Oates

Ordinary differential equations (ODE's) are a cornerstone of systems and control theory. Accordingly, they are standard material in undergraduate programs in engineering and there is abundant didactic literature about this topic. Yet, the…

Systems and Control · Electrical Eng. & Systems 2026-04-10 Alexandre Sanfelici Bazanella , Tristão Garcia

The Bayesian inference approach is widely used to tackle inverse problems due to its versatile and natural ability to handle ill-posedness. However, it often faces challenges when dealing with situations involving continuous fields or…

Numerical Analysis · Mathematics 2023-08-28 Xinchao Jiang , Xin Wang , Ziming Wen , Hu Wang

State-space models are successfully used in many areas of science, engineering and economics to model time series and dynamical systems. We present a fully Bayesian approach to inference \emph{and learning} (i.e. state estimation and system…

Machine Learning · Statistics 2013-12-18 Roger Frigola , Fredrik Lindsten , Thomas B. Schön , Carl E. Rasmussen

Parameter estimation for ordinary differential equations (ODEs) plays a fundamental role in the analysis of dynamical systems. Generally lacking closed-form solutions, ODEs are traditionally approximated using deterministic solvers.…

Computation · Statistics 2025-06-30 Mohan Wu , Martin Lysy

Most ordinary differential equation (ODE) models used to describe biological or physical systems must be solved approximately using numerical methods. Perniciously, even those solvers which seem sufficiently accurate for the forward…

Filtering-based probabilistic numerical solvers for ordinary differential equations (ODEs), also known as ODE filters, have been established as efficient methods for quantifying numerical uncertainty in the solution of ODEs. In practical…

Machine Learning · Statistics 2025-10-02 Dingling Yao , Filip Tronarp , Nathanael Bosch

Likelihood-free (a.k.a. simulation-based) inference problems are inverse problems with expensive, or intractable, forward models. ODE inverse problems are commonly treated as likelihood-free, as their forward map has to be numerically…

Machine Learning · Statistics 2020-07-01 Hans Kersting , Nicholas Krämer , Martin Schiegg , Christian Daniel , Michael Tiemann , Philipp Hennig

Ordinary Differential Equations are a simple but powerful framework for modeling complex systems. Parameter estimation from times series can be done by Nonlinear Least Squares (or other classical approaches), but this can give…

Methodology · Statistics 2014-10-29 Quentin Clairon , Nicolas Brunel

In the last decade, the scientific community has devolved its attention to the deployment of data-driven approaches in scientific research to provide accurate and reliable analysis of a plethora of phenomena. Most notably, Physics-informed…

Machine Learning · Computer Science 2023-06-21 Mattia Silvestri , Federico Baldo , Eleonora Misino , Michele Lombardi

This paper studies the expressive and computational power of discrete Ordinary Differential Equations (ODEs), a.k.a. (Ordinary) Difference Equations. It presents a new framework using these equations as a central tool for computation and…

Logic in Computer Science · Computer Science 2022-09-27 Olivier Bournez , Arnaud Durand

The numerical solution of differential equations can be formulated as an inference problem to which formal statistical approaches can be applied. However, nonlinear partial differential equations (PDEs) pose substantial challenges from an…

Numerical Analysis · Mathematics 2021-08-26 Junyang Wang , Jon Cockayne , Oksana Chkrebtii , T. J. Sullivan , Chris. J. Oates

We introduce a new family of deep neural network models. Instead of specifying a discrete sequence of hidden layers, we parameterize the derivative of the hidden state using a neural network. The output of the network is computed using a…

Machine Learning · Computer Science 2019-12-17 Ricky T. Q. Chen , Yulia Rubanova , Jesse Bettencourt , David Duvenaud

We present a new scientific machine learning method that learns from data a computationally inexpensive surrogate model for predicting the evolution of a system governed by a time-dependent nonlinear partial differential equation (PDE), an…

Numerical Analysis · Mathematics 2022-02-28 Elizabeth Qian , Ionut-Gabriel Farcas , Karen Willcox

We develop a transformer-based sequence-to-sequence model that recovers scalar ordinary differential equations (ODEs) in symbolic form from irregularly sampled and noisy observations of a single solution trajectory. We demonstrate in…

Machine Learning · Computer Science 2023-07-25 Sören Becker , Michal Klein , Alexander Neitz , Giambattista Parascandolo , Niki Kilbertus

We derive a novel, provably robust, and closed-form Bayesian update rule for online filtering in state-space models in the presence of outliers and misspecified measurement models. Our method combines generalised Bayesian inference with…

Probabilistic solvers for ordinary differential equations (ODEs) provide efficient quantification of numerical uncertainty associated with simulation of dynamical systems. Their convergence rates have been established by a growing body of…

Machine Learning · Statistics 2020-12-21 Nicholas Krämer , Philipp Hennig

We propose a new class of filtering and smoothing methods for inference in high-dimensional, nonlinear, non-Gaussian, spatio-temporal state-space models. The main idea is to combine the ensemble Kalman filter and smoother, developed in the…

Methodology · Statistics 2019-03-22 Matthias Katzfuss , Jonathan R. Stroud , Christopher K. Wikle