English
Related papers

Related papers: Machine Learning of Linear Differential Equations …

200 papers

We describe a set of Gaussian Process based approaches that can be used to solve non-linear Ordinary Differential Equations. We suggest an explicit probabilistic solver and two implicit methods, one analogous to Picard iteration and the…

Methodology · Statistics 2014-08-19 David Barber

We present a machine learning algorithm that discovers conservation laws from differential equations, both numerically (parametrized as neural networks) and symbolically, ensuring their functional independence (a non-linear generalization…

Machine Learning · Computer Science 2022-11-01 Ziming Liu , Varun Madhavan , Max Tegmark

This paper addresses Bayesian inference related to partial differential equations (PDEs), particularly nonparametric regression constrained by PDEs. To effectively encode prior information, we propose a novel framework that learns a…

Statistics Theory · Mathematics 2026-02-09 Junxiong Jia , Deyu Meng , Zongben Xu , Fang Yao

We introduce a nonparametric approach for estimating drift and diffusion functions in systems of stochastic differential equations from observations of the state vector. Gaussian processes are used as flexible models for these functions and…

Data Analysis, Statistics and Probability · Physics 2018-08-15 Philipp Batz , Andreas Ruttor , Manfred Opper

We introduce a variational Bayesian neural network where the parameters are governed via a probability distribution on random matrices. Specifically, we employ a matrix variate Gaussian \cite{gupta1999matrix} parameter posterior…

Machine Learning · Statistics 2016-06-24 Christos Louizos , Max Welling

Linear filtering problem for infinite-dimensional Gaussian processes is studied, the observation process being finite-dimensional. Integral equations for the filter and for covariance of the error are derived. General results are applied to…

Probability · Mathematics 2019-09-10 Vit Kubelka , Bohdan Maslowski

Non-stationary time series with non-linear trends are frequently encountered in applications. We consider here the feasibility of accurately forecasting the signals of multiple such time series considering jointly when the number of…

Methodology · Statistics 2016-08-05 Kerry Fendick

Equations governing physico-chemical processes are usually known at microscopic spatial scales, yet one suspects that there exist equations, e.g. in the form of Partial Differential Equations (PDEs), that can explain the system evolution at…

Machine Learning · Statistics 2021-03-31 Hassan Arbabi , Ioannis Kevrekidis

The paper covers the design and analysis of experiments to discriminate between two Gaussian process models, such as those widely used in computer experiments, kriging, sensor location and machine learning. Two frameworks are considered.…

Methodology · Statistics 2022-11-22 Elham Yousefi , Luc Pronzato , Markus Hainy , Werner G. Müller , Henry P. Wynn

Statistical (machine learning) tools for equation discovery require large amounts of data that are typically computer generated rather than experimentally observed. Multiscale modeling and stochastic simulations are two areas where learning…

Machine Learning · Statistics 2021-03-17 Joseph Bakarji , Daniel M. Tartakovsky

Complex spatiotemporal dynamics of physicochemical processes are often modeled at a microscopic level (through e.g. atomistic, agent-based or lattice models) based on first principles. Some of these processes can also be successfully…

Within the past two decades, Gaussian process regression has been increasingly used for modeling dynamical systems due to some beneficial properties such as the bias variance trade-off and the strong connection to Bayesian mathematics. As…

Systems and Control · Electrical Eng. & Systems 2021-02-11 Thomas Beckers

Gaussian process regression is a well-established Bayesian machine learning method. We propose a new approach to Gaussian process regression using quantum kernels based on parameterized quantum circuits. By employing a hardware-efficient…

Quantum Physics · Physics 2024-02-06 Frederic Rapp , Marco Roth

High dimensional time series are endemic in applications of machine learning such as robotics (sensor data), computational biology (gene expression data), vision (video sequences) and graphics (motion capture data). Practical nonlinear…

Machine Learning · Statistics 2011-07-26 Andreas C. Damianou , Michalis K. Titsias , Neil D. Lawrence

Gaussian processes are a powerful framework for quantifying uncertainty and for sequential decision-making but are limited by the requirement of solving linear systems. In general, this has a cubic cost in dataset size and is sensitive to…

This paper proposes a new algorithm for Gaussian process classification based on posterior linearisation (PL). In PL, a Gaussian approximation to the posterior density is obtained iteratively using the best possible linearisation of the…

Machine Learning · Computer Science 2019-04-19 Ángel F. García-Fernández , Filip Tronarp , Simo Särkkä

This paper presents a unified treatment of Gaussian process models that extends to data from the exponential dispersion family and to survival data. Our specific interest is in the analysis of data sets with predictors that have an a priori…

Methodology · Statistics 2011-06-17 Terrance Savitsky , Marina Vannucci , Naijun Sha

This work develops a class of probabilistic algorithms for the numerical solution of nonlinear, time-dependent partial differential equations (PDEs). Current state-of-the-art PDE solvers treat the space- and time-dimensions separately,…

Numerical Analysis · Mathematics 2022-03-10 Nicholas Krämer , Jonathan Schmidt , Philipp Hennig

We present a machine learning based method for learning first integrals of systems of ordinary differential equations from given trajectory data. The method is model-agnostic in that it does not require explicit knowledge of the underlying…

Machine Learning · Computer Science 2023-02-02 Shivam Arora , Alex Bihlo , Rüdiger Brecht , Pavel Holba

We introduce a method based on Gaussian process regression to identify discrete variational principles from observed solutions of a field theory. The method is based on the data-based identification of a discrete Lagrangian density. It is a…

Numerical Analysis · Mathematics 2024-07-11 Christian Offen