English
Related papers

Related papers: Learning differential equations from data

200 papers

Deriving governing equations in Electromagnetic (EM) environment based on first principles can be quite tough when there are some unknown sources of noise and other uncertainties in the system. For nonlinear multiple-physics electromagnetic…

Computational Physics · Physics 2019-10-31 Bing Xiong , Haiyang Fu , Feng Xu , Yaqiu Jin

Many physical processes such as weather phenomena or fluid mechanics are governed by partial differential equations (PDEs). Modelling such dynamical systems using Neural Networks is an active research field. However, current methods are…

Machine Learning · Computer Science 2022-10-12 Andrzej Dulny , Andreas Hotho , Anna Krause

Neural ordinary differential equations (Neural ODEs) propose the idea that a sequence of layers in a neural network is just a discretisation of an ODE, and thus can instead be directly modelled by a parameterised ODE. This idea has had…

Machine Learning · Computer Science 2024-05-07 Christina Runkel , Ander Biguri , Carola-Bibiane Schönlieb

Neural Ordinary Differential Equations (ODE) are a promising approach to learn dynamic models from time-series data in science and engineering applications. This work aims at learning Neural ODE for stiff systems, which are usually raised…

Numerical Analysis · Mathematics 2021-10-04 Suyong Kim , Weiqi Ji , Sili Deng , Yingbo Ma , Christopher Rackauckas

We present a numerical framework for deep neural network (DNN) modeling of unknown time-dependent partial differential equations (PDE) using their trajectory data. Unlike the recent work of [Wu and Xiu, J. Comput. Phys. 2020], where the…

Machine Learning · Computer Science 2021-11-24 Zhen Chen , Victor Churchill , Kailiang Wu , Dongbin Xiu

The intersection of machine learning and dynamical systems has generated considerable interest recently. Neural Ordinary Differential Equations (NODEs) represent a rich overlap between these fields. In this paper, we develop a continuous…

Optimization and Control · Mathematics 2023-06-16 Maria Oprea , Mark Walth , Robert Stephany , Gabriella Torres Nothaft , Arnaldo Rodriguez-Gonzalez , William Clark

Numerical approximations of partial differential equations (PDEs) are routinely employed to formulate the solution of physics, engineering, and mathematical problems involving functions of several variables, such as the propagation of heat…

A long-standing problem at the interface of artificial intelligence and applied mathematics is to devise an algorithm capable of achieving human level or even superhuman proficiency in transforming observed data into predictive mathematical…

Machine Learning · Statistics 2018-01-23 Maziar Raissi

The identification of a mathematical dynamics model is a crucial step in the designing process of a controller. However, it is often very difficult to identify the system's governing equations, especially in complex environments that…

Systems and Control · Electrical Eng. & Systems 2024-07-01 Tobias Nagel , Marco F. Huber

Forecasting system behaviour near and across bifurcations is crucial for identifying potential shifts in dynamical systems. While machine learning has recently been used to learn critical transitions and bifurcation structures from data,…

Machine Learning · Computer Science 2025-11-14 Eva van Tegelen , George van Voorn , Ioannis Athanasiadis , Peter van Heijster

Deep Learning has emerged as one of the most significant innovations in machine learning. However, a notable limitation of this field lies in the ``black box" decision-making processes, which have led to skepticism within groups like…

Machine Learning · Computer Science 2025-03-06 Shi Li

Deep neural networks (DNNs) have achieved remarkable empirical success, yet the absence of a principled theoretical foundation continues to hinder their systematic development. In this survey, we present differential equations as a…

Artificial Intelligence · Computer Science 2026-03-20 Hongjue Zhao , Yizhuo Chen , Yuchen Wang , Hairong Qi , Lui Sha , Tarek Abdelzaher , Huajie Shao

Can neural networks learn to solve partial differential equations (PDEs)? We investigate this question for two (systems of) PDEs, namely, the Poisson equation and the steady Navier--Stokes equations. The contributions of this paper are…

Machine Learning · Computer Science 2019-04-16 Tim Dockhorn

We introduce physics informed neural networks -- neural networks that are trained to solve supervised learning tasks while respecting any given law of physics described by general nonlinear partial differential equations. In this two part…

Artificial Intelligence · Computer Science 2017-11-30 Maziar Raissi , Paris Perdikaris , George Em Karniadakis

Providing fast and accurate solutions to partial differential equations is a problem of continuous interest to the fields of applied mathematics and physics. With the recent advances in machine learning, the adoption learning techniques in…

Computational Physics · Physics 2019-04-16 S. Mohammad H. Hashemi , Demetri Psaltis

Complex dynamic systems are typically either modeled using expert knowledge in the form of differential equations or via data-driven universal approximation models such as artificial neural networks (ANN). While the first approach has…

Optimization and Control · Mathematics 2024-09-09 Christoph Plate , Carl Julius Martensen , Sebastian Sager

Machine learning algorithms have been successfully used to approximate nonlinear maps under weak assumptions on the structure and properties of the maps. We present deep neural networks using dense and convolutional layers to solve an…

Machine Learning · Statistics 2021-05-05 Johann Rudi , Julie Bessac , Amanda Lenzi

We introduce a new family of deep neural network models. Instead of specifying a discrete sequence of hidden layers, we parameterize the derivative of the hidden state using a neural network. The output of the network is computed using a…

Machine Learning · Computer Science 2019-12-17 Ricky T. Q. Chen , Yulia Rubanova , Jesse Bettencourt , David Duvenaud

Numerical simulation of ordinary differential equations (ODEs) can be challenging when the system exhibits high accelerations and rapidly changing dynamics. Under these conditions the ODE solver often needs to take very small time steps in…

Numerical Analysis · Mathematics 2026-05-11 Andrew Tagg , Andrew Frandsen , Andrew Ning

We develop a framework for estimating unknown partial differential equations from noisy data, using a deep learning approach. Given noisy samples of a solution to an unknown PDE, our method interpolates the samples using a neural network,…

Machine Learning · Computer Science 2019-10-24 Ali Hasan , João M. Pereira , Robert Ravier , Sina Farsiu , Vahid Tarokh