English
Related papers

Related papers: SNODE: Spectral Discretization of Neural ODEs for …

200 papers

Fast data acquisition in Magnetic Resonance Imaging (MRI) is vastly in demand and scan time directly depends on the number of acquired k-space samples. The data-driven methods based on deep neural networks have resulted in promising…

Image and Video Processing · Electrical Eng. & Systems 2020-01-01 Ali Pour Yazdanpanah , Onur Afacan , Simon K. Warfield

Ordinary differential equations (ODEs) are a conventional way to describe the observed dynamics of physical systems. Scientists typically hypothesize about dynamical behavior, propose a mathematical model, and compare its predictions to…

Machine Learning · Computer Science 2025-11-20 Nils Wildt , Daniel M. Tartakovsky , Sergey Oladyshkin , Wolfgang Nowak

Neural Ordinary Differential Equations (NODEs) have proven successful in learning dynamical systems in terms of accurately recovering the observed trajectories. While different types of sparsity have been proposed to improve robustness, the…

Machine Learning · Computer Science 2022-10-27 Hananeh Aliee , Till Richter , Mikhail Solonin , Ignacio Ibarra , Fabian Theis , Niki Kilbertus

Recent advances in solving ordinary differential equations (ODEs) with neural networks have been remarkable. Neural networks excel at serving as trial functions and approximating solutions within functional spaces, aided by gradient…

Machine Learning · Computer Science 2024-02-01 Chenxin Qin , Ruhao Liu , Maocai Li , Shengyuan Li , Yi Liu , Chichun Zhou

Neural networks have shown promising potential in accelerating the numerical simulation of systems governed by partial differential equations (PDEs). Different from many existing neural network surrogates operating on high-dimensional…

Machine Learning · Computer Science 2025-01-09 Zijie Li , Saurabh Patil , Francis Ogoke , Dule Shu , Wilson Zhen , Michael Schneier , John R. Buchanan, , Amir Barati Farimani

We propose Characteristic-Neural Ordinary Differential Equations (C-NODEs), a framework for extending Neural Ordinary Differential Equations (NODEs) beyond ODEs. While NODEs model the evolution of a latent variables as the solution to an…

Machine Learning · Computer Science 2022-11-10 Xingzi Xu , Ali Hasan , Khalil Elkhalil , Jie Ding , Vahid Tarokh

Neural networks are one tool for approximating non-linear differential equations used in scientific computing tasks such as surrogate modeling, real-time predictions, and optimal control. PDE foundation models utilize neural networks to…

Machine Learning · Computer Science 2025-02-11 Elisa Negrini , Yuxuan Liu , Liu Yang , Stanley J. Osher , Hayden Schaeffer

The neural Ordinary Differential Equation (ODE) model has shown success in learning complex continuous-time processes from observations on discrete time stamps. In this work, we consider the modeling and forecasting of time series data that…

Machine Learning · Statistics 2023-06-05 Yixuan Tan , Liyan Xie , Xiuyuan Cheng

We study the inverse problem of radiative transfer equation (RTE) using stochastic gradient descent method (SGD) in this paper. Mathematically, optical tomography amounts to recovering the optical parameters in RTE using the…

Optimization and Control · Mathematics 2018-07-04 Ke Chen , Qin Li , Jian-Guo Liu

Neural networks have recently been used to analyze diverse physical systems and to identify the underlying dynamics. While existing methods achieve impressive results, they are limited by their strong demand for training data and their weak…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Florian Hofherr , Lukas Koestler , Florian Bernard , Daniel Cremers

To better understand and improve the behavior of neural networks, a recent line of works bridged the connection between ordinary differential equations (ODEs) and deep neural networks (DNNs). The connections are made in two folds: (1) View…

Machine Learning · Computer Science 2019-11-05 Xinshi Chen

Neural ordinary differential equations (NODE) have been proposed as a continuous depth generalization to popular deep learning models such as Residual networks (ResNets). They provide parameter efficiency and automate the model selection…

Machine Learning · Computer Science 2021-12-24 Srinivas Anumasa , P. K. Srijith

Recent advancements in operator-type neural networks have shown promising results in approximating the solutions of spatiotemporal Partial Differential Equations (PDEs). However, these neural networks often entail considerable training…

Machine Learning · Computer Science 2025-05-08 Shuhao Cao , Francesco Brarda , Ruipeng Li , Yuanzhe Xi

We develop an all-at-once modeling framework for learning systems of ordinary differential equations (ODE) from scarce, partial, and noisy observations of the states. The proposed methodology amounts to a combination of sparse recovery…

The laws of physics have been written in the language of dif-ferential equations for centuries. Neural Ordinary Differen-tial Equations (NODEs) are a new machine learning architecture which allows these differential equations to be learned…

Machine Learning · Computer Science 2021-09-20 Max Zhu , Pietro Lio , Jacob Moss

Neural networks can be used to learn the solution of partial differential equations (PDEs) on arbitrary domains without requiring a computational mesh. Common approaches integrate differential operators in training neural networks using a…

Machine Learning · Computer Science 2022-07-07 Shamsulhaq Basir , Inanc Senocak

Stochastic regularization of neural networks (e.g. dropout) is a wide-spread technique in deep learning that allows for better generalization. Despite its success, continuous-time models, such as neural ordinary differential equation (ODE),…

Machine Learning · Computer Science 2020-06-29 Viktor Oganesyan , Alexandra Volokhova , Dmitry Vetrov

Neural differential equations offer a powerful approach for learning dynamics from data. However, they do not impose known constraints that should be obeyed by the learned model. It is well-known that enforcing constraints in surrogate…

Improved uniform error bounds on time-splitting methods are rigorously proven for the long-time dynamics of the weakly nonlinear Dirac equation (NLDE), where the nonlinearity strength is characterized by a dimensionless parameter…

Numerical Analysis · Mathematics 2022-03-16 Weizhu Bao , Yongyong Cai , Feng Yue

We propose robust methods to identify underlying Partial Differential Equation (PDE) from a given set of noisy time dependent data. We assume that the governing equation is a linear combination of a few linear and nonlinear differential…

Numerical Analysis · Mathematics 2023-03-03 Yuchen He , Sung Ha Kang , Wenjing Liao , Hao Liu , Yingjie Liu