English
Related papers

Related papers: Semi-Explicit Neural DAEs: Learning Long-Horizon D…

200 papers

Many scientific problems focus on observed patterns of change or on how to design a system to achieve particular dynamics. Those problems often require fitting differential equation models to target trajectories. Fitting such models can be…

Quantitative Methods · Quantitative Biology 2023-12-27 Steven A. Frank

Recent developments in mechanical, aerospace, and structural engineering have driven a growing need for efficient ways to model and analyse structures at much larger and more complex scales than before. While established numerical methods…

Machine Learning · Computer Science 2025-07-29 Rui Wu , Nikola Kovachki , Burigede Liu

This paper presents the Standalone Neural ODE (sNODE), a continuous-depth neural ODE model capable of describing a full deep neural network. This uses a novel nonlinear conjugate gradient (NCG) descent optimization scheme for training,…

Machine Learning · Computer Science 2022-06-09 Rym Jaroudi , Lukáš Malý , Gabriel Eilertsen , B. Tomas Johansson , Jonas Unger , George Baravdish

A key challenge in scientific machine learning is solving partial differential equations (PDEs) on complex domains, where the curved geometry complicates the approximation of functions and their derivatives required by differential…

Numerical Analysis · Mathematics 2025-09-26 Hanfei Zhou , Lei Shi

Partial Differential Equations (PDE) are fundamental to model different phenomena in science and engineering mathematically. Solving them is a crucial step towards a precise knowledge of the behaviour of natural and engineered systems. In…

While tumor dynamic modeling has been widely applied to support the development of oncology drugs, there remains a need to increase predictivity, enable personalized therapy, and improve decision-making. We propose the use of Tumor Dynamic…

Quantitative Methods · Quantitative Biology 2023-10-24 Mark Laurie , James Lu

Neural ordinary differential equations (NODEs) presented a new paradigm to construct (continuous-time) neural networks. While showing several good characteristics in terms of the number of parameters and the flexibility in constructing…

Machine Learning · Computer Science 2021-06-01 Sheo Yon Jhin , Minju Jo , Taeyong Kong , Jinsung Jeon , Noseong Park

Solving high-dimensional partial differential equations (PDEs) is a major challenge in scientific computing. We develop a new numerical method for solving elliptic-type PDEs by adapting the Q-learning algorithm in reinforcement learning.…

Numerical Analysis · Mathematics 2023-06-27 Samuel N. Cohen , Deqing Jiang , Justin Sirignano

In this work, we introduce and study a class of Deep Neural Networks (DNNs) in continuous-time. The proposed architecture stems from the combination of Neural Ordinary Differential Equations (Neural ODEs) with the model structure of…

Systems and Control · Electrical Eng. & Systems 2023-09-18 Daniele Martinelli , Clara Lucía Galimberti , Ian R. Manchester , Luca Furieri , Giancarlo Ferrari-Trecate

The working mechanisms of complex natural systems tend to abide by concise and profound partial differential equations (PDEs). Methods that directly mine equations from data are called PDE discovery, which reveals consistent physical laws…

Machine Learning · Computer Science 2023-03-17 Mengge Du , Yuntian Chen , Dongxiao Zhang

One of the most popular recent areas of machine learning predicates the use of neural networks augmented by information about the underlying process in the form of Partial Differential Equations (PDEs). These physics-informed neural…

Fluid Dynamics · Physics 2025-06-17 Luca Menicali , David H. Richter , Stefano Castruccio

Purpose: To develop a neural ordinary differential equation (ODE) model for visualizing deep neural network (DNN) behavior during multi-parametric MRI (mp-MRI) based glioma segmentation as a method to enhance deep learning explainability.…

Quantitative Methods · Quantitative Biology 2022-03-25 Zhenyu Yang , Zongsheng Hu , Hangjie Ji , Kyle Lafata , Scott Floyd , Fang-Fang Yin , Chunhao Wang

Forecasting high-dimensional dynamical systems is a fundamental challenge in various fields, such as geosciences and engineering. Neural Ordinary Differential Equations (NODEs), which combine the power of neural networks and numerical…

Machine Learning · Computer Science 2024-10-16 Dibyajyoti Chakraborty , Seung Whan Chung , Troy Arcomano , Romit Maulik

The core objective of machine-assisted scientific discovery is to learn physical laws from experimental data without prior knowledge of the systems in question. In the area of quantum physics, making progress towards these goals is…

Quantum Physics · Physics 2023-01-09 Matthew Choi , Daniel Flam-Shepherd , Thi Ha Kyaw , Alán Aspuru-Guzik

Deep Learning has emerged as one of the most significant innovations in machine learning. However, a notable limitation of this field lies in the ``black box" decision-making processes, which have led to skepticism within groups like…

Machine Learning · Computer Science 2025-03-06 Shi Li

We propose a novel approach for training Physics-enhanced Neural ODEs (PeN-ODEs) by expressing the training process as a dynamic optimization problem. The full model, including neural components, is discretized using a high-order implicit…

Machine Learning · Computer Science 2025-08-07 Linus Langenkamp , Philip Hannebohm , Bernhard Bachmann

Manifold learning is a hot research topic in the field of computer science and has many applications in the real world. A main drawback of manifold learning methods is, however, that there is no explicit mappings from the input data…

Computer Vision and Pattern Recognition · Computer Science 2010-01-18 Hong Qiao , Peng Zhang , Di Wang , Bo Zhang

We present polynomial-augmented neural networks (PANNs), a novel machine learning architecture that combines deep neural networks (DNNs) with a polynomial approximant. PANNs combine the strengths of DNNs (flexibility and efficiency in…

Machine Learning · Computer Science 2025-02-25 Madison Cooley , Shandian Zhe , Robert M. Kirby , Varun Shankar

Motion planning with constraints is an important part of many real-world robotic systems. In this work, we study manifold learning methods to learn such constraints from data. We explore two methods for learning implicit constraint…

We propose a novel approach for image segmentation that combines Neural Ordinary Differential Equations (NODEs) and the Level Set method. Our approach parametrizes the evolution of an initial contour with a NODE that implicitly learns from…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Rafael Valle , Fitsum Reda , Mohammad Shoeybi , Patrick Legresley , Andrew Tao , Bryan Catanzaro