English
Related papers

Related papers: Training Stiff Neural Ordinary Differential Equati…

200 papers

Deep neural networks (DNNs), especially physics-informed neural networks (PINNs), have recently become a new popular method for solving forward and inverse problems governed by partial differential equations (PDEs). However, these methods…

Machine Learning · Computer Science 2023-10-26 Wenbo Cao , Weiwei Zhang

Ordinary differential equations (ODEs) describe dynamical systems evolving deterministically in continuous time. Accurate data-driven modeling of systems as ODEs, a central problem across the natural sciences, remains challenging,…

Machine Learning · Computer Science 2025-10-15 Maximilian Mauel , Manuel Hinz , Patrick Seifner , David Berghaus , Ramses J. Sanchez

Conservation of energy is at the core of many physical phenomena and dynamical systems. There have been a significant number of works in the past few years aimed at predicting the trajectory of motion of dynamical systems using neural…

Machine Learning · Computer Science 2022-08-05 Yi Heng Lim , Muhammad Firmansyah Kasim

Stochastic differential equations (sdes) play an important role in physics but existing numerical methods for solving such equations are of low accuracy and poor stability. A general strategy for developing accurate and efficient schemes…

Quantum Physics · Physics 2009-11-10 Joshua Wilkie

Ordinary and stochastic differential equations (ODEs and SDEs) are widely used to model continuous-time processes across various scientific fields. While ODEs offer interpretability and simplicity, SDEs incorporate randomness, providing…

Methodology · Statistics 2025-05-20 Qingchuan Sun , Susanne Ditlevsen

In this study, we introduce a refined method for ascertaining error estimations in numerical simulations of dynamical systems via an innovative application of composition techniques. Our approach involves a dual application of a basic…

General Mathematics · Mathematics 2024-09-18 Ahmad Deeb , Denys Dutykh

Temporal difference (TD) learning is a foundational algorithm in reinforcement learning (RL). For nearly forty years, TD learning has served as a workhorse for applied RL as well as a building block for more complex and specialized…

Machine Learning · Computer Science 2025-06-24 Hwanwoo Kim , Panos Toulis , Eric Laber

Deriving analytical solutions of ordinary differential equations is usually restricted to a small subset of problems and numerical techniques are considered. Inevitably, a numerical simulation of a differential equation will then always be…

Numerical Analysis · Mathematics 2021-05-12 Said Ouala , Laurent Debreu , Ananda Pascual , Bertrand Chapron , Fabrice Collard , Lucile Gaultier , Ronan Fablet

The objective of this paper is to prove the convergence of a linear implicit multi-step numerical method for ordinary differential equations. The algorithm is obtained via Taylor approximations. The convergence is proved following the…

Chaotic Dynamics · Physics 2011-03-08 Marius-F. Danca

Poverty is a complex dynamic challenge that cannot be adequately captured using predefined differential equations. Nowadays, artificial machine learning (ML) methods have demonstrated significant potential in modelling real-world dynamical…

Dynamical Systems · Mathematics 2026-04-02 Sandeep Kumar Samota , Snehashish Chakraverty , Narayan Sethi

Ordinary differential equations (ODEs) are foundational in modeling intricate dynamics across a gamut of scientific disciplines. Yet, a possibility to represent a single phenomenon through multiple ODE models, driven by different…

Methodology · Statistics 2023-09-01 Itai Dattner , Shota Gugushvili , Oleksandr Laskorunskyi

Ordinary differential equations (ODEs) can provide mechanistic models of temporally local changes of processes, where parameters are often informed by external knowledge. While ODEs are popular in systems modeling, they are less established…

Methodology · Statistics 2025-07-10 Maren Hackenberg , Astrid Pechmann , Clemens Kreutz , Janbernd Kirschner , Harald Binder

Differential equations (DE) constrained optimization plays a critical role in numerous scientific and engineering fields, including energy systems, aerospace engineering, ecology, and finance, where optimal configurations or control…

Machine Learning · Computer Science 2024-10-03 Vincenzo Di Vito , Mostafa Mohammadian , Kyri Baker , Ferdinando Fioretto

When learning dynamical systems from data, embedding physical structure can constrain the solution space and improve generalization, but many physics-informed models assume access to the full system state. This limits their use in partially…

Machine Learning · Computer Science 2026-05-25 Sunniva Meltzer , Sølve Eidnes , Alexander Johannes Stasik

Learning dynamical systems is a promising avenue for scientific discoveries. However, capturing the governing dynamics in multiple environments still remains a challenge: model-based approaches rely on the fidelity of assumptions made for a…

Machine Learning · Computer Science 2023-03-09 MoonJeong Park , Youngbin Choi , Namhoon Lee , Dongwoo Kim

Physics informed neural networks (PINNs) are nowadays used as efficient machine learning methods for solving differential equations. However, vanilla-PINNs fail to learn complex problems as ones involving stiff ordinary differential…

Computational Physics · Physics 2023-04-18 Hubert Baty

Learning continuous-time dynamics on complex networks is crucial for understanding, predicting and controlling complex systems in science and engineering. However, this task is very challenging due to the combinatorial complexities in the…

Social and Information Networks · Computer Science 2020-06-19 Chengxi Zang , Fei Wang

Predicting scene dynamics from visual observations is challenging. Existing methods capture dynamics only within observed boundaries failing to extrapolate far beyond the training sequence. Node-RF (Neural ODE-based NeRF) overcomes this…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Hiran Sarkar , Liming Kuang , Yordanka Velikova , Benjamin Busam

Implicit layer deep learning techniques, like Neural Differential Equations, have become an important modeling framework due to their ability to adapt to new problems automatically. Training a neural differential equation is effectively a…

Machine Learning · Computer Science 2023-06-05 Avik Pal , Alan Edelman , Chris Rackauckas

In numerous robotics and mechanical engineering applications, among others, data is often constrained on smooth manifolds due to the presence of rotational degrees of freedom. Common datadriven and learning-based methods such as neural…

Optimization and Control · Mathematics 2023-05-16 Karthik Elamvazhuthi , Xuechen Zhang , Samet Oymak , Fabio Pasqualetti