English
Related papers

Related papers: Training Stiff Neural Ordinary Differential Equati…

200 papers

Models in cardiac electrophysiology are coupled systems of reaction diffusion PDE and of ODE. The ODE system displays a very stiff behavior. It is non linear and its upgrade at each time step is a preponderant load in the computational…

Numerical Analysis · Mathematics 2018-04-27 Yves Coudière , Charlie Douanla Lontsi , Charles Pierre

Numerically solving ordinary differential equations (ODEs) is a naturally serial process and as a result the vast majority of ODE solver software are serial. In this manuscript we developed a set of parallelized ODE solvers using…

Numerical Analysis · Mathematics 2022-09-13 Utkarsh , Chris Elrod , Yingbo Ma , Christopher Rackauckas

Fast and accurate solution of time-dependent partial differential equations (PDEs) is of key interest in many research fields including physics, engineering, and biology. Generally, implicit schemes are preferred over the explicit ones for…

Numerical Analysis · Mathematics 2019-11-28 Suprosanna Shit , Abinav Ravi Venkatakrishnan , Ivan Ezhov , Jana Lipkova , Marie Piraud , Bjoern Menze

Numerical simulation of ordinary differential equations (ODEs) can be challenging when the system exhibits high accelerations and rapidly changing dynamics. Under these conditions the ODE solver often needs to take very small time steps in…

Numerical Analysis · Mathematics 2026-05-11 Andrew Tagg , Andrew Frandsen , Andrew Ning

The simulation of multi-body systems with frictional contacts is a fundamental tool for many fields, such as robotics, computer graphics, and mechanics. Hard frictional contacts are particularly troublesome to simulate because they make the…

Robotics · Computer Science 2022-04-19 Bilal Hammoud , Luca Olivieri , Ludovic Righetti , Justin Carpentier , Andrea Del Prete

Recently, Neural Ordinary Differential Equations has emerged as a powerful framework for modeling physical simulations without explicitly defining the ODEs governing the system, but instead learning them via machine learning. However, the…

Taylor series methods show a newfound promise for the solution of non-stiff ordinary differential equations (ODEs) given the rise of new compiler-enhanced techniques for calculating high order derivatives. In this paper we detail a new…

Numerical Analysis · Mathematics 2026-02-20 Songchen Tan , Oscar Smith , Christopher Rackauckas

Advances in differentiable numerical integrators have enabled the use of gradient descent techniques to learn ordinary differential equations (ODEs). In the context of machine learning, differentiable solvers are central for Neural ODEs…

Machine Learning · Computer Science 2021-07-06 Weiming Zhi , Tin Lai , Lionel Ott , Edwin V. Bonilla , Fabio Ramos

Two semi-implicit Euler schemes for differential inclusions are proposed and analyzed in depth. An error analysis shows that both semi-implicit schemes inherit favorable stability properties from the differential inclusion. Their…

Numerical Analysis · Mathematics 2013-08-19 Janosch Rieger

This paper aims to investigate the numerical approximation of a general second order parabolic stochastic partial differential equation(SPDE) driven by multiplicative and additive noise under more relaxed conditions. The SPDE is discretized…

Numerical Analysis · Mathematics 2020-01-01 Antoine Tambue , Jean Daniel Mukam

Measurement noise is an integral part while collecting data of a physical process. Thus, noise removal is necessary to draw conclusions from these data, and it often becomes essential to construct dynamical models using these data. We…

Machine Learning · Computer Science 2022-05-20 Pawan Goyal , Peter Benner

Recent years have seen a growing interest in understanding acceleration methods through the lens of ordinary differential equations (ODEs). Despite the theoretical advancements, translating the rapid convergence observed in continuous-time…

Optimization and Control · Mathematics 2024-06-05 Zhonglin Xie , Wotao Yin , Zaiwen Wen

Neural ordinary differential equations (NODEs) -- parametrizations of differential equations using neural networks -- have shown tremendous promise in learning models of unknown continuous-time dynamical systems from data. However, every…

Machine Learning · Computer Science 2023-01-02 Franck Djeumou , Cyrus Neary , Eric Goubault , Sylvie Putot , Ufuk Topcu

Modern deep learning algorithms use variations of gradient descent as their main learning methods. Gradient descent can be understood as the simplest Ordinary Differential Equation (ODE) solver; namely, the Euler method applied to the…

Machine Learning · Computer Science 2025-05-20 Benoit Dherin , Michael Munn , Hanna Mazzawi , Michael Wunder , Sourabh Medapati , Javier Gonzalvo

Efficient long-time integration of nonlinear fractional differential equations is significantly challenging due to the integro-differential nature of the fractional operators. In addition, the inherent non-smoothness introduced by the…

Numerical Analysis · Mathematics 2019-09-11 Yongtao Zhou , Jorge L. Suzuki , Chengjian Zhang , Mohsen Zayernouri

We introduce a provably stable variant of neural ordinary differential equations (neural ODEs) whose trajectories evolve on an energy functional parametrised by a neural network. Stable neural flows provide an implicit guarantee on…

Machine Learning · Computer Science 2020-03-19 Stefano Massaroli , Michael Poli , Michelangelo Bin , Jinkyoo Park , Atsushi Yamashita , Hajime Asama

Differential equations are frequently used in engineering domains, such as modeling and control of industrial systems, where safety and performance guarantees are of paramount importance. Traditional physics-based modeling approaches…

Systems and Control · Electrical Eng. & Systems 2020-11-30 Aaron Tuor , Jan Drgona , Draguna Vrabie

Neural surrogates for stiff differential-algebraic equations (DAEs) face two barriers: soft-constraint methods leave algebraic residuals that stiffness amplifies into errors, and hard-constraint methods require trajectory data from stiff…

Machine Learning · Computer Science 2026-04-28 Huy Hoang Le , Haoguang Wang , Christian Moya , Marcos Netto , Guang Lin

Neural-ODE parameterize a differential equation using continuous depth neural network and solve it using numerical ODE-integrator. These models offer a constant memory cost compared to models with discrete sequence of hidden layers in which…

Machine Learning · Computer Science 2025-03-27 Sheikh Waqas Akhtar

The identification of a mathematical dynamics model is a crucial step in the designing process of a controller. However, it is often very difficult to identify the system's governing equations, especially in complex environments that…

Systems and Control · Electrical Eng. & Systems 2024-07-01 Tobias Nagel , Marco F. Huber