English
Related papers

Related papers: Training Stiff Neural Ordinary Differential Equati…

200 papers

Review of implicit methods of integrating system of stiff ordinary differential equations is presented. Defines and graphically presents absolute stability region for Gears methods (backward differentiation formula) used to solve system of…

Classical Analysis and ODEs · Mathematics 2015-03-17 Mihail Semenov

In a recent paper by Kamrani et al. (2024), exponential Euler method for stiff stochastic differential equations with additive fractional Brownian noise was discussed, and the convergence order close to the Hurst parameter H was proved.…

Probability · Mathematics 2024-07-08 Haozhe Chen , Zhaotong Shen , Qian Yu

Since the advent of the ``Neural Ordinary Differential Equation (Neural ODE)'' paper, learning ODEs with deep learning has been applied to system identification, time-series forecasting, and related areas. Exploiting the diffeomorphic…

Machine Learning · Statistics 2025-08-27 Yuji Okamoto , Tomoya Takeuchi , Yusuke Sakemi

Stochastic interpolants offer a robust framework for continuously transforming samples between arbitrary data distributions, holding significant promise for generative modeling. Despite their potential, rigorous finite-time convergence…

Machine Learning · Computer Science 2025-08-12 Yuhao Liu , Rui Hu , Yu Chen , Longbo Huang

Motivated by the Hodgkin-Huxley model of neuronal dynamics, we study explicit numerical integrators for "conditionally linear" systems of ordinary differential equations. We show that splitting and composition methods, when applied to the…

Numerical Analysis · Mathematics 2020-03-19 Zhengdao Chen , Baranidharan Raman , Ari Stern

Neural Ordinary Differential Equations (Neural ODEs) represent continuous-time dynamics with neural networks, offering advancements for modeling and control tasks. However, training Neural ODEs requires solving differential equations at…

Machine Learning · Computer Science 2025-02-24 Mariia Shapovalova , Calvin Tsay

Neural differential equations offer a powerful framework for modeling continuous-time dynamics, but forecasting stiff biophysical systems remains unreliable. Standard Neural ODEs and physics informed variants often require orders of…

Machine Learning · Computer Science 2025-11-18 Kamalpreet Singh Kainth , Prathamesh Dinesh Joshi , Raj Abhijit Dandekar , Rajat Dandekar , Sreedat Panat

Explicit step-truncation tensor methods have recently proven successful in integrating initial value problems for high-dimensional partial differential equations (PDEs). However, the combination of non-linearity and stiffness may introduce…

Numerical Analysis · Mathematics 2023-03-21 Abram Rodgers , Daniele Venturi

This paper aims to investigate the numerical approximation of semilinear non-autonomous stochastic partial differential equations (SPDEs) driven by multiplicative or additive noise. Such equations are more realistic than autonomous SPDEs…

Numerical Analysis · Mathematics 2020-11-18 Jean Daniel Mukam , Antoine Tambue

Radau IIA methods, specifically the adaptive order Radau method in Fortran due to Hairer, are known to be state-of-the-art for the high-accuracy solution of highly stiff ordinary differential equations (ODEs). However, the traditional…

Numerical Analysis · Mathematics 2025-05-15 Shreyas Ekanathan , Oscar Smith , Christopher Rackauckas

Explicit stabilized methods are an efficient alternative to implicit schemes for the time integration of stiff systems of differential equations in large dimension. In this paper, we derive explicit stabilized integrators of orders one and…

Numerical Analysis · Mathematics 2023-06-09 Ibrahim Almuslimani , Gilles Vilmart

In many applications, the governing PDE to be solved numerically contains a stiff component. When this component is linear, an implicit time stepping method that is unencumbered by stability restrictions is often preferred. On the other…

Numerical Analysis · Mathematics 2021-04-27 Kevin Chow , Steven J. Ruuth

Probabilistic solvers for ordinary differential equations (ODEs) provide efficient quantification of numerical uncertainty associated with simulation of dynamical systems. Their convergence rates have been established by a growing body of…

Machine Learning · Statistics 2020-12-21 Nicholas Krämer , Philipp Hennig

Ordinary differential equations (ODEs) provide a powerful framework for modeling dynamic systems arising in a wide range of scientific domains. However, most existing ODE methods focus on a single system, and do not adequately address the…

Methodology · Statistics 2026-04-08 Shuoxun Xu , Zijian Guo , Brooke R. Staveland , Robert T. Knight , Lexin Li

The numerical solution of implicit and stiff differential equations by implicit numerical integrators has been largely investigated and there exist many excellent efficient codes available in the scientific community, as Radau5 (based on a…

Numerical Analysis · Mathematics 2025-06-27 Nicola Guglielmi , Ernst Hairer

A class of neural networks that gained particular interest in the last years are neural ordinary differential equations (neural ODEs). We study input-output relations of neural ODEs using dynamical systems theory and prove several results…

Dynamical Systems · Mathematics 2023-09-29 Christian Kuehn , Sara-Viola Kuntz

We propose a numerical method based on physics-informed Random Projection Neural Networks for the solution of Initial Value Problems (IVPs) of Ordinary Differential Equations (ODEs) with a focus on stiff problems. We address an Extreme…

This paper addresses the training of Neural Ordinary Differential Equations (neural ODEs), and in particular explores the interplay between numerical integration techniques, stability regions, step size, and initialization techniques. It is…

Machine Learning · Computer Science 2024-08-07 Theodor Westny , Arman Mohammadi , Daniel Jung , Erik Frisk

An efficient approximate version of implicit Taylor methods for initial-value problems of systems of ordinary differential equations (ODEs) is introduced. The approach, based on an approximate formulation of Taylor methods, produces a…

Numerical Analysis · Mathematics 2024-02-05 Antonio Baeza , Raimund Bürger , María del Carmen Martí , Pep Mulet , David Zorío

In this paper, numerical methods using Physics-Informed Neural Networks (PINNs) are presented with the aim to solve higher-order ordinary differential equations (ODEs). Indeed, this deep-learning technique is successfully applied for…

Computational Physics · Physics 2023-07-17 Hubert Baty