English
Related papers

Related papers: Inference for Differential Equation Models using R…

200 papers

The numerical solution of implicit and stiff differential equations by implicit numerical integrators has been largely investigated and there exist many excellent efficient codes available in the scientific community, as Radau5 (based on a…

Numerical Analysis · Mathematics 2025-06-27 Nicola Guglielmi , Ernst Hairer

Ordinary differential equations (ODEs) are widely used to model biological, (bio-)chemical and technical processes. The parameters of these ODEs are often estimated from experimental data using ODE-constrained optimisation. This article…

Optimization and Control · Mathematics 2015-11-06 Anna Fiedler , Fabian J. Theis , Jan Hasenauer

By interpreting the forward dynamics of the latent representation of neural networks as an ordinary differential equation, Neural Ordinary Differential Equation (Neural ODE) emerged as an effective framework for modeling a system dynamics…

Machine Learning · Computer Science 2020-10-19 Daehoon Gwak , Gyuhyeon Sim , Michael Poli , Stefano Massaroli , Jaegul Choo , Edward Choi

This study investigates the use of continuous-time dynamical systems for sparse signal recovery. The proposed dynamical system is in the form of a nonlinear ordinary differential equation (ODE) derived from the gradient flow of the Lasso…

Information Theory · Computer Science 2023-03-30 Tadashi Wadayama , Ayano Nakai-Kasai

We present a new microscopic ODE-based model for pedestrian dynamics: the Gradient Navigation Model. The model uses a superposition of gradients of distance functions to directly change the direction of the velocity vector. The velocity is…

Mathematical Physics · Physics 2014-06-11 Felix Dietrich , Gerta Köster

End-to-end learning of dynamical systems with black-box models, such as neural ordinary differential equations (ODEs), provides a flexible framework for learning dynamics from data without prescribing a mathematical model for the dynamics.…

Machine Learning · Statistics 2022-06-20 Paidamoyo Chapfuwa , Sherri Rose , Lawrence Carin , Edward Meeds , Ricardo Henao

Ordinary differential equation (ODE) models are widely used to describe chemical or biological processes. This article considers the estimation and assessment of such models on the basis of time-course data. Due to experimental limitations,…

Molecular Networks · Quantitative Biology 2023-02-14 Samuel W. K. Wong , Shihao Yang , S. C. Kou

We study gradient-based optimization methods obtained by directly discretizing a second-order ordinary differential equation (ODE) related to the continuous limit of Nesterov's accelerated gradient method. When the function is smooth…

Optimization and Control · Mathematics 2018-11-29 Jingzhao Zhang , Aryan Mokhtari , Suvrit Sra , Ali Jadbabaie

Embedding nonlinear dynamical systems into artificial neural networks is a powerful new formalism for machine learning. By parameterizing ordinary differential equations (ODEs) as neural network layers, these Neural ODEs are…

Machine Learning · Computer Science 2024-10-28 Mikko Lehtimäki , Lassi Paunonen , Marja-Leena Linne

Numerical simulation of ordinary differential equations (ODEs) can be challenging when the system exhibits high accelerations and rapidly changing dynamics. Under these conditions the ODE solver often needs to take very small time steps in…

Numerical Analysis · Mathematics 2026-05-11 Andrew Tagg , Andrew Frandsen , Andrew Ning

A conventional approach to train neural ordinary differential equations (ODEs) is to fix an ODE solver and then learn the neural network's weights to optimize a target loss function. However, such an approach is tailored for a specific…

Machine Learning · Computer Science 2021-03-16 Julia Gusak , Alexandr Katrutsa , Talgat Daulbaev , Andrzej Cichocki , Ivan Oseledets

In many fields of application, dynamic processes that evolve through time are well described by systems of ordinary differential equations (ODEs). The analytical solution of the ODEs is often not available and different methods have been…

Methodology · Statistics 2017-07-19 Saverio Ranciati , Cinzia Viroli , Ernst Wit

When applied to stiff, linear differential equations with time-dependent forcing, Runge-Kutta methods can exhibit convergence rates lower than predicted by the classical order condition theory. Commonly, this order reduction phenomenon is…

Numerical Analysis · Mathematics 2022-02-15 Steven Roberts , Adrian Sandu

The recently-introduced relaxation approach for Runge-Kutta methods can be used to enforce conservation of energy in the integration of Hamiltonian systems. We study the behavior of implicit and explicit relaxation Runge-Kutta methods in…

Numerical Analysis · Mathematics 2020-07-13 Hendrik Ranocha , David I. Ketcheson

Classical and new numerical schemes are generated using evolutionary computing. Differential Evolution is used to find the coefficients of finite difference approximations of function derivatives, and of single and multi-step integration…

Neural and Evolutionary Computing · Computer Science 2014-01-02 C. D. Erdbrink , V. V. Krzhizhanovskaya , P. M. A. Sloot

Most ordinary differential equation (ODE) models used to describe biological or physical systems must be solved approximately using numerical methods. Perniciously, even those solvers which seem sufficiently accurate for the forward…

Training Neural Ordinary Differential Equations (ODEs) is often computationally expensive. Indeed, computing the forward pass of such models involves solving an ODE which can become arbitrarily complex during training. Recent works have…

Machine Learning · Computer Science 2020-11-03 Arnab Ghosh , Harkirat Singh Behl , Emilien Dupont , Philip H. S. Torr , Vinay Namboodiri

Ordinary differential equations (ODEs) are central to scientific modelling, but inferring their vector fields from noisy trajectories remains challenging. Current approaches such as symbolic regression, Gaussian process (GP) regression, and…

Machine Learning · Computer Science 2026-02-10 Maximilian Mauel , Johannes R. Hübers , David Berghaus , Patrick Seifner , Ramses J. Sanchez

We study gradient-based optimization methods obtained by direct Runge-Kutta discretization of the ordinary differential equation (ODE) describing the movement of a heavy-ball under constant friction coefficient. When the function is high…

Optimization and Control · Mathematics 2019-05-30 Jingzhao Zhang , Suvrit Sra , Ali Jadbabaie

As power systems transition toward renewable-rich and inverter-dominated operations, accurate time-domain dynamic analysis becomes increasingly critical. Such analysis supports key operational tasks, including transient stability…

Artificial Intelligence · Computer Science 2026-04-17 Haoran Li , Lihao Mai , Chenhan Xiao , Erik Blasch , Yang Weng