English
Related papers

Related papers: Training Stiff Neural Ordinary Differential Equati…

200 papers

The spatially discretized magnetic vector potential formulation of magnetoquasistatic field problems is transformed from an infinitely stiff differential algebraic equation system into a finitely stiff ordinary differential equation (ODE)…

Computational Engineering, Finance, and Science · Computer Science 2017-09-26 Jennifer Dutiné , Markus Clemens , Sebastian Schöps

Stabilized explicit methods are particularly efficient for large systems of stiff stochastic differential equations (SDEs) due to their extended stability domain. However, they loose their efficiency when a severe stiffness is induced by…

Numerical Analysis · Mathematics 2021-08-13 Assyr Abdulle , Giacomo Rosilho de Souza

Neural operators have emerged as promising surrogate models for solving partial differential equations (PDEs), but struggle to generalise beyond training distributions and are often constrained to a fixed temporal discretisation. This work…

We propose a novel approach for training Physics-enhanced Neural ODEs (PeN-ODEs) by expressing the training process as a dynamic optimization problem. The full model, including neural components, is discretized using a high-order implicit…

Machine Learning · Computer Science 2025-08-07 Linus Langenkamp , Philip Hannebohm , Bernhard Bachmann

The data-driven discovery of interpretable models approximating the underlying dynamics of a physical system has gained attraction in the past decade. Current approaches employ pre-specified functional forms or basis functions and often…

Machine Learning · Computer Science 2025-07-30 Rahul Golder , M. M. Faruque Hasan

Euler--Euler or volume-averaged Navier--Stokes equations are used in various applications to model systems with two or more interpenetrating phases. Each fluid obeys its own momentum and mass equations, and the phases are typically coupled…

Numerical Analysis · Mathematics 2025-08-04 Douglas Pacheco , Richard Schussnig

A quantitative definition of numerical stiffness for initial value problems is proposed. Exponential integrators can effectively integrate linearly stiff systems, but they become expensive when the linear coefficient is a matrix, especially…

Numerical Analysis · Mathematics 2023-05-23 Thoma Zoto , John C. Bowman

A method for enhancing the stability and robustness of explicit schemes in computational fluid dynamics is presented. The method is based in reformulating explicit schemes in matrix form, which cane modified gradually into semi or…

Mathematical Physics · Physics 2009-11-10 A. A. Hujeirat

Fractional Differential Equations (FDEs) are essential tools for modelling complex systems in science and engineering. They extend the traditional concepts of differentiation and integration to non-integer orders, enabling a more precise…

Machine Learning · Computer Science 2025-03-27 C. Coelho , M. Fernanda P. Costa , L. L. Ferrás

Many successful methods to learn dynamical systems from data have recently been introduced. However, ensuring that the inferred dynamics preserve known constraints, such as conservation laws or restrictions on the allowed system states,…

Machine Learning · Computer Science 2024-02-16 Alistair White , Niki Kilbertus , Maximilian Gelbrecht , Niklas Boers

The use of implicit time-stepping schemes for the numerical approximation of solutions to stiff nonlinear time-evolution equations brings well-known advantages including, typically, better stability behaviour and corresponding support of…

Numerical Analysis · Mathematics 2025-02-14 Tianyu Jin , Georg Maierhofer , Katharina Schratz , Yang Xiang

We introduce a class of explicit exponential Rosenbrock methods for the time integration of large systems of stiff differential equations. Their application with respect to simulation tasks in the field of visual computing is discussed…

Numerical Analysis · Mathematics 2018-05-23 Vu Thai Luan , Dominik L. Michels

The existing Neural ODE formulation relies on an explicit knowledge of the termination time. We extend Neural ODEs to implicitly defined termination criteria modeled by neural event functions, which can be chained together and…

Machine Learning · Computer Science 2021-10-28 Ricky T. Q. Chen , Brandon Amos , Maximilian Nickel

This work presents the design of nonlinear stabilization techniques for the finite element discretization of Euler equations in both steady and transient form. Implicit time integration is used in the case of the transient form. A…

Numerical Analysis · Mathematics 2020-08-26 Santiago Badia , Jesús Bonilla , Sibusiso Mabuza , John N. Shadid

We prove a general criterion providing sufficient conditions under which a time-discretiziation of a given Stochastic Differential Equation (SDE) is a uniform in time approximation of the SDE. The criterion is also, to a certain extent,…

Numerical Analysis · Mathematics 2025-01-22 Letizia Angeli , Dan Crisan , Michela Ottobre

We propose a simple interpolation-based method for the efficient approximation of gradients in neural ODE models. We compare it with the reverse dynamic method (known in the literature as "adjoint method") to train neural ODEs on…

Neural and Evolutionary Computing · Computer Science 2020-11-03 Talgat Daulbaev , Alexandr Katrutsa , Larisa Markeeva , Julia Gusak , Andrzej Cichocki , Ivan Oseledets

In this paper, we present error estimates of the integral deferred correction method constructed with stiffly accurate implicit Runge-Kutta methods with a nonsingular matrix $A$ in its Butcher table representation, when applied to stiff…

Numerical Analysis · Mathematics 2015-10-15 Sebastiano Boscarino , Jing-Mei Qiu

We derive nonlinear stability results for numerical integrators on Riemannian manifolds, by imposing conditions on the ODE vector field and the step size that makes the numerical solution non-expansive whenever the exact solution is…

Numerical Analysis · Mathematics 2026-02-10 Marta Ghirardelli , Brynjulf Owren , Elena Celledoni

The main difficulty in studying numerical method for stochastic evolution equations (SEEs) lies in the treatment of the time discretization (J. Printems. [ESAIM Math. Model. Numer. Anal. (2001)]). Although fruitful results on numerical…

Numerical Analysis · Mathematics 2023-04-03 Jialin Hong , Derui Sheng , Tau Zhou

In this paper we present a formally fourth-order accurate hybrid-variable method for the Euler equations in the context of method of lines. The hybrid-variable (HV) method seeks numerical approximations to both cell-averages and nodal…

Numerical Analysis · Mathematics 2023-08-22 Xianyi Zeng