English
Related papers

Related papers: A parallel-in-time Newton's method-based ODE solve…

200 papers

A novel efficient and high accuracy numerical method for the time-fractional differential equations (TFDEs) is proposed in this work. We show the equivalence between TFDEs and the integer-order extended parametric differential equations…

Numerical Analysis · Mathematics 2025-05-13 Peng Ding , Zhiping Mao

Neural ordinary differential equations (Neural ODEs) propose the idea that a sequence of layers in a neural network is just a discretisation of an ODE, and thus can instead be directly modelled by a parameterised ODE. This idea has had…

Machine Learning · Computer Science 2024-05-07 Christina Runkel , Ander Biguri , Carola-Bibiane Schönlieb

Neural differential equations are a promising new member in the neural network family. They show the potential of differential equations for time series data analysis. In this paper, the strength of the ordinary differential equation (ODE)…

Machine Learning · Computer Science 2020-05-21 Mansura Habiba , Barak A. Pearlmutter

We investigate the use of piecewise linear systems, whose coefficient matrix is a piecewise constant function of the solution itself. Such systems arise, for example, from the numerical solution of linear complementarity problems and in the…

Numerical Analysis · Mathematics 2012-06-21 Luigi Brugnano , Alessandra Sestini

We develop a computationally efficient algorithm for the automatic regularization of nonlinear inverse problems based on the discrepancy principle. We formulate the problem as an equality constrained optimization problem, where the…

Numerical Analysis · Mathematics 2021-09-03 Jeffrey Cornelis , Wim Vanroose

In this paper, we propose a parallel-in-time algorithm for approximately solving parabolic equations. In particular, we apply the $k$-step backward differentiation formula, and then develop an iterative solver by using the waveform…

Numerical Analysis · Mathematics 2021-06-04 Shuonan Wu , Zhi Zhou

The time domain analysis of eddy current problems often requires the simulation of long time intervals, e.g. until a steady state is reached. Fast-switching excitations e.g. in pulsedwidth modulated signals require in addition very small…

Numerical Analysis · Mathematics 2021-01-05 Idoia Cortes Garcia , Iryna Kulchytska-Ruchka , Markus Clemens , Sebastian Schöps

The aim of this paper is to introduce a new Newton-type iterative method and then to show that this process converges to the unique solution of the scalar nonlinear equation f(x)=0 under weaker conditions involving only f and f' by fixed…

General Mathematics · Mathematics 2017-06-27 Nazli Karaca , Isa Yildirim

In this paper we review the parallel solution of sparse linear systems, usually deriving by the discretization of ODE-IVPs or ODE-BVPs. The approach is based on the concept of parallel factorization of a (block) tridiagonal matrix. This…

Numerical Analysis · Mathematics 2010-01-13 Pierluigi Amodio , Luigi Brugnano

Neural differential equations may be trained by backpropagating gradients via the adjoint method, which is another differential equation typically solved using an adaptive-step-size numerical differential equation solver. A proposed step is…

Machine Learning · Computer Science 2021-05-11 Patrick Kidger , Ricky T. Q. Chen , Terry Lyons

We present a spectrally accurate numerical method for finding non-trivial time-periodic solutions of non-linear partial differential equations. The method is based on minimizing a functional (of the initial condition and the period) that is…

Exactly Solvable and Integrable Systems · Physics 2010-06-11 David M. Ambrose , Jon Wilkening

Neural ordinary differential equations (NODE) have been proposed as a continuous depth generalization to popular deep learning models such as Residual networks (ResNets). They provide parameter efficiency and automate the model selection…

Machine Learning · Computer Science 2021-12-24 Srinivas Anumasa , P. K. Srijith

Traditional solvers for delay differential equations (DDEs) are designed around only a single method and do not effectively use the infrastructure of their more-developed ordinary differential equation (ODE) counterparts. In this work we…

Numerical Analysis · Mathematics 2022-08-30 David Widmann , Chris Rackauckas

Welcome to a beautiful subject in scientific computing: numerical solution of ordinary differential equations (ODEs) with initial conditions.

History and Overview · Mathematics 2024-12-31 Davoud Mirzaei

The time-dependent one-dimensional nonlinear Schr\"odinger equation (NLSE) is solved numerically by a hybrid pseudospectral-variational quantum algorithm that connects a pseudospectral step for the Hamiltonian term with a variational step…

We introduce a simple, rigorous, and unified framework for solving nonlinear partial differential equations (PDEs), and for solving inverse problems (IPs) involving the identification of parameters in PDEs, using the framework of Gaussian…

Numerical Analysis · Mathematics 2021-08-12 Yifan Chen , Bamdad Hosseini , Houman Owhadi , Andrew M Stuart

In this study, we propose high-order implicit and semi-implicit schemes for solving ordinary differential equations (ODEs) based on Taylor series expansion. These methods are designed to handle stiff and non-stiff components within a…

Numerical Analysis · Mathematics 2024-09-19 S. Boscarino , E. Macca

Lasso problems arise in many areas, including signal processing, machine learning, and control, and are closely connected to sparse coding mechanisms observed in neuroscience. A continuous-time ordinary differential equation (ODE)…

Optimization and Control · Mathematics 2026-04-03 Liang Wu , Yunhong Che , Wallace Gian Yion Tan , Efstathios Iliakis , Richard D. Braatz , Ján Drgoňa

An implementation and an application of the combination of the genetic algorithm and Newton's method for solving a system of nonlinear equations is presented. The method first uses the advantage of the robustness of the genetic algorithm…

Numerical Analysis · Mathematics 2020-07-13 Ryuji Koshikawa , Akira Terui , Masahiko Mikawa

We propose a numerical method based on physics-informed Random Projection Neural Networks for the solution of Initial Value Problems (IVPs) of Ordinary Differential Equations (ODEs) with a focus on stiff problems. We address an Extreme…