English
Related papers

Related papers: A parallel-in-time Newton's method-based ODE solve…

200 papers

Probabilistic solvers for ordinary differential equations (ODEs) provide efficient quantification of numerical uncertainty associated with simulation of dynamical systems. Their convergence rates have been established by a growing body of…

Machine Learning · Statistics 2020-12-21 Nicholas Krämer , Philipp Hennig

This paper considers one of the fundamental parallel-in-time methods for the solution of ordinary differential equations, Parareal, and extends it by adopting a neural network as a coarse propagator. We provide a theoretical analysis of the…

Numerical Analysis · Mathematics 2024-08-20 Marta M. Betcke , Lisa Maria Kreusser , Davide Murari

We present an algorithm for the solution of a simultaneous space-time discretization of linear parabolic evolution equations with a symmetric differential operator in space. Building on earlier work, we recast this discretization into a…

Numerical Analysis · Mathematics 2021-09-07 Raymond van Venetië , Jan Westerdiep

We establish an equivalence between the $\ell_2$-regularized solution path for a convex loss function, and the solution of an ordinary differentiable equation (ODE). Importantly, this equivalence reveals that the solution path can be viewed…

Machine Learning · Statistics 2021-07-08 Yunzhang Zhu , Renxiong Liu

A probabilistic representation for initial value semilinear parabolic problems based on generalized random trees has been derived. Two different strategies have been proposed, both requiring generating suitable random trees combined with a…

Numerical Analysis · Mathematics 2024-02-13 Juan A. Acebron , Angel Rodriguez-Rozas

There exists a huge number of numerical methods that iteratively construct approximations to the solution $y(x)$ of an ordinary differential equation (ODE) $y'(x)=f(x,y)$ starting from an initial value $y_0=y(x_0)$ and using a finite…

Numerical Analysis · Mathematics 2013-07-15 Yaroslav D. Sergeyev

Nonlinear systems of partial differential equations (PDEs) may permit several distinct solutions. The typical current approach to finding distinct solutions is to start Newton's method with many different initial guesses, hoping to find…

Numerical Analysis · Mathematics 2015-07-03 Patrick E. Farrell , Ásgeir Birkisson , Simon W. Funke

Quantum computers have the potential to efficiently solve a system of nonlinear ordinary differential equations (ODEs), which play a crucial role in various industries and scientific fields. However, it remains unclear which system of…

Quantum Physics · Physics 2025-04-07 Yu Tanaka , Keisuke Fujii

Neural ordinary differential equations (NODEs) -- parametrizations of differential equations using neural networks -- have shown tremendous promise in learning models of unknown continuous-time dynamical systems from data. However, every…

Machine Learning · Computer Science 2023-01-02 Franck Djeumou , Cyrus Neary , Eric Goubault , Sylvie Putot , Ufuk Topcu

High-dimensional partial-differential equations (PDEs) arise in a number of fields of science and engineering, where they are used to describe the evolution of joint probability functions. Their examples include the Boltzmann and…

Numerical Analysis · Mathematics 2018-10-17 A. M. P. Boelens , D. Venturi , D. M. Tartakovsky

We propose a Newton-based scheme, initialized by neural operator predictions, to accelerate the parametric solution of nonlinear problems in computational solid mechanics. First, a physics informed conditional neural field is trained to…

Machine Learning · Computer Science 2025-11-11 Kianoosh Taghikhani , Yusuke Yamazaki , Jerry Paul Varghese , Markus Apel , Reza Najian Asl , Shahed Rezaei

One of the most important problems in the field of distributed optimization is the problem of minimizing a sum of local convex objective functions over a networked system. Most of the existing work in this area focus on developing…

Optimization and Control · Mathematics 2019-01-08 Fatemeh Mansoori , Ermin Wei

Time delays are ubiquitous in industry, and they must be accounted for when designing control strategies. However, numerical optimal control (NOC) of delay differential equations (DDEs) is challenging because it requires specialized…

Optimization and Control · Mathematics 2024-10-22 Tobias K. S. Ritschel , Søren Stange

In partial differential equations-based (PDE-based) inverse problems with many measurements, many large-scale discretized PDEs must be solved for each evaluation of the misfit or objective function. In the nonlinear case, evaluating the…

Numerical Analysis · Mathematics 2018-07-18 Selin Aslan , Eric de Sturler , Misha E. Kilmer

The Parareal algorithm allows to solve evolution problems exploiting parallelization in time. Its convergence and stability have been proved under the assumption of regular (smooth) inputs. We present and analyze here a new Parareal…

Numerical Analysis · Mathematics 2019-04-09 Martin J. Gander , Iryna Kulchytska-Ruchka , Innocent Niyonzima , Sebastian Schöps

The numerical solution of differential equations using machine learning-based approaches has gained significant popularity. Neural network-based discretization has emerged as a powerful tool for solving differential equations by…

Numerical Analysis · Mathematics 2024-01-23 Wenrui Hao , Qingguo Hong , Xianlin Jin

To solve optimization problems with parabolic PDE constraints, often methods working on the reduced objective functional are used. They are computationally expensive due to the necessity of solving both the state equation and a…

Optimization and Control · Mathematics 2019-12-17 Sebastian Götschel , Michael L. Minion

In this paper we consider a class of boundary value problems for third order nonlinear functional differential equation. By the reduction of the problem to operator equation we establish the existence and uniqueness of solution and…

Numerical Analysis · Mathematics 2021-01-26 Dang Quang A , Dang Quang Long

Higher-order nonlinear time-evolution equations have widespread applications in science and engineering, such as in solid mechanics, materials science, and fluid mechanics. This paper mainly studies a direct time-parallel algorithm for…

Numerical Analysis · Mathematics 2025-10-14 Shun-Zhi Zhong , Yong-Liang Zhao , Qian-Yu Shu

Training Neural Ordinary Differential Equations (ODEs) is often computationally expensive. Indeed, computing the forward pass of such models involves solving an ODE which can become arbitrarily complex during training. Recent works have…

Machine Learning · Computer Science 2020-11-03 Arnab Ghosh , Harkirat Singh Behl , Emilien Dupont , Philip H. S. Torr , Vinay Namboodiri