English
Related papers

Related papers: Towards Robust and Stable Deep Learning Algorithms…

200 papers

In recent years, tremendous progress has been made on numerical algorithms for solving partial differential equations (PDEs) in a very high dimension, using ideas from either nonlinear (multilevel) Monte Carlo or deep learning. They are…

Numerical Analysis · Mathematics 2021-12-13 Weinan E , Jiequn Han , Arnulf Jentzen

Partial Differential Equations (PDE) are fundamental to model different phenomena in science and engineering mathematically. Solving them is a crucial step towards a precise knowledge of the behaviour of natural and engineered systems. In…

Fractional-order differential equations (FDEs) enhance traditional differential equations by extending the order of differential operators from integers to real numbers, offering greater flexibility in modeling complex dynamical systems…

Machine Learning · Computer Science 2025-03-24 Qiyu Kang , Xuhao Li , Kai Zhao , Wenjun Cui , Yanan Zhao , Weihua Deng , Wee Peng Tay

This paper develops a probabilistic numerical method for solution of partial differential equations (PDEs) and studies application of that method to PDE-constrained inverse problems. This approach enables the solution of challenging inverse…

Methodology · Statistics 2017-07-12 Jon Cockayne , Chris Oates , Tim Sullivan , Mark Girolami

Backward stochastic differential equation (BSDE)-based deep learning methods provide an alternative to Physics-Informed Neural Networks (PINNs) for solving high-dimensional partial differential equations (PDEs), offering potential…

Machine Learning · Computer Science 2026-01-15 Sungje Park , Stephen Tu

Many systems in physics, engineering, and biology exhibit multiscale stochastic dynamics, where low-dimensional slow variables evolve under the influence of high-dimensional fast processes. In practice, observations are often limited to a…

Machine Learning · Statistics 2026-05-12 Anan Saha , Arnab Ganguly

We present a deep recurrent neural network architecture to solve a class of stochastic optimal control problems described by fully nonlinear Hamilton Jacobi Bellmanpartial differential equations. Such PDEs arise when one considers…

Machine Learning · Computer Science 2019-12-24 Marcus A Pereira , Ziyi Wang , Tianrong Chen , Emily Reed , Evangelos A Theodorou

In the present work, a multi-scale framework for neural network enhanced methods is proposed for approximation of function and solution of partial differential equations (PDEs). By introducing the multi-scale concept, the total solution of…

Numerical Analysis · Mathematics 2022-09-07 Xiaodan Ren

It is one of the most challenging problems in applied mathematics to approximatively solve high-dimensional partial differential equations (PDEs). Recently, several deep learning-based approximation algorithms for attacking this problem…

Numerical Analysis · Mathematics 2023-02-10 Christian Beck , Martin Hutzenthaler , Arnulf Jentzen , Benno Kuckuck

The solution to partial differential equations using deep learning approaches has shown promising results for several classes of initial and boundary-value problems. However, their ability to surpass, particularly in terms of accuracy,…

Numerical Analysis · Mathematics 2023-08-23 Ziad Aldirany , Régis Cottereau , Marc Laforest , Serge Prudhomme

The recently proposed numerical algorithm, deep BSDE method, has shown remarkable performance in solving high-dimensional forward-backward stochastic differential equations (FBSDEs) and parabolic partial differential equations (PDEs). This…

Probability · Mathematics 2022-03-10 Jiequn Han , Jihao Long

In this paper, we introduce the Deep Finite Volume Method (DFVM), an innovative deep learning framework tailored for solving high-order (order \(\geq 2\)) partial differential equations (PDEs). Our approach centers on a novel loss function…

Numerical Analysis · Mathematics 2024-07-15 Jianhuan Cen , Qingsong Zou

Fractional Differential Equations (FDEs) are essential tools for modelling complex systems in science and engineering. They extend the traditional concepts of differentiation and integration to non-integer orders, enabling a more precise…

Machine Learning · Computer Science 2025-03-27 C. Coelho , M. Fernanda P. Costa , L. L. Ferrás

In this work, we propose a novel backward differential deep learning-based algorithm for solving high-dimensional nonlinear backward stochastic differential equations (BSDEs), where the deep neural network (DNN) models are trained not only…

Numerical Analysis · Mathematics 2024-04-15 Lorenc Kapllani , Long Teng

Forward-backward stochastic differential equations (FBSDEs) have been generalized by introducing jumps for better capturing random phenomena, while the resulting FBSDEs are far more intricate than the standard one from every perspective. In…

Numerical Analysis · Mathematics 2024-10-15 Reiichiro Kawai , Riu Naito , Toshihiro Yamada

We introduce a physics-driven deep latent variable model (PDDLVM) to learn simultaneously parameter-to-solution (forward) and solution-to-parameter (inverse) maps of parametric partial differential equations (PDEs). Our formulation…

Machine Learning · Statistics 2023-08-09 Arnaud Vadeboncoeur , Ömer Deniz Akyildiz , Ieva Kazlauskaite , Mark Girolami , Fehmi Cirak

Ordinary differential equations (ODEs) provide a powerful framework for modeling dynamic systems arising in a wide range of scientific domains. However, most existing ODE methods focus on a single system, and do not adequately address the…

Methodology · Statistics 2026-04-08 Shuoxun Xu , Zijian Guo , Brooke R. Staveland , Robert T. Knight , Lexin Li

In this work, we present a machine learning approach for reducing the error when numerically solving time-dependent partial differential equations (PDE). We use a fully convolutional LSTM network to exploit the spatiotemporal dynamics of…

Machine Learning · Computer Science 2020-02-11 Ben Stevens , Tim Colonius

This is one of our series papers on multistep schemes for solving forward backward stochastic differential equations (FBSDEs) and related problems. Here we extend (with non-trivial updates) our multistep schemes in [W. Zhao, Y. Fu and T.…

Numerical Analysis · Mathematics 2015-02-12 Kong Tao , Weidong Zhao , Tao Zhou

Neural Stochastic Differential Equations (Neural SDEs) have emerged as powerful mesh-free generative models for continuous stochastic processes, with critical applications in fields such as finance, physics, and biology. Previous…

Machine Learning · Computer Science 2025-03-28 Jianxin Zhang , Josh Viktorov , Doosan Jung , Emily Pitler