English
Related papers

Related papers: Random Neural Network Expressivity for Non-Linear …

200 papers

In this paper, we propose forward and backward stochastic differential equations (FBSDEs) based deep neural network (DNN) learning algorithms for the solution of high dimensional quasilinear parabolic partial differential equations (PDEs),…

Numerical Analysis · Mathematics 2021-05-10 Wenzhong Zhang , Wei Cai

Physics Informed Neural Networks (PINNs) have frequently been used for the numerical approximation of Partial Differential Equations (PDEs). The goal of this paper is to construct PINNs along with a computable upper bound of the error,…

Numerical Analysis · Mathematics 2022-12-19 Lewin Ernst , Karsten Urban

In this article, we investigate the existence of a deep neural network (DNN) capable of approximating solutions to partial integro-differential equations while circumventing the curse of dimensionality. Using the Feynman-Kac theorem, we…

Numerical Analysis · Mathematics 2025-01-22 Marcin Baranek

Recent years have witnessed a growth in mathematics for deep learning--which seeks a deeper understanding of the concepts of deep learning with mathematics and explores how to make it more robust--and deep learning for mathematics, where…

Machine Learning · Computer Science 2023-10-31 Derick Nganyu Tanyu , Jianfeng Ning , Tom Freudenberg , Nick Heilenkötter , Andreas Rademacher , Uwe Iben , Peter Maass

Partial Differential Equations (PDE) are fundamental to model different phenomena in science and engineering mathematically. Solving them is a crucial step towards a precise knowledge of the behaviour of natural and engineered systems. In…

It is a challenging topic in applied mathematics to solve high-dimensional nonlinear partial differential equations (PDEs). Standard approximation methods for nonlinear PDEs suffer under the curse of dimensionality (COD) in the sense that…

Machine Learning · Computer Science 2024-06-18 Julia Ackermann , Arnulf Jentzen , Benno Kuckuck , Joshua Lee Padgett

Solving partial differential equations (PDEs) is the canonical approach for understanding the behavior of physical systems. However, large scale solutions of PDEs using state of the art discretization techniques remains an expensive…

Computational Engineering, Finance, and Science · Computer Science 2021-01-14 Xiaoxuan Zhang , Krishna Garikipati

We demonstrate that deep neural networks with the ReLU activation function can efficiently approximate the solutions of various types of parametric linear transport equations. For non-smooth initial conditions, the solutions of these PDEs…

Numerical Analysis · Mathematics 2020-01-31 Fabian Laakmann , Philipp Petersen

Partial differential equations (PDEs) play a crucial role in studying a vast number of problems in science and engineering. Numerically solving nonlinear and/or high-dimensional PDEs is often a challenging task. Inspired by the traditional…

Numerical Analysis · Mathematics 2022-01-11 Yihao Hu , Tong Zhao , Shixin Xu , Zhiliang Xu , Lizhen Lin

In recent years, there has been a growing interest in leveraging deep learning and neural networks to address scientific problems, particularly in solving partial differential equations (PDEs). However, many neural network-based methods…

Machine Learning · Computer Science 2024-04-24 Adrian Celaya , Keegan Kirk , David Fuentes , Beatrice Riviere

Learning time-dependent partial differential equations (PDEs) that govern evolutionary observations is one of the core challenges for data-driven inference in many fields. In this work, we propose to capture the essential dynamics of…

Numerical Analysis · Mathematics 2021-09-07 Ricardo A. Delgadillo , Jingwei Hu , Haizhao Yang

In this paper, we consider approximating the parameter-to-solution maps of parametric partial differential equations (PPDEs) using deep neural networks (DNNs). We propose an efficient approach combining reduced collocation methods (RCMs)…

Numerical Analysis · Mathematics 2025-08-18 Guanhang Lei , Zhen Lei , Lei Shi , Chenyu Zeng

Recently, several deep learning (DL) methods for approximating high-dimensional partial differential equations (PDEs) have been proposed. The interest that these methods have generated in the literature is in large part due to simulations…

Numerical Analysis · Mathematics 2026-04-30 Julia Ackermann , Arnulf Jentzen , Thomas Kruse , Benno Kuckuck , Joshua Lee Padgett

In recent years, deep neural networks have been applied to obtain high performance of prediction, classification, and pattern recognition. However, the weights in these deep neural networks are difficult to be explained. Although a linear…

Machine Learning · Computer Science 2020-05-08 Chi-Hua Chen

We present the partial evolutionary tensor neural networks (pETNNs), a novel framework for solving time-dependent partial differential equations with high accuracy and capable of handling high-dimensional problems. Our architecture…

Numerical Analysis · Mathematics 2025-12-08 Tunan Kao , He Zhang , Lei Zhang , Jin Zhao

Linearized shallow neural networks that are constructed by fixing the hidden-layer parameters have recently shown strong performance in solving partial differential equations (PDEs). Such models, widely used in the random feature method…

Numerical Analysis · Mathematics 2026-01-21 Tong Mao , Jinchao Xu , Xiaofeng Xu

Recent research has used deep learning to develop partial differential equation (PDE) models in science and engineering. The functional form of the PDE is determined by a neural network, and the neural network parameters are calibrated to…

Machine Learning · Computer Science 2023-10-17 Justin Sirignano , Jonathan MacArt , Konstantinos Spiliopoulos

Nonlinear partial differential equations (PDEs) are used to model dynamical processes in a large number of scientific fields, ranging from finance to biology. In many applications standard local models are not sufficient to accurately…

Numerical Analysis · Mathematics 2022-05-10 Victor Boussange , Sebastian Becker , Arnulf Jentzen , Benno Kuckuck , Loïc Pellissier

In this article we propose a new deep learning approach to approximate operators related to parametric partial differential equations (PDEs). In particular, we introduce a new strategy to design specific artificial neural network (ANN)…

Numerical Analysis · Mathematics 2026-05-01 Arnulf Jentzen , Adrian Riekert , Philippe von Wurstemberger

Deep neural networks (DNN) have been used to model nonlinear relations between physical quantities. Those DNNs are embedded in physical systems described by partial differential equations (PDE) and trained by minimizing a loss function that…

Numerical Analysis · Mathematics 2020-02-26 Kailai Xu , Eric Darve