English
Related papers

Related papers: Deep neural network approximation for high-dimensi…

200 papers

Physics-informed neural networks offered an alternate way to solve several differential equations that govern complicated physics. However, their success in predicting the acoustic field is limited by the vanishing-gradient problem that…

Machine Learning · Computer Science 2025-03-27 D. Veerababu , Prasanta K. Ghosh

Machine learning methods for solving nonlinear partial differential equations (PDEs) are hot topical issues, and different algorithms proposed in the literature show efficient numerical approximation in high dimension. In this paper, we…

Optimization and Control · Mathematics 2022-01-05 Maximilien Germain , Mathieu Laurière , Huyên Pham , Xavier Warin

It is one of the most challenging problems in applied mathematics to approximatively solve high-dimensional partial differential equations (PDEs). Recently, several deep learning-based approximation algorithms for attacking this problem…

Numerical Analysis · Mathematics 2023-02-10 Christian Beck , Martin Hutzenthaler , Arnulf Jentzen , Benno Kuckuck

The diffuse-domain, or smoothed boundary, method is an attractive approach for solving partial differential equations in complex geometries because of its simplicity and flexibility. In this method the complex geometry is embedded into a…

Numerical Analysis · Mathematics 2019-12-02 Fei Yu , Zhenlin Guo , John Lowengrub

Using deep neural networks to solve PDEs has attracted a lot of attentions recently. However, why the deep learning method works is falling far behind its empirical success. In this paper, we provide a rigorous numerical analysis on deep…

Numerical Analysis · Mathematics 2021-09-07 Yuling Jiao , Yanming Lai , Yisu Lo , Yang Wang , Yunfei Yang

This paper proves an abstract theorem addressing in a unified manner two important problems in function approximation: avoiding curse of dimensionality and estimating the degree of approximation for out-of-sample extension in manifold…

Machine Learning · Computer Science 2019-11-05 Hrushikesh N. Mhaskar

Partial Differential Equations (PDEs) are used to model a variety of dynamical systems in science and engineering. Recent advances in deep learning have enabled us to solve them in a higher dimension by addressing the curse of…

Deep Neural Networks (DNNs) are widely used for their ability to effectively approximate large classes of functions. This flexibility, however, makes the strict enforcement of constraints on DNNs an open problem. Here we present a framework…

Machine Learning · Computer Science 2023-02-10 Eric Marcus , Ray Sheombarsing , Jan-Jakob Sonke , Jonas Teuwen

Parabolic partial differential equations (PDEs) are widely used in the mathematical modeling of natural phenomena and man made complex systems. In particular, parabolic PDEs are a fundamental tool to determine fair prices of financial…

Numerical Analysis · Mathematics 2020-10-05 Martin Hutzenthaler , Arnulf Jentzen , Philippe von Wurstemberger

Neural operators, as a powerful approximation to the non-linear operators between infinite-dimensional function spaces, have proved to be promising in accelerating the solution of partial differential equations (PDE). However, it requires a…

Machine Learning · Computer Science 2024-05-08 Xinquan Huang , Wenlei Shi , Xiaotian Gao , Xinran Wei , Jia Zhang , Jiang Bian , Mao Yang , Tie-Yan Liu

A Neural Network (NN) based numerical method is formulated and implemented for solving Boundary Value Problems (BVPs) and numerical results are presented to validate this method by solving Laplace equation with Dirichlet boundary condition…

Machine Learning · Computer Science 2019-09-25 Sethu Hareesh Kolluru

In certain practical engineering applications, there is an urgent need to perform repetitive solving of partial differential equations (PDEs) in a short period. This paper primarily considers three scenarios requiring extensive repetitive…

Numerical Analysis · Mathematics 2025-08-06 Bo Yang , Xingquan Li , Jie Zhao , Ying Jiang

Deep neural networks (DNNs) have achieved remarkable success in numerous domains, and their application to PDE-related problems has been rapidly advancing. This paper provides an estimate for the generalization error of learning Lipschitz…

Machine Learning · Computer Science 2023-10-04 Ke Chen , Chunmei Wang , Haizhao Yang

We propose a very general framework for deriving rigorous bounds on the approximation error for physics-informed neural networks (PINNs) and operator learning architectures such as DeepONets and FNOs as well as for physics-informed operator…

Machine Learning · Computer Science 2022-10-11 Tim De Ryck , Siddhartha Mishra

We study the problem of approximating and estimating classification functions that have their decision boundary in the $RBV^2$ space. Functions of $RBV^2$ type arise naturally as solutions of regularized neural network learning problems and…

Machine Learning · Computer Science 2024-09-27 Andres Felipe Lerma-Pineda , Philipp Petersen , Simon Frieder , Thomas Lukasiewicz

We investigate the complexity of deep neural networks through the lens of functional equivalence, which posits that different parameterizations can yield the same network function. Leveraging the equivalence property, we present a novel…

Machine Learning · Computer Science 2024-05-17 Guohao Shen

In this paper, we propose multi-scale deep neural networks (MscaleDNNs) using the idea of radial scaling in frequency domain and activation functions with compact support. The radial scaling converts the problem of approximation of high…

Computational Physics · Physics 2020-12-30 Ziqi Liu , Wei Cai , Zhi-Qin John Xu

Neural networks are powerful tools for approximating high dimensional data that have been used in many contexts, including solution of partial differential equations (PDEs). We describe a solver for multiscale fully nonlinear elliptic…

Numerical Analysis · Mathematics 2025-03-07 Shi Chen , Zhiyan Ding , Qin Li , Stephen J. Wright

We study the approximation rates of a class of deep neural network approximations of operators which arise as data-to-solution maps $\mathcal{S}$ of linear elliptic partial differential equations (PDEs), and act between pairs $X,Y$ of…

Numerical Analysis · Mathematics 2025-12-22 Carlo Marcati , Christoph Schwab

Current physics-informed (standard or deep operator) neural networks still rely on accurately learning the initial and/or boundary conditions of the system of differential equations they are solving. In contrast, standard numerical methods…

Machine Learning · Computer Science 2024-06-25 Rüdiger Brecht , Dmytro R. Popovych , Alex Bihlo , Roman O. Popovych