English
Related papers

Related papers: Neural Network Approximations of PDEs Beyond Linea…

200 papers

Recently, deep Convolutional Neural Networks (CNNs) have proven to be successful when employed in areas such as reduced order modeling of parametrized PDEs. Despite their accuracy and efficiency, the approaches available in the literature…

Numerical Analysis · Mathematics 2023-01-26 Nicola Rares Franco , Stefania Fresca , Andrea Manzoni , Paolo Zunino

The past decade has seen increasing interest in applying Deep Learning (DL) to Computational Science and Engineering (CSE). Driven by impressive results in applications such as computer vision, Uncertainty Quantification (UQ), genetics,…

Numerical Analysis · Mathematics 2024-07-18 Ben Adcock , Simone Brugiapaglia , Nick Dexter , Sebastian Moraga

Recent developments in mechanical, aerospace, and structural engineering have driven a growing need for efficient ways to model and analyse structures at much larger and more complex scales than before. While established numerical methods…

Machine Learning · Computer Science 2025-07-29 Rui Wu , Nikola Kovachki , Burigede Liu

Deep neural nets have caused a revolution in many classification tasks. A related ongoing revolution -- also theoretically not understood -- concerns their ability to serve as generative models for complicated types of data such as images…

Machine Learning · Computer Science 2021-04-20 Holden Lee , Rong Ge , Tengyu Ma , Andrej Risteski , Sanjeev Arora

Machine learning for scientific applications faces the challenge of limited data. We propose a framework that leverages a priori known physics to reduce overfitting when training on relatively small datasets. A deep neural network is…

Machine Learning · Computer Science 2019-11-22 Jonathan B. Freund , Jonathan F. MacArt , Justin Sirignano

The fractional Laplacian has been strongly studied during past decades. In this paper we present a different approach for the associated Dirichlet problem, using recent deep learning techniques. In fact, intensively PDEs with a stochastic…

Analysis of PDEs · Mathematics 2022-07-04 Nicolás Valenzuela

Parabolic partial differential equations (PDEs) are widely used in the mathematical modeling of natural phenomena and man made complex systems. In particular, parabolic PDEs are a fundamental tool to determine fair prices of financial…

Numerical Analysis · Mathematics 2020-10-05 Martin Hutzenthaler , Arnulf Jentzen , Philippe von Wurstemberger

Verification of Neural Networks (NNs) that approximate the solution of Partial Differential Equations (PDEs) is a major milestone towards enhancing their trustworthiness and accelerating their deployment, especially for safety-critical…

Systems and Control · Electrical Eng. & Systems 2024-02-13 Petros Ellinas , Rahul Nellikath , Ignasi Ventura , Jochen Stiasny , Spyros Chatzivasileiadis

Recent works have shown that deep neural networks can be employed to solve partial differential equations, giving rise to the framework of physics informed neural networks. We introduce a generalization for these methods that manifests as a…

Numerical Analysis · Mathematics 2021-03-25 Remco van der Meer , Cornelis Oosterlee , Anastasia Borovykh

Recently, researchers have utilized neural networks to accurately solve partial differential equations (PDEs), enabling the mesh-free method for scientific computation. Unfortunately, the network performance drops when encountering a high…

Machine Learning · Computer Science 2021-09-29 Pongpisit Thanasutives , Masayuki Numao , Ken-ichi Fukui

We use elliptic partial differential equations (PDEs) as examples to show various properties and behaviors when shallow neural networks (SNNs) are used to represent the solutions. In particular, we study the numerical ill-conditioning,…

Numerical Analysis · Mathematics 2025-11-04 Roy Y. He , Ying Liang , Hongkai Zhao , Yimin Zhong

This article is concerned with the approximation and expressive powers of deep neural networks. This is an active research area currently producing many interesting papers. The results most commonly found in the literature prove that neural…

Machine Learning · Computer Science 2019-05-08 I. Daubechies , R. DeVore , S. Foucart , B. Hanin , G. Petrova

Neural network-based approaches for solving partial differential equations (PDEs) have recently received special attention. However, the large majority of neural PDE solvers only apply to rectilinear domains, and do not systematically…

Neural networks (NN) have achieved state-of-the-art performance in various applications. Unfortunately in applications where training data is insufficient, they are often prone to overfitting. One effective way to alleviate this problem is…

Machine Learning · Computer Science 2016-11-03 Hao Wang , Xingjian Shi , Dit-Yan Yeung

To sidestep the curse of dimensionality when computing solutions to Hamilton-Jacobi-Bellman partial differential equations (HJB PDE), we propose an algorithm that leverages a neural network to approximate the value function. We show that…

Machine Learning · Computer Science 2017-03-28 Frank Jiang , Glen Chou , Mo Chen , Claire J. Tomlin

This paper studies deep neural networks for solving extremely large linear systems arising from highdimensional problems. Because of the curse of dimensionality, it is expensive to store both the solution and right-hand side vector in such…

Numerical Analysis · Mathematics 2023-03-07 Yiqi Gu , Michael K. Ng

This work extends the paradigm of evolutional deep neural networks (EDNNs) to solving parametric time-dependent partial differential equations (PDEs) on domains with geometric structure. By introducing positional embeddings based on…

Numerical Analysis · Mathematics 2023-08-08 Mariella Kast , Jan S Hesthaven

In this paper, we establish a neural network to approximate functionals, which are maps from infinite dimensional spaces to finite dimensional spaces. The approximation error of the neural network is $O(1/\sqrt{m})$ where $m$ is the size of…

Numerical Analysis · Mathematics 2023-01-02 Yahong Yang , Yang Xiang

Approximation capabilities of shallow neural networks (SNNs) form an integral part in understanding the properties of deep neural networks (DNNs). In the study of these approximation capabilities some very popular classes of target…

Machine Learning · Computer Science 2023-12-15 Ahmed Abdeljawad , Thomas Dittrich

This paper proposes a mesh-free computational framework and machine learning theory for solving elliptic PDEs on unknown manifolds, identified with point clouds, based on diffusion maps (DM) and deep learning. The PDE solver is formulated…

Numerical Analysis · Mathematics 2024-02-28 Senwei Liang , Shixiao W. Jiang , John Harlim , Haizhao Yang