English
Related papers

Related papers: Neural networks catching up with finite difference…

200 papers

The aim of this note is to construct a neural network for which the linear finite element approximation of a simple one dimensional boundary value problem is a minimum of the cost function to find out if the neural network is able to…

Numerical Analysis · Mathematics 2024-05-20 Julia Novo , Eduardo Terrés

Recent years have witnessed a growth in mathematics for deep learning--which seeks a deeper understanding of the concepts of deep learning with mathematics and explores how to make it more robust--and deep learning for mathematics, where…

Machine Learning · Computer Science 2023-10-31 Derick Nganyu Tanyu , Jianfeng Ning , Tom Freudenberg , Nick Heilenkötter , Andreas Rademacher , Uwe Iben , Peter Maass

Neural networks are universal approximators and are studied for their use in solving differential equations. However, a major criticism is the lack of error bounds for obtained solutions. This paper proposes a technique to rigorously…

Computational Engineering, Finance, and Science · Computer Science 2023-06-07 Shuheng Liu , Xiyue Huang , Pavlos Protopapas

Mathematical models in neural networks are powerful tools for solving complex differential equations and optimizing their parameters; that is, solving the forward and inverse problems, respectively. A forward problem predicts the output of…

Machine Learning · Computer Science 2025-07-29 Aarush Gupta , Kendric Hsu , Syna Mathod

Neural networks can be trained to solve partial differential equations (PDEs) by using the PDE residual as the loss function. This strategy is called "physics-informed neural networks" (PINNs), but it currently cannot produce high-accuracy…

Machine Learning · Computer Science 2024-04-11 Qi Zeng , Yash Kothari , Spencer H. Bryngelson , Florian Schäfer

Recently, researchers have utilized neural networks to accurately solve partial differential equations (PDEs), enabling the mesh-free method for scientific computation. Unfortunately, the network performance drops when encountering a high…

Machine Learning · Computer Science 2021-09-29 Pongpisit Thanasutives , Masayuki Numao , Ken-ichi Fukui

Deep learning-based partial differential equation(PDE) solvers have received much attention in the past few years. Methods of this category can solve a wide range of PDEs with high accuracy, typically by transforming the problems into…

Numerical Analysis · Mathematics 2024-07-23 Ramesh Chandra Sau , Luowei Yin

A new penalty-free neural network method, PFNN-2, is presented for solving partial differential equations, which is a subsequent improvement of our previously proposed PFNN method [1]. PFNN-2 inherits all advantages of PFNN in handling the…

Numerical Analysis · Mathematics 2022-05-03 Hailong Sheng , Chao Yang

Physics-Informed Neural Networks (PINNs) are a powerful class of numerical solvers for partial differential equations, employing deep neural networks with successful applications across a diverse set of problems. However, their…

Numerical Analysis · Mathematics 2024-04-18 Tianhao Hu , Bangti Jin , Zhi Zhou

Neural operators, as a powerful approximation to the non-linear operators between infinite-dimensional function spaces, have proved to be promising in accelerating the solution of partial differential equations (PDE). However, it requires a…

Machine Learning · Computer Science 2024-05-08 Xinquan Huang , Wenlei Shi , Xiaotian Gao , Xinran Wei , Jia Zhang , Jiang Bian , Mao Yang , Tie-Yan Liu

This paper aims to devise an adaptive neural network basis method for numerically solving a second-order semilinear partial differential equation (PDE) with low-regular solutions in two/three dimensions. The method is obtained by combining…

Numerical Analysis · Mathematics 2024-11-05 Jianguo Huang , Haohao Wu , Tao Zhou

In this paper, the authors propose the utilization of Fibonacci Neural Networks (FNN) for solving arbitrary order differential equations. The FNN architecture comprises input, middle, and output layers, with various degrees of Fibonacci…

Number Theory · Mathematics 2024-08-27 Kushal Dhar Dwivedi , Anup Singh

We present PFNN, a penalty-free neural network method, to efficiently solve a class of second-order boundary-value problems on complex geometries. To reduce the smoothness requirement, the original problem is reformulated to a weak form so…

Numerical Analysis · Mathematics 2021-02-03 Hailong Sheng , Chao Yang

To solve high-dimensional parameter-dependent partial differential equations (pPDEs), a neural network architecture is presented. It is constructed to map parameters of the model data to corresponding finite element solutions. To improve…

Numerical Analysis · Mathematics 2024-03-20 Janina E. Schütte , Martin Eigel

Deep neural networks have enabled progress in a wide variety of applications. Growing the size of the neural network typically results in improved accuracy. As model sizes grow, the memory and compute requirements for training these models…

This paper is concerned with the approximation of the solution of partial differential equations by means of artificial neural networks. Here a feedforward neural network is used to approximate the solution of the partial differential…

Numerical Analysis · Mathematics 2019-04-10 Henri Calandra , Serge Gratton , Elisa Riccietti , Xavier Vasseur

In recent years, there has been a growing interest in leveraging deep learning and neural networks to address scientific problems, particularly in solving partial differential equations (PDEs). However, many neural network-based methods…

Machine Learning · Computer Science 2024-04-24 Adrian Celaya , Keegan Kirk , David Fuentes , Beatrice Riviere

We present a subspace method based on neural networks for solving the partial differential equation in weak form with high accuracy. The basic idea of our method is to use some functions based on neural networks as base functions to span a…

Numerical Analysis · Mathematics 2024-05-15 Pengyuan Liu , Zhaodong Xu , Zhiqiang Sheng

Physics-informed neural networks solve partial differential equations by training neural networks. Since this method approximates infinite-dimensional PDE solutions with finite collocation points, minimizing discretization errors by…

Machine Learning · Computer Science 2024-12-11 Takashi Matsubara , Takaharu Yaguchi

In recent work it has been established that deep neural networks are capable of approximating solutions to a large class of parabolic partial differential equations without incurring the curse of dimension. However, all this work has been…

Numerical Analysis · Mathematics 2020-08-18 Philipp Grohs , Lukas Herrmann