English
Related papers

Related papers: Neural networks catching up with finite difference…

200 papers

The solution of partial differential equations (PDES) on irregular domains has long been a subject of significant research interest. In this work, we present an approach utilizing physics-informed neural networks (PINNs) to achieve…

Computational Physics · Physics 2025-06-12 Cuizhi Zhou , Kaien Zhu

We present two effective methods for solving high-dimensional partial differential equations (PDE) based on randomized neural networks. Motivated by the universal approximation property of this type of networks, both methods extend the…

Numerical Analysis · Mathematics 2023-09-14 Yiran Wang , Suchuan Dong

In this paper, we propose and study neural network based methods for solutions of high-dimensional quadratic porous medium equation (QPME). Three variational formulations of this nonlinear PDE are presented: a strong formulation and two…

Numerical Analysis · Mathematics 2022-05-09 Jianfeng Lu , Min Wang

We prove that deep neural networks are capable of approximating solutions of semilinear Kolmogorov PDE in the case of gradient-independent, Lipschitz-continuous nonlinearities, while the required number of parameters in the networks grow at…

Numerical Analysis · Mathematics 2022-05-31 Petru A. Cioica-Licht , Martin Hutzenthaler , P. Tobias Werner

Neural networks are usually not the tool of choice for nonparametric high-dimensional problems where the number of input features is much larger than the number of observations. Though neural networks can approximate complex multivariate…

Methodology · Statistics 2019-06-25 Jean Feng , Noah Simon

In this paper, neural network approximation methods are developed for elliptic partial differential equations with multi-frequency solutions. Neural network work approximation methods have advantages over classical approaches in that they…

Numerical Analysis · Mathematics 2023-11-08 Deok-Kyu Jang , Hyea Hyun Kim , Kyungsoo Kim

In this work, we present a machine learning approach for reducing the error when numerically solving time-dependent partial differential equations (PDE). We use a fully convolutional LSTM network to exploit the spatiotemporal dynamics of…

Machine Learning · Computer Science 2020-02-11 Ben Stevens , Tim Colonius

Random cost simulations were introduced as a method to investigate optimization problems in systems with conflicting constraints. Here I study the approach in connection with the training of a feed-forward multilayer perceptron, as used in…

High Energy Physics - Phenomenology · Physics 2009-10-28 Bernd A. Berg

Many machine learning applications deal with high dimensional data. To make computations feasible and learning more efficient, it is often desirable to reduce the dimensionality of the input variables by finding linear combinations of the…

Machine Learning · Computer Science 2025-01-30 Wenjing Yang , Yuhong Yang

Differential equations are indispensable to engineering and hence to innovation. In recent years, physics-informed neural networks (PINN) have emerged as a novel method for solving differential equations. PINN method has the advantage of…

Computational Engineering, Finance, and Science · Computer Science 2022-01-07 Mayank Raj , Pramod Kumbhar , Ratna Kumar Annabattula

Physics-informed neural networks (PINNs) have been demonstrated to be efficient in solving partial differential equations (PDEs) from a variety of experimental perspectives. Some recent studies have also proposed PINN algorithms for PDEs on…

Numerical Analysis · Mathematics 2024-08-06 Guanhang Lei , Zhen Lei , Lei Shi , Chenyu Zeng , Ding-Xuan Zhou

In recent years a large literature on deep learning based methods for the numerical solution partial differential equations has emerged; results for integro-differential equations on the other hand are scarce. In this paper we study deep…

Numerical Analysis · Mathematics 2021-09-27 Rüdiger Frey , Verena Köck

Neural networks have been very successful in many applications; we often, however, lack a theoretical understanding of what the neural networks are actually learning. This problem emerges when trying to generalise to new data sets. The…

Classical Analysis and ODEs · Mathematics 2022-11-22 Matthew Thorpe , Yves van Gennip

Neural networks can be used to learn the solution of partial differential equations (PDEs) on arbitrary domains without requiring a computational mesh. Common approaches integrate differential operators in training neural networks using a…

Machine Learning · Computer Science 2022-07-07 Shamsulhaq Basir , Inanc Senocak

We propose the use of physics-informed neural networks for solving the shallow-water equations on the sphere in the meteorological context. Physics-informed neural networks are trained to satisfy the differential equations along with the…

Computational Physics · Physics 2024-09-19 Alex Bihlo , Roman O. Popovych

Partial differential equations (PDEs) are often computationally challenging to solve, and in many settings many related PDEs must be be solved either at every timestep or for a variety of candidate boundary conditions, parameters, or…

Machine Learning · Computer Science 2022-11-04 Tian Qin , Alex Beatson , Deniz Oktay , Nick McGreivy , Ryan P. Adams

We study deep neural networks and their use in semiparametric inference. We establish novel rates of convergence for deep feedforward neural nets. Our new rates are sufficiently fast (in some cases minimax optimal) to allow us to establish…

Econometrics · Economics 2021-01-20 Max H. Farrell , Tengyuan Liang , Sanjog Misra

A feedforward neural network, including hidden layers, motivated by nonlinear functions (such as Tanh, ReLU, and Sigmoid functions), exhibits uniform approximation properties in Sobolev space, and discontinuous neural networks can reduce…

Numerical Analysis · Mathematics 2025-05-16 Xiaoyu Wang , Long Yuan , Yao Yu

Physics informed neural networks (PINNs) have emerged as a powerful tool to provide robust and accurate approximations of solutions to partial differential equations (PDEs). However, PINNs face serious difficulties and challenges when…

Machine Learning · Computer Science 2023-07-11 Rajat Arora

Neural network-based approaches for solving partial differential equations (PDEs) have recently received special attention. However, the large majority of neural PDE solvers only apply to rectilinear domains, and do not systematically…