English
Related papers

Related papers: Deep neural network for solving differential equat…

200 papers

We investigate the potential of applying (D)NN ((deep) neural networks) for approximating nonlinear mappings arising in the finite element discretization of nonlinear PDEs (partial differential equations). As an application, we apply the…

Numerical Analysis · Mathematics 2019-11-14 Tuyen Tran , Aidan Hamilton , Maricela Best McKay , Benjamin Quiring , Panayot S. Vassilevski

Partial differential equations (PDEs) with Dirichlet boundary conditions defined on boundaries with simple geometry have been succesfuly treated using sigmoidal multilayer perceptrons in previous works. This article deals with the case of…

Neural and Evolutionary Computing · Computer Science 2007-05-23 I. E. Lagaris , A. Likas , D. G. Papageorgiou

We prove that deep neural networks are capable of approximating solutions of semilinear Kolmogorov PDE in the case of gradient-independent, Lipschitz-continuous nonlinearities, while the required number of parameters in the networks grow at…

Numerical Analysis · Mathematics 2022-05-31 Petru A. Cioica-Licht , Martin Hutzenthaler , P. Tobias Werner

The highly non-linear nature of deep neural networks causes them to be susceptible to adversarial examples and have unstable gradients which hinders interpretability. However, existing methods to solve these issues, such as adversarial…

Machine Learning · Computer Science 2023-01-11 Suraj Srinivas , Kyle Matoba , Himabindu Lakkaraju , Francois Fleuret

In recent years, there has been an increasing interest in using deep learning and neural networks to tackle scientific problems, particularly in solving partial differential equations (PDEs). However, many neural network-based methods, such…

Machine Learning · Computer Science 2025-02-14 Adrian Celaya , Yimo Wang , David Fuentes , Beatrice Riviere

In this paper we use deep feedforward artificial neural networks to approximate solutions to partial differential equations in complex geometries. We show how to modify the backpropagation algorithm to compute the partial derivatives of the…

Machine Learning · Statistics 2018-08-28 Jens Berg , Kaj Nyström

We consider the fractional elliptic problem with Dirichlet boundary conditions on a bounded and convex domain $D$ of $\mathbb{R}^d$, with $d \geq 2$. In this paper, we perform a stochastic gradient descent algorithm that approximates the…

Analysis of PDEs · Mathematics 2023-09-01 Nicolás Valenzuela

In the field of pattern recognition research, the method of using deep neural networks based on improved computing hardware recently attracted attention because of their superior accuracy compared to conventional methods. Deep neural…

Computer Vision and Pattern Recognition · Computer Science 2018-09-27 Kyongsik Yun , Alexander Huyen , Thomas Lu

Linearized shallow neural networks that are constructed by fixing the hidden-layer parameters have recently shown strong performance in solving partial differential equations (PDEs). Such models, widely used in the random feature method…

Numerical Analysis · Mathematics 2026-01-21 Tong Mao , Jinchao Xu , Xiaofeng Xu

Partial differential equations have a wide range of applications in modeling multiple physical, biological, or social phenomena. Therefore, we need to approximate the solutions of these equations in computationally feasible terms. Nowadays,…

Numerical Analysis · Mathematics 2024-11-14 Carlos Uriarte

In this paper we consider utilizing a residual neural network (ResNet) to solve ordinary differential equations. Stochastic gradient descent method is applied to obtain the optimal parameter set of weights and biases of the network. We…

Numerical Analysis · Mathematics 2021-01-12 Changxin Qiu , Aaron Bendickson , Joshua Kalyanapu , Jue Yan

Partial Differential Equations (PDEs) are central to modeling complex systems across physical, biological, and engineering domains, yet traditional numerical methods often struggle with high-dimensional or complex problems. Physics-Informed…

Machine Learning · Computer Science 2026-02-11 Chenggong Zhang

In the last decade, deep learning has become a major component of artificial intelligence. The workhorse of deep learning is the optimization of loss functions by stochastic gradient descent (SGD). Traditionally in deep learning, neural…

Machine Learning · Computer Science 2021-04-27 Benjamin Scellier

This research introduces an extended application of neural networks for solving nonlinear partial differential equations (PDEs). A neural network, combined with a pseudo-arclength continuation, is proposed to construct bifurcation diagrams…

Numerical Analysis · Mathematics 2025-07-24 Muhammad Luthfi Shahab , Hadi Susanto

Recent experiments have shown that deep networks can approximate solutions to high-dimensional PDEs, seemingly escaping the curse of dimensionality. However, questions regarding the theoretical basis for such approximations, including the…

Machine Learning · Computer Science 2021-07-07 Tanya Marwah , Zachary C. Lipton , Andrej Risteski

Deep neural networks are widely used for nonlinear function approximation with applications ranging from computer vision to control. Although these networks involve the composition of simple arithmetic operations, it can be very challenging…

Machine Learning · Computer Science 2020-12-02 Changliu Liu , Tomer Arnon , Christopher Lazarus , Christopher Strong , Clark Barrett , Mykel J. Kochenderfer

Probabilistic theory and differential equation are powerful tools for the interpretability and guidance of the design of machine learning models, especially for illuminating the mathematical motivation of learning latent variable from…

Machine Learning · Computer Science 2025-02-13 Zhuangwei Shi

Spectral methods are an important part of scientific computing's arsenal for solving partial differential equations (PDEs). However, their applicability and effectiveness depend crucially on the choice of basis functions used to expand the…

Numerical Analysis · Mathematics 2021-11-10 Brek Meuris , Saad Qadeer , Panos Stinis

Neural networks are known to be effective function approximators. Recently, deep neural networks have proven to be very effective in pattern recognition, classification tasks and human-level control to model highly nonlinear realworld…

Neural and Evolutionary Computing · Computer Science 2016-10-06 Olalekan Ogunmolu , Xuejun Gu , Steve Jiang , Nicholas Gans

Many scientific and industrial applications require solving Partial Differential Equations (PDEs) to describe the physical phenomena of interest. Some examples can be found in the fields of aerodynamics, astrodynamics, combustion and many…

Computational Physics · Physics 2019-12-11 Juan B. Pedro , Juan Maroñas , Roberto Paredes