English
Related papers

Related papers: Are Two Hidden Layers Still Enough for the Physics…

200 papers

Physics-informed neural networks (PINNs) provide a promising framework for solving inverse problems governed by partial differential equations (PDEs) by integrating observational data and physical constraints in a unified optimization…

Machine Learning · Computer Science 2026-04-07 Yongsheng Chen , Yong Chen , Wei Guo , Xinghui Zhong

We introduce physics informed neural networks -- neural networks that are trained to solve supervised learning tasks while respecting any given law of physics described by general nonlinear partial differential equations. In this second…

Artificial Intelligence · Computer Science 2017-11-30 Maziar Raissi , Paris Perdikaris , George Em Karniadakis

Physics Informed Neural Networks is a numerical method which uses neural networks to approximate solutions of partial differential equations. It has received a lot of attention and is currently used in numerous physical and engineering…

Numerical Analysis · Mathematics 2025-07-10 Dimitrios Gazoulis , Ioannis Gkanis , Charalambos G. Makridakis

In this paper, we introduce a shallow (one-hidden-layer) physics-informed neural network for solving partial differential equations on static and evolving surfaces. For the static surface case, with the aid of level set function, the…

Numerical Analysis · Mathematics 2025-03-20 Wei-Fan Hu , Yi-Jun Shih , Te-Sheng Lin , Ming-Chih Lai

Current physics-informed (standard or deep operator) neural networks still rely on accurately learning the initial and/or boundary conditions of the system of differential equations they are solving. In contrast, standard numerical methods…

Machine Learning · Computer Science 2024-06-25 Rüdiger Brecht , Dmytro R. Popovych , Alex Bihlo , Roman O. Popovych

Physics-informed neural networks (PINNs) have recently received much attention due to their capabilities in solving both forward and inverse problems. For training a deep neural network associated with a PINN, one typically constructs a…

Machine Learning · Computer Science 2022-08-26 Pouyan Nasiri , Roozbeh Dargazany

Physics-Informed Neural Networks (PINNs) provide a powerful and general framework for solving Partial Differential Equations (PDEs) by embedding physical laws into loss functions. However, training PINNs is notoriously difficult due to the…

Machine Learning · Computer Science 2025-10-09 Kang An , Chenhao Si , Ming Yan , Shiqian Ma

Physics-informed neural networks (PINNs) are a new tool for solving boundary value problems by defining loss functions of neural networks based on governing equations, boundary conditions, and initial conditions. Recent investigations have…

Computational Engineering, Finance, and Science · Computer Science 2023-11-14 Ali Harandi , Ahmad Moeineddin , Michael Kaliske , Stefanie Reese , Shahed Rezaei

The proper initialization of weights is crucial for the effective training and fast convergence of deep neural networks (DNNs). Prior work in this area has mostly focused on balancing the variance among weights per layer to maintain…

Machine Learning · Computer Science 2020-06-05 Maciej Skorski , Alessandro Temperoni , Martin Theobald

Physics-informed neural networks have emerged as a prominent new method for solving differential equations. While conceptually straightforward, they often suffer training difficulties that lead to relatively large discretization errors or…

Mathematical Physics · Physics 2024-03-13 Shivam Arora , Alex Bihlo , Francis Valiquette

We propose a ``half'' layer of hidden units that has some of its weights randomly set and some of them trained. A half unit is composed of two stages: First, it takes a weighted sum of its inputs with fixed random weights, and second, the…

Machine Learning · Computer Science 2025-06-06 Ethem Alpaydin

Recently, neural networks have been widely applied for solving partial differential equations (PDEs). Although such methods have been proven remarkably successful on practical engineering problems, they have not been shown, theoretically or…

Numerical Analysis · Mathematics 2023-03-27 Jonathan W. Siegel , Qingguo Hong , Xianlin Jin , Wenrui Hao , Jinchao Xu

Physics-informed Neural Networks (PINNs) have been shown as a promising approach for solving both forward and inverse problems of partial differential equations (PDEs). Meanwhile, the neural operator approach, including methods such as Deep…

Machine Learning · Computer Science 2023-10-31 Bin Lin , Zhiping Mao , Zhicheng Wang , George Em Karniadakis

Deep neural networks (DNN) have been used to model nonlinear relations between physical quantities. Those DNNs are embedded in physical systems described by partial differential equations (PDE) and trained by minimizing a loss function that…

Numerical Analysis · Mathematics 2020-02-26 Kailai Xu , Eric Darve

Discovering hidden physical laws and identifying governing system parameters from sparse observations are central challenges in computational science and engineering. Existing data-driven methods, such as physics-informed neural networks…

Machine Learning · Computer Science 2026-04-16 Dibakar Roy Sarkar , Vijay Kag , Birupaksha Pal , Somdatta Goswami

We propose a novel algorithm for combined unit and layer pruning of deep neural networks that functions during training and without requiring a pre-trained network to apply. Our algorithm optimally trades-off learning accuracy and pruning…

Machine Learning · Computer Science 2025-07-17 Valentin Frank Ingmar Guenter , Athanasios Sideris

Many types of physics-informed neural network models have been proposed in recent years as approaches for learning solutions to differential equations. When a particular task requires solving a differential equation at multiple…

Machine Learning · Computer Science 2021-11-02 Filipe de Avila Belbute-Peres , Yi-fan Chen , Fei Sha

Foundation models for partial differential equations (PDEs) have emerged as powerful surrogates pre-trained on diverse physical systems, but adapting them to new downstream tasks remains challenging due to limited task-specific data and…

Machine Learning · Computer Science 2026-03-17 Vlad Medvedev , Leon Armbruster , Christopher Straub , Georg Kruse , Andreas Rosskopf

In this paper, we show a physics-informed neural network solver for the time-dependent surface PDEs. Unlike the traditional numerical solver, no extension of PDE and mesh on the surface is needed. We show a simplified prior estimate of the…

Machine Learning · Computer Science 2021-03-26 Zhiwei Fang , Justin Zhang , Xiu Yang

In this paper, we propose a novel approach for implicit data representation to evaluate similarity of input data using a trained neural network. In contrast to the previous approach, which uses gradients for representation, we utilize only…

Machine Learning · Computer Science 2020-10-12 Alan Savushkin , Nikita Benkovich , Dmitry Golubev