English
Related papers

Related papers: When and why PINNs fail to train: A neural tangent…

200 papers

Physics-informed neural networks (PINNs) are trained using physical equations and can also incorporate unmodeled effects by learning from data. PINNs for control (PINCs) of dynamical systems are gaining interest due to their prediction…

Systems and Control · Electrical Eng. & Systems 2024-08-29 Henrik Krauss , Tim-Lukas Habich , Max Bartholdt , Thomas Seel , Moritz Schappler

Modern deep learning models employ considerably more parameters than required to fit the training data. Whereas conventional statistical wisdom suggests such models should drastically overfit, in practice these models generalize remarkably…

Machine Learning · Statistics 2020-08-18 Ben Adlam , Jeffrey Pennington

Physics-informed neural networks (PINNs) and their variants have been very popular in recent years as algorithms for the numerical simulation of both forward and inverse problems for partial differential equations. This article aims to…

Numerical Analysis · Mathematics 2024-11-20 Tim De Ryck , Siddhartha Mishra

Physics-informed neural networks (PINNs) have recently emerged as effective methods for solving partial differential equations (PDEs) in various problems. Substantial research focuses on the failure modes of PINNs due to their frequent…

Machine Learning · Computer Science 2024-10-01 Yesom Park , Changhoon Song , Myungjoo Kang

Partial differential equations (PDEs) are an essential computational kernel in physics and engineering. With the advance of deep learning, physics-informed neural networks (PINNs), as a mesh-free method, have shown great potential for fast…

Machine Learning · Computer Science 2023-06-19 Junjun Yan , Xinhai Chen , Zhichao Wang , Enqiang Zhoui , Jie Liu

Given the complexity of genetic risk prediction, there is a critical need for the development of novel methodologies that can effectively capture intricate genotype--phenotype relationships (e.g., nonlinear) while remaining statistically…

Applications · Statistics 2025-10-03 Heng Ge , Qing Lu

Physics-informed neural networks (PINNs) have emerged as a new learning paradigm for solving partial differential equations (PDEs) by enforcing the constraints of physical equations, boundary conditions (BCs), and initial conditions (ICs)…

Machine Learning · Computer Science 2025-05-21 Chenhong Zhou , Jie Chen , Zaifeng Yang , Ching Eng Png

Physics-informed neural networks (PINNs) have earned high expectations in solving partial differential equations (PDEs), but their optimization usually faces thorny challenges due to the unique derivative-dependent loss function. By…

Machine Learning · Computer Science 2025-05-20 Haixu Wu , Yuezhou Ma , Hang Zhou , Huikun Weng , Jianmin Wang , Mingsheng Long

Graph neural networks (GNNs) achieve remarkable performance in graph machine learning tasks but can be hard to train on large-graph data, where their learning dynamics are not well understood. We investigate the training dynamics of…

Machine Learning · Computer Science 2023-06-02 Sanjukta Krishnagopal , Luana Ruiz

Physics-informed neural networks (PINNs) are a newly emerging research frontier in machine learning, which incorporate certain physical laws that govern a given data set, e.g., those described by partial differential equations (PDEs), into…

Neural and Evolutionary Computing · Computer Science 2023-07-11 Bo Wang , A. K. Qin , Sajjad Shafiei , Hussein Dia , Adriana-Simona Mihaita , Hanna Grzybowska

Physics-Informed Neural Networks (PINNs) solve physical systems by incorporating governing partial differential equations directly into neural network training. In electromagnetism, where well-established methodologies such as FDTD and FEM…

Computational Physics · Physics 2026-02-13 Nilufer K. Bulut

A longstanding goal in the theory of deep learning is to characterize the conditions under which a given neural network architecture will be trainable, and if so, how well it might generalize to unseen data. In this work, we provide such a…

Machine Learning · Computer Science 2020-07-14 Lechao Xiao , Jeffrey Pennington , Samuel S. Schoenholz

Physics-informed neural networks (PINNs) have effectively been demonstrated in solving forward and inverse differential equation problems, but they are still trapped in training failures when the target functions to be approximated exhibit…

Machine Learning · Computer Science 2023-03-06 Ye Li , Song-Can Chen , Sheng-Jun Huang

Recently, neural networks utilizing periodic activation functions have been proven to demonstrate superior performance in vision tasks compared to traditional ReLU-activated networks. However, there is still a limited understanding of the…

Machine Learning · Computer Science 2024-02-08 Hemanth Saratchandran , Shin-Fang Chng , Simon Lucey

Physics-informed neural networks (PINNs) have recently become a powerful tool for solving partial differential equations (PDEs). However, finding a set of neural network parameters that lead to fulfilling a PDE can be challenging and…

Machine Learning · Computer Science 2023-04-12 Aleksandr Dekhovich , Marcel H. F. Sluiter , David M. J. Tax , Miguel A. Bessa

Approximating solutions to partial differential equations (PDEs) is fundamental for the modeling of dynamical systems in science and engineering. Physics-informed neural networks (PINNs) are a recent machine learning-based approach, for…

Physics-informed neural networks (PINNs) [4, 10] are an approach for solving boundary value problems based on differential equations (PDEs). The key idea of PINNs is to use a neural network to approximate the solution to the PDE and to…

Numerical Analysis · Mathematics 2023-05-23 Victorita Dolean , Alexander Heinlein , Siddhartha Mishra , Ben Moseley

Recent work in scientific machine learning has developed so-called physics-informed neural network (PINN) models. The typical approach is to incorporate physical domain knowledge as soft constraints on an empirical loss function and use…

Machine Learning · Computer Science 2021-11-12 Aditi S. Krishnapriyan , Amir Gholami , Shandian Zhe , Robert M. Kirby , Michael W. Mahoney

Neural networks (NNs) accelerate simulations of quantum dissipative dynamics. Ensuring that these simulations adhere to fundamental physical laws is crucial, but has been largely ignored in the state-of-the-art NN approaches. We show that…

Chemical Physics · Physics 2024-09-06 Arif Ullah , Yu Huang , Ming Yang , Pavlo O. Dral

Physics-Informed Neural Networks (PINNs) are Neural Network architectures trained to emulate solutions of differential equations without the necessity of solution data. They are currently ubiquitous in the scientific literature due to their…

Machine Learning · Computer Science 2023-08-25 Andrea Bonfanti , Roberto Santana , Marco Ellero , Babak Gholami