English
Related papers

Related papers: Challenges in Training PINNs: A Loss Landscape Per…

200 papers

Physics-informed neural networks (PINNs) have emerged as a new learning paradigm for solving partial differential equations (PDEs) by enforcing the constraints of physical equations, boundary conditions (BCs), and initial conditions (ICs)…

Machine Learning · Computer Science 2025-05-21 Chenhong Zhou , Jie Chen , Zaifeng Yang , Ching Eng Png

While Physics-Informed Neural Networks (PINNs) are powerful for solving Partial Differential Equations (PDEs), their training is often paralyzed by gradient pathology. The gradients from the PDE residuals and boundary constraints oppose…

Machine Learning · Computer Science 2026-05-26 Yichen Luo , Peiyu Zhu , Dongxiao Hu , Jia Wang , Tailin Wu , Dapeng Lan , Yu Liu , Zhibo Pang

A physics-informed neural network (PINN) uses physics-augmented loss functions, e.g., incorporating the residual term from governing partial differential equations (PDEs), to ensure its output is consistent with fundamental physics laws.…

Machine Learning · Computer Science 2022-12-16 Jian Cheng Wong , Chinchun Ooi , Abhishek Gupta , Yew-Soon Ong

Physics-Informed Neural Networks (PINNs) have revolutionized the computation of PDE solutions by integrating partial differential equations (PDEs) into the neural network's training process as soft constraints, becoming an important…

Machine Learning · Computer Science 2026-02-10 Elham Kiyani , Khemraj Shukla , Jorge F. Urbán , Jérôme Darbon , George Em Karniadakis

Solving time-dependent Partial Differential Equations (PDEs) is one of the most critical problems in computational science. While Physics-Informed Neural Networks (PINNs) offer a promising framework for approximating PDE solutions, their…

Physics-informed neural networks (PINNs) have emerged as promising surrogate modes for solving partial differential equations (PDEs). Their effectiveness lies in the ability to capture solution-related features through neural networks.…

Machine Learning · Computer Science 2023-07-13 Junjun Yan , Xinhai Chen , Zhichao Wang , Enqiang Zhou , Jie Liu

"AI for Science" aims to solve fundamental scientific problems using AI techniques. As most physical phenomena can be described as Partial Differential Equations (PDEs) , approximating their solutions using neural networks has evolved as a…

Machine Learning · Computer Science 2024-07-31 Mohan Ren , Zhihao Fang , Keren Li , Anirbit Mukherjee

Physics-informed neural networks (PINNs) are a versatile tool in the burgeoning field of scientific machine learning for solving partial differential equations (PDEs). However, determining suitable training strategies for them is not…

Numerical Analysis · Mathematics 2026-03-09 Saad Qadeer , Panos Stinis

Physics-informed neural networks (PINNs) are extensively employed to solve partial differential equations (PDEs) by ensuring that the outputs and gradients of deep learning models adhere to the governing equations. However, constrained by…

Machine Learning · Computer Science 2025-07-21 Chenhao Si , Ming Yan

In this paper, we investigate the behavior of gradient descent algorithms in physics-informed machine learning methods like PINNs, which minimize residuals connected to partial differential equations (PDEs). Our key result is that the…

Machine Learning · Computer Science 2024-05-06 Tim De Ryck , Florent Bonnet , Siddhartha Mishra , Emmanuel de Bézenac

Recent work in scientific machine learning has developed so-called physics-informed neural network (PINN) models. The typical approach is to incorporate physical domain knowledge as soft constraints on an empirical loss function and use…

Machine Learning · Computer Science 2021-11-12 Aditi S. Krishnapriyan , Amir Gholami , Shandian Zhe , Robert M. Kirby , Michael W. Mahoney

Physics-informed neural networks (PINNs) provide a flexible framework for solving forward and inverse problems governed by partial differential equations (PDEs), but standard PINN training typically relies on soft penalty formulations that…

Machine Learning · Computer Science 2026-05-12 Binghang Lu , Runyu Zhang , Changhong Mou , Na Li , Guang Lin

Physics-informed neural networks (PINNs) have gained prominence in recent years and are now effectively used in a number of applications. However, their performance remains unstable due to the complex landscape of the loss function. To…

Machine Learning · Computer Science 2025-09-30 Dmitry Bylinkin , Mikhail Aleksandrov , Savelii Chezhegov , Aleksandr Beznosikov

The loss functions of many learning problems contain multiple additive terms that can disagree and yield conflicting update directions. For Physics-Informed Neural Networks (PINNs), loss terms on initial/boundary conditions and physics…

Machine Learning · Computer Science 2025-03-25 Qiang Liu , Mengyu Chu , Nils Thuerey

The concepts and techniques of physics-informed neural networks (PINNs) is studied and limitations are identified to make it efficient to approximate dynamical equations. Potential working research domains are explored for increasing the…

Computational Physics · Physics 2023-01-13 Siddharth Rout

Deep learning models trained on finite data lack a complete understanding of the physical world. On the other hand, physics-informed neural networks (PINNs) are infused with such knowledge through the incorporation of mathematically…

Neural and Evolutionary Computing · Computer Science 2026-02-23 Jian Cheng Wong , Abhishek Gupta , Chin Chun Ooi , Pao-Hsiung Chiu , Jiao Liu , Yew-Soon Ong

Physics-Informed Neural Networks (PINNs) often suffer from slow convergence, training instability, and reduced accuracy on challenging partial differential equations due to the anisotropic and rapidly varying geometry of their loss…

Machine Learning · Computer Science 2026-04-20 Kang An , Chenhao Si , Shiqian Ma , Ming Yan

Physics-informed neural networks (PINNs) have recently received much attention due to their capabilities in solving both forward and inverse problems. For training a deep neural network associated with a PINN, one typically constructs a…

Machine Learning · Computer Science 2022-08-26 Pouyan Nasiri , Roozbeh Dargazany

In the recent years, Physics Informed Neural Networks (PINNs) have received strong interest as a method to solve PDE driven systems, in particular for data assimilation purpose. This method is still in its infancy, with many shortcomings…

Machine Learning · Computer Science 2025-03-20 Nilo Schwencke , Cyril Furtlehner

Deep learning has been shown to be an effective tool in solving partial differential equations (PDEs) through physics-informed neural networks (PINNs). PINNs embed the PDE residual into the loss function of the neural network, and have been…

Machine Learning · Computer Science 2022-04-06 Jeremy Yu , Lu Lu , Xuhui Meng , George Em Karniadakis