English
Related papers

Related papers: Challenges in Training PINNs: A Loss Landscape Per…

200 papers

Physics-Informed Neural Networks have shown unique utility in parameterising the solution of a well-defined partial differential equation using automatic differentiation and residual losses. Though they provide theoretical guarantees of…

Machine Learning · Computer Science 2022-05-17 Vignesh Gopakumar , Stanislas Pamela , Debasmita Samaddar

Physics-informed neural networks (PINNs) are powerful surrogates for differential equations but are notoriously difficult to train due to spectral bias, stiffness, and poor accuracy on high-frequency or multiscale solutions. Adversarial…

Machine Learning · Computer Science 2026-05-18 Yuan-dong Cao , Chi Chiu SO , Jun-Min Wang , He Wang

Physics-Informed Neural Networks (PINNs) have emerged as a powerful tool for integrating physics-based constraints and data to address forward and inverse problems in machine learning. Despite their potential, the implementation of PINNs…

Optimization and Control · Mathematics 2024-12-19 Alan Williams , Christopher Leon , Alexander Scheinker

Physics-informed neural networks (PINNs) have emerged as a prominent approach for solving partial differential equations (PDEs) by minimizing a combined loss function that incorporates both boundary loss and PDE residual loss. Despite their…

Machine Learning · Computer Science 2025-01-16 Youngsik Hwang , Dong-Young Lim

This paper empirically studies commonly observed training difficulties of Physics-Informed Neural Networks (PINNs) on dynamical systems. Our results indicate that fixed points which are inherent to these systems play a key role in the…

Machine Learning · Computer Science 2023-02-14 Franz M. Rohrhofer , Stefan Posch , Clemens Gößnitzer , Bernhard C. Geiger

Physics-Informed Neural Networks (PINNs) are regarded as state-of-the-art tools for addressing highly nonlinear problems based on partial differential equations. Despite their broad range of applications, PINNs encounter several performance…

Machine Learning · Computer Science 2024-09-06 Jamshaid Ul Rahman , Nimra

This paper explores the difficulties in solving partial differential equations (PDEs) using physics-informed neural networks (PINNs). PINNs use physics as a regularization term in the objective function. However, a drawback of this approach…

Machine Learning · Computer Science 2023-06-21 Shamsulhaq Basir

A method is presented that allows to reduce a problem described by differential equations with initial and boundary conditions to the problem described only by differential equations. The advantage of using the modified problem for…

This paper presents NSGA-PINN, a multi-objective optimization framework for effective training of Physics-Informed Neural Networks (PINNs). The proposed framework uses the Non-dominated Sorting Genetic Algorithm (NSGA-II) to enable…

Machine Learning · Computer Science 2023-03-08 Binghang Lu , Christian B. Moya , Guang Lin

Physics-Informed Neural Networks (PINNs) have become a prominent application of deep learning in scientific computation, as they are powerful approximators of solutions to nonlinear partial differential equations (PDEs). There have been…

Machine Learning · Computer Science 2023-06-01 Hwijae Son , Sung Woong Cho , Hyung Ju Hwang

This work presents an algorithm for training Neural Networks where the loss function can be decomposed into two non-negative terms to be minimized. The proposed method is an adaptation of Inexact Restoration algorithms, constituting a…

Optimization and Control · Mathematics 2024-09-12 Dimary Moreno López

Physics-informed Neural Networks (PINNs) have recently achieved remarkable progress in solving Partial Differential Equations (PDEs) in various fields by minimizing a weighted sum of PDE loss and boundary loss. However, there are several…

Machine Learning · Computer Science 2023-06-06 Jiachen Yao , Chang Su , Zhongkai Hao , Songming Liu , Hang Su , Jun Zhu

The residual loss in Physics-Informed Neural Networks (PINNs) alters the simple recursive relation of layers in a feed-forward neural network by applying a differential operator, resulting in a loss landscape that is inherently different…

Machine Learning · Computer Science 2024-06-14 Nima Hosseini Dashtbayaz , Ghazal Farhani , Boyu Wang , Charles X. Ling

This study investigates the potential accuracy boundaries of physics-informed neural networks, contrasting their approach with previous similar works and traditional numerical methods. We find that selecting improved optimization algorithms…

Computational Physics · Physics 2024-12-16 Jorge F. Urbán , Petros Stefanou , José A. Pons

Physics-informed neural networks (PINNs) have recently emerged as a novel and popular approach for solving forward and inverse problems involving partial differential equations (PDEs). However, achieving stable training and obtaining…

Fluid Dynamics · Physics 2024-05-28 Wenbo Cao , Weiwei Zhang

Physics-Informed Neural Networks (PINNs) encounter significant training difficulties when applied to doubly-clamped beam problems, and the underlying causes are not fully understood. This study investigates the PINN loss landscape to…

Computational Engineering, Finance, and Science · Computer Science 2025-11-26 Thonn Homsnit , Kensuke Kageyama , Tomohisa Kojima

Physics-informed neural networks (PINNs) offer a promising avenue for tackling both forward and inverse problems in partial differential equations (PDEs) by incorporating deep learning with fundamental physics principles. Despite their…

Machine Learning · Computer Science 2024-02-06 Hemanth Saratchandran , Shin-Fang Chng , Simon Lucey

Physics-informed neural networks (PINNs) leverage neural-networks to find the solutions of partial differential equation (PDE)-constrained optimization problems with initial conditions and boundary conditions as soft constraints. These soft…

Machine Learning · Computer Science 2022-12-09 Rambod Mojgani , Maciej Balajewicz , Pedram Hassanzadeh

Neural networks can be trained to solve partial differential equations (PDEs) by using the PDE residual as the loss function. This strategy is called "physics-informed neural networks" (PINNs), but it currently cannot produce high-accuracy…

Machine Learning · Computer Science 2024-04-11 Qi Zeng , Yash Kothari , Spencer H. Bryngelson , Florian Schäfer

Physics-informed neural networks (PINNs) have effectively been demonstrated in solving forward and inverse differential equation problems, but they are still trapped in training failures when the target functions to be approximated exhibit…

Machine Learning · Computer Science 2023-03-06 Ye Li , Song-Can Chen , Sheng-Jun Huang
‹ Prev 1 2 3 10 Next ›