English
Related papers

Related papers: Stability in Training PINNs for Stiff PDEs: Why In…

200 papers

Physics-informed neural networks (PINNs) have gained prominence in recent years and are now effectively used in a number of applications. However, their performance remains unstable due to the complex landscape of the loss function. To…

Machine Learning · Computer Science 2025-09-30 Dmitry Bylinkin , Mikhail Aleksandrov , Savelii Chezhegov , Aleksandr Beznosikov

Stiff differential equations are prevalent in various scientific domains, posing significant challenges due to the disparate time scales of their components. As computational power grows, physics-informed neural networks (PINNs) have led to…

Machine Learning · Computer Science 2025-01-30 Emilien Seiler , Wanzhou Lei , Pavlos Protopapas

Physics-informed neural networks (PINNs) have been popularized as a deep learning framework that can seamlessly synthesize observational data and partial differential equation (PDE) constraints. Their practical effectiveness however can be…

Machine Learning · Computer Science 2023-08-17 Sifan Wang , Shyam Sankaran , Hanwen Wang , Paris Perdikaris

Physics informed neural networks (PINNs) are nowadays used as efficient machine learning methods for solving differential equations. However, vanilla-PINNs fail to learn complex problems as ones involving stiff ordinary differential…

Computational Physics · Physics 2023-04-18 Hubert Baty

Physics-Informed Neural Networks (PINNs) are a class of deep learning neural networks that learn the response of a physical system without any simulation data, and only by incorporating the governing partial differential equations (PDEs) in…

Machine Learning · Computer Science 2023-12-19 Rini J. Gladstone , Mohammad A. Nabian , N. Sukumar , Ankit Srivastava , Hadi Meidani

Physics-informed neural networks (PINNs) have recently emerged as a prominent paradigm for solving partial differential equations (PDEs), yet their training strategies remain underexplored. While hard prioritization methods inspired by…

Machine Learning · Computer Science 2025-12-22 Zhaoqian Gao , Min Yanga

Physics-informed neural networks (PINNs) have recently emerged as a novel and popular approach for solving forward and inverse problems involving partial differential equations (PDEs). However, achieving stable training and obtaining…

Fluid Dynamics · Physics 2024-05-28 Wenbo Cao , Weiwei Zhang

We present a unified theoretical framework for analyzing the stability and consistency of Physics-Informed Neural Networks (PINNs), grounded in operator coercivity, variational formulations, and non-asymptotic perturbation theory. PINNs…

Machine Learning · Computer Science 2025-09-04 Ronald Katende

Recently developed physics-informed neural network (PINN) has achieved success in many science and engineering disciplines by encoding physics laws into the loss functions of the neural network, such that the network not only conforms to…

Numerical Analysis · Mathematics 2021-11-17 Weiqi Ji , Weilun Qiu , Zhiyu Shi , Shaowu Pan , Sili Deng

Physics-Informed Neural Networks (PINNs) encounter significant training difficulties when applied to doubly-clamped beam problems, and the underlying causes are not fully understood. This study investigates the PINN loss landscape to…

Computational Engineering, Finance, and Science · Computer Science 2025-11-26 Thonn Homsnit , Kensuke Kageyama , Tomohisa Kojima

This paper empirically studies commonly observed training difficulties of Physics-Informed Neural Networks (PINNs) on dynamical systems. Our results indicate that fixed points which are inherent to these systems play a key role in the…

Machine Learning · Computer Science 2023-02-14 Franz M. Rohrhofer , Stefan Posch , Clemens Gößnitzer , Bernhard C. Geiger

Physics-informed neural networks (PINNs) have recently emerged as a promising way to compute the solutions of partial differential equations (PDEs) using deep neural networks. However, despite their significant success in various fields, it…

Numerical Analysis · Mathematics 2024-07-15 Seungchan Ko , Sang Hyeon Park

Recent work in scientific machine learning has developed so-called physics-informed neural network (PINN) models. The typical approach is to incorporate physical domain knowledge as soft constraints on an empirical loss function and use…

Machine Learning · Computer Science 2021-11-12 Aditi S. Krishnapriyan , Amir Gholami , Shandian Zhe , Robert M. Kirby , Michael W. Mahoney

Physics-informed neural networks (PINNs) provide a promising machine learning framework for solving partial differential equations, but their training often breaks down on challenging problems, sometimes converging to physically incorrect…

Machine Learning · Computer Science 2026-04-28 Sifan Wang , Shawn Koohy , Yiping Lu , Paris Perdikaris

Physics-informed neural networks (PINNs) leverage neural-networks to find the solutions of partial differential equation (PDE)-constrained optimization problems with initial conditions and boundary conditions as soft constraints. These soft…

Machine Learning · Computer Science 2022-12-09 Rambod Mojgani , Maciej Balajewicz , Pedram Hassanzadeh

Solving time-dependent Partial Differential Equations (PDEs) is one of the most critical problems in computational science. While Physics-Informed Neural Networks (PINNs) offer a promising framework for approximating PDE solutions, their…

It was recently shown that the loss function used for training physics-informed neural networks (PINNs) exhibits local minima at solutions corresponding to fixed points of dynamical systems. In the forward setting, where the PINN is trained…

Machine Learning · Computer Science 2025-09-16 Milos Babic , Franz M. Rohrhofer , Bernhard C. Geiger

Physics-informed neural networks (PINNs) have shown promise in solving various partial differential equations (PDEs). However, training pathologies have negatively affected the convergence and prediction accuracy of PINNs, which further…

Machine Learning · Computer Science 2024-02-02 Songming Liu , Chang Su , Jiachen Yao , Zhongkai Hao , Hang Su , Youjia Wu , Jun Zhu

Physics-Informed Neural Networks (PINNs) often struggle to train reliably on stiff and oscillatory dynamical systems due to poor optimization conditioning. While prior work has emphasized representational remedies such as spectral…

Machine Learning · Computer Science 2026-05-07 Isabela M. Yepes , Pavlos Protopapas

Physics-informed neural networks (PINNs) have recently become a powerful tool for solving partial differential equations (PDEs). However, finding a set of neural network parameters that lead to fulfilling a PDE can be challenging and…

Machine Learning · Computer Science 2023-04-12 Aleksandr Dekhovich , Marcel H. F. Sluiter , David M. J. Tax , Miguel A. Bessa
‹ Prev 1 2 3 10 Next ›