English
Related papers

Related papers: Challenges in Training PINNs: A Loss Landscape Per…

200 papers

Physics-informed neural networks (PINNs) have emerged as a promising deep learning method, capable of solving forward and inverse problems governed by differential equations. Despite their recent advance, it is widely acknowledged that…

Machine Learning · Computer Science 2024-06-11 Franz M. Rohrhofer , Stefan Posch , Clemens Gößnitzer , Bernhard C. Geiger

We propose to enhance the training of physics-informed neural networks (PINNs). To this aim, we introduce nonlinear additive and multiplicative preconditioning strategies for the widely used L-BFGS optimizer. The nonlinear preconditioners…

Numerical Analysis · Mathematics 2024-04-16 Alena Kopaničáková , Hardik Kothari , George Em Karniadakis , Rolf Krause

Physics-informed neural networks (PINNs) represent a significant advancement in scientific machine learning by integrating fundamental physical laws into their architecture through loss functions. PINNs have been successfully applied to…

Machine Learning · Computer Science 2024-07-16 Wei Zhou , Y. F. Xu

Physics-Informed Neural Networks (PINNs) represent a significant advancement in Scientific Machine Learning (SciML), which integrate physical domain knowledge into an empirical loss function as soft constraints and apply existing machine…

Machine Learning · Computer Science 2024-09-18 Xiaoran Cheng , Sen Na

In this paper, numerical methods using Physics-Informed Neural Networks (PINNs) are presented with the aim to solve higher-order ordinary differential equations (ODEs). Indeed, this deep-learning technique is successfully applied for…

Computational Physics · Physics 2023-07-17 Hubert Baty

For multi-scale problems, the conventional physics-informed neural networks (PINNs) face some challenges in obtaining available predictions. In this paper, based on PINNs, we propose a practical deep learning framework for multi-scale…

Machine Learning · Computer Science 2024-12-18 Yong Wang , Yanzhong Yao , Jiawei Guo , Zhiming Gao

Physics-informed neural networks (PINNs) have emerged as a promising approach to solving partial differential equations (PDEs) using neural networks, particularly in data-scarce scenarios, due to their unsupervised training capability.…

Machine Learning · Computer Science 2025-03-25 Edgar Torres , Jonathan Schiefer , Mathias Niepert

Physics-informed neural networks (PINNs) have recently emerged as a prominent paradigm for solving partial differential equations (PDEs), yet their training strategies remain underexplored. While hard prioritization methods inspired by…

Machine Learning · Computer Science 2025-12-22 Zhaoqian Gao , Min Yanga

Physics-Informed Neural Networks (PINNs) provide a learning-based framework for solving partial differential equations (PDEs) by embedding governing physical laws into neural network training. In practice, however, their performance is…

Machine Learning · Computer Science 2026-01-21 Pancheng Niu , Jun Guo , Qiaolin He , Yongming Chen , Yanchao Shi

Neural networks can be used to learn the solution of partial differential equations (PDEs) on arbitrary domains without requiring a computational mesh. Common approaches integrate differential operators in training neural networks using a…

Machine Learning · Computer Science 2022-07-07 Shamsulhaq Basir , Inanc Senocak

Physics-informed neural networks (PINNs) provide a means of obtaining approximate solutions of partial differential equations and systems through the minimisation of an objective function which includes the evaluation of a residual function…

Machine Learning · Computer Science 2024-10-08 Jose Florido , He Wang , Amirul Khan , Peter K. Jimack

Learning the solution of partial differential equations (PDEs) with a neural network is an attractive alternative to traditional solvers due to its elegance, greater flexibility and the ease of incorporating observed data. However, training…

Machine Learning · Computer Science 2024-07-18 Katsiaryna Haitsiukevich , Alexander Ilin

In this study, novel physics-informed neural network (PINN) methods for coupling neighboring support points and their derivative terms which are obtained by automatic differentiation (AD), are proposed to allow efficient training with…

Machine Learning · Computer Science 2022-12-16 Pao-Hsiung Chiu , Jian Cheng Wong , Chinchun Ooi , My Ha Dao , Yew-Soon Ong

Physics informed neural networks (PINNs) are nowadays used as efficient machine learning methods for solving differential equations. However, vanilla-PINNs fail to learn complex problems as ones involving stiff ordinary differential…

Computational Physics · Physics 2023-04-18 Hubert Baty

The Physics-Informed Neural Network (PINN) approach is a new and promising way to solve partial differential equations using deep learning. The $L^2$ Physics-Informed Loss is the de-facto standard in training Physics-Informed Neural…

Machine Learning · Computer Science 2023-01-02 Chuwei Wang , Shanda Li , Di He , Liwei Wang

Physics-Informed Neural Networks (PINNs) have been recognized as a mesh-free alternative to solve partial differential equations where physics information is incorporated. However, in dealing with problems characterized by high stiffness or…

Machine Learning · Computer Science 2026-03-04 Divyavardhan Singh , Shubham Kamble , Dimple Sonone , Kishor Upla

Physics-informed neural networks (PINNs) have been popularized as a deep learning framework that can seamlessly synthesize observational data and partial differential equation (PDE) constraints. Their practical effectiveness however can be…

Machine Learning · Computer Science 2023-08-17 Sifan Wang , Shyam Sankaran , Hanwen Wang , Paris Perdikaris

Physics-informed neural networks (PINNs) are a newly emerging research frontier in machine learning, which incorporate certain physical laws that govern a given data set, e.g., those described by partial differential equations (PDEs), into…

Neural and Evolutionary Computing · Computer Science 2023-07-11 Bo Wang , A. K. Qin , Sajjad Shafiei , Hussein Dia , Adriana-Simona Mihaita , Hanna Grzybowska

While the popularity of physics-informed neural networks (PINNs) is steadily rising, to this date, PINNs have not been successful in simulating multi-scale and singular perturbation problems. In this work, we present a new training paradigm…

Machine Learning · Computer Science 2024-03-27 Zhiwei Fang , Sifan Wang , Paris Perdikaris

We develop improved physics-informed neural networks (PINNs) for high-order and high-dimensional power system models described by nonlinear ordinary differential equations. We propose some novel enhancements to improve PINN training and…

Machine Learning · Computer Science 2024-10-11 Vineet Jagadeesan Nair