English
Related papers

Related papers: Challenges in Training PINNs: A Loss Landscape Per…

200 papers

Physics-informed neural networks (PINNs) have attracted a lot of attention in scientific computing as their functional representation of partial differential equation (PDE) solutions offers flexibility and accuracy features. However, their…

Machine Learning · Computer Science 2024-01-17 Xinquan Huang , Tariq Alkhalifah

Physics-informed neural networks based on automatic differentiation (AD-PINNs) and their finite-difference counterparts (FD-PINNs) are widely used for solving partial differential equations (PDEs), yet their analytical properties remain…

Numerical Analysis · Mathematics 2026-01-13 Andreas Langer

The best performing Binary Neural Networks (BNNs) are usually attained using Adam optimization and its multi-step training variants. However, to the best of our knowledge, few studies explore the fundamental reasons why Adam is superior to…

Machine Learning · Computer Science 2021-06-22 Zechun Liu , Zhiqiang Shen , Shichao Li , Koen Helwegen , Dong Huang , Kwang-Ting Cheng

We introduce NewPINNs, a physics-informing learning framework that couples neural networks with conventional numerical solvers for solving differential equations. Rather than enforcing governing equations and boundary conditions through…

Machine Learning · Computer Science 2026-01-27 Maedeh Makki , Satish Chandran , Maziar Raissi , Adrien Grenier , Behzad Mohebbi

Differential equations are indispensable to engineering and hence to innovation. In recent years, physics-informed neural networks (PINN) have emerged as a novel method for solving differential equations. PINN method has the advantage of…

Computational Engineering, Finance, and Science · Computer Science 2022-01-07 Mayank Raj , Pramod Kumbhar , Ratna Kumar Annabattula

Whilst the partial differential equations that govern the dynamics of our world have been studied in great depth for centuries, solving them for complex, high-dimensional conditions and domains still presents an incredibly large…

Machine Learning · Computer Science 2023-03-07 Edward Small

Interest is rising in Physics-Informed Neural Networks (PINNs) as a mesh-free alternative to traditional numerical solvers for partial differential equations (PDEs). However, PINNs often struggle to learn high-frequency and multi-scale…

Machine Learning · Computer Science 2025-02-25 Madison Cooley , Varun Shankar , Robert M. Kirby , Shandian Zhe

Physics-informed neural networks (PINNs) are a promising approach for solving partial differential equations (PDEs). Their training, however, is often difficult because multiple loss terms induced by PDE residuals and boundary or initial…

Machine Learning · Computer Science 2026-05-12 Hoyeol Yoon , Seoungbin Bae , Nam Ho-Nguyen , Dabeen Lee

Physics-Informed Neural Networks (PINNs) have emerged as a powerful framework for solving partial differential equations (PDEs). However, their performance heavily relies on the strategy used to select training points. Conventional adaptive…

Machine Learning · Computer Science 2025-04-18 Zhenao Song

Multiscale problems are challenging for neural network-based discretizations of differential equations, such as physics-informed neural networks (PINNs). This can be (partly) attributed to the so-called spectral bias of neural networks. To…

Numerical Analysis · Mathematics 2024-06-07 Alexander Heinlein , Amanda A. Howard , Damien Beecroft , Panos Stinis

Physics-informed neural networks (PINNs) are an increasingly powerful way to solve partial differential equations, generate digital twins, and create neural surrogates of physical models. In this manuscript we detail the inner workings of…

Physics-informed neural networks (PINNs) have recently become a popular method for solving forward and inverse problems governed by partial differential equations (PDEs). By incorporating the residual of the PDE into the loss function of a…

Optimization and Control · Mathematics 2022-11-07 Saviz Mowlavi , Saleh Nabi

Physics-Informed Neural Networks (PINNs) offer a promising approach to solving differential equations and, more generally, to applying deep learning to problems in the physical sciences. We adopt a recently developed transfer learning…

Machine Learning · Computer Science 2022-11-02 Raphaël Pellegrin , Blake Bullwinkel , Marios Mattheakis , Pavlos Protopapas

In various engineering and applied science applications, repetitive numerical simulations of partial differential equations (PDEs) for varying input parameters are often required (e.g., aircraft shape optimization over many design…

Machine Learning · Computer Science 2023-10-17 Woojin Cho , Kookjin Lee , Donsub Rim , Noseong Park

In recent engineering applications using deep learning, physics-informed neural network (PINN) is a new development as it can exploit the underlying physics of engineering systems. The novelty of PINN lies in the use of partial differential…

Computational Engineering, Finance, and Science · Computer Science 2026-02-26 Kart Leong Lim , Rahul Dutta , Mihai Rotaru

With growing investigations into solving partial differential equations by physics-informed neural networks (PINNs), more accurate and efficient PINNs are required to meet the practical demands of scientific computing. One bottleneck of…

Machine Learning · Computer Science 2025-10-29 Tianchi Yu , Yiming Qi , Ivan Oseledets , Shiyi Chen

Physics Informed Neural Networks (PINNs) is a promising application of deep learning. The smooth architecture of a fully connected neural network is appropriate for finding the solutions of PDEs; the corresponding loss function can also be…

Numerical Analysis · Mathematics 2021-12-09 Hwijae Son , Jin Woo Jang , Woo Jin Han , Hyung Ju Hwang

Physics-informed Neural Networks (PINNs) have been shown to be effective in solving partial differential equations by capturing the physics induced constraints as a part of the training loss function. This paper shows that a PINN can be…

Machine Learning · Computer Science 2023-05-08 Chandrajit Bajaj , Luke McLennan , Timothy Andeen , Avik Roy

Physics-Informed Neural Networks (PINNs) have become a kind of attractive machine learning method for obtaining solutions of partial differential equations (PDEs). Training PINNs can be seen as a semi-supervised learning task, in which only…

Machine Learning · Computer Science 2022-10-25 Jia Guo , Haifeng Wang , Chenping Hou

Natural-gradient methods markedly accelerate the training of Physics-Informed Neural Networks (PINNs), yet their Gauss--Newton update must be solved in the parameter space, incurring a prohibitive $O(n^3)$ time complexity, where $n$ is the…

Machine Learning · Computer Science 2025-10-09 Anas Jnini , Flavio Vella