English
Related papers

Related papers: Challenges in Training PINNs: A Loss Landscape Per…

200 papers

Addressing high-dimensional partial differential equations to derive effective actions within the functional renormalization group is formidable, especially when considering various field configurations, including inhomogeneous states, even…

Disordered Systems and Neural Networks · Physics 2024-08-05 Takeru Yokota

This work investigates the use of shallow physics-informed neural networks (PINNs) for solving forward and inverse problems of nonlinear partial differential equations (PDEs). By reformulating PINNs as nonlinear systems, the…

Numerical Analysis · Mathematics 2026-02-12 Muhammad Luthfi Shahab , Imam Mukhlash , Hadi Susanto

Recently, a class of machine learning methods called physics-informed neural networks (PINNs) has been proposed and gained prevalence in solving various scientific computing problems. This approach enables the solution of partial…

Computational Engineering, Finance, and Science · Computer Science 2023-11-06 Chen Xu , Ba Trung Cao , Yong Yuan , Günther Meschke

Physics-informed neural networks (PINNs) offer a novel AI-driven framework for integrating physical laws directly into neural network models, facilitating the solution of complex multiphysics problems in materials engineering. This study…

Materials Science · Physics 2025-10-14 Mohid Farooqi , Ingmar Bösing , Conrard G. Tetsassi Feugmo

Physics-Informed Neural Networks (PINNs) have emerged as a promising machine learning approach for solving partial differential equations (PDEs). However, PINNs face significant challenges in balancing multi-objective losses, as multiple…

Computational Engineering, Finance, and Science · Computer Science 2025-10-07 Afrah Farea , Saiful Khan , Mustafa Serdar Celebi

This paper focuses on the PINNs algorithm by proposing the ALM-PINNs computational framework to solve various nonlinear partial differential equations and corresponding parameters identification problems. The numerical solutions obtained by…

Numerical Analysis · Mathematics 2024-10-15 Yimeng Tian , Dinghua Xu

Physics-informed neural networks (PINNs) are a new tool for solving boundary value problems by defining loss functions of neural networks based on governing equations, boundary conditions, and initial conditions. Recent investigations have…

Computational Engineering, Finance, and Science · Computer Science 2023-11-14 Ali Harandi , Ahmad Moeineddin , Michael Kaliske , Stefanie Reese , Shahed Rezaei

Physics-informed neural networks (PINNs) often struggle with multi-scale PDEs featuring sharp gradients and nontrivial boundary conditions, as the physics residual and boundary enforcement compete during optimization. We present a…

Numerical Analysis · Mathematics 2025-12-01 Naseem Abbas , Vittorio Colao , Davide Macri , William Spataro

Efficient and robust optimization is essential for neural networks, enabling scientific machine learning models to converge rapidly to very high accuracy -- faithfully capturing complex physical behavior governed by differential equations.…

Physics-informed neural networks (PINNs) provide a promising framework for solving inverse problems governed by partial differential equations (PDEs) by integrating observational data and physical constraints in a unified optimization…

Machine Learning · Computer Science 2026-04-07 Yongsheng Chen , Yong Chen , Wei Guo , Xinghui Zhong

This short note describes the concept of guided training of deep neural networks (DNNs) to learn physically reasonable solutions. DNNs are being widely used to predict phenomena in physics and mechanics. One of the issues of DNNs is that…

Machine Learning · Computer Science 2023-04-25 Kazuo Yonekura

Parameter estimation remains a challenging task across many areas of engineering. Because data acquisition can often be costly, limited, or prone to inaccuracies (noise, uncertainty) it is crucial to identify sensor configurations that…

Machine Learning · Statistics 2025-11-20 Georgios Venianakis , Constantinos Theodoropoulos , Michail Kavousanakis

Solving inverse problems, such as parameter estimation and optimal control, is a vital part of science. Many experiments repeatedly collect data and rely on machine learning algorithms to quickly infer solutions to the associated inverse…

Machine Learning · Computer Science 2022-10-14 Philipp Holl , Vladlen Koltun , Nils Thuerey

Training physics-informed neural networks (PINNs) for forward problems often suffers from severe convergence issues, hindering the propagation of information from regions where the desired solution is well-defined. Haitsiukevich and Ilin…

Machine Learning · Computer Science 2025-07-03 Kevin Innerebner , Franz M. Rohrhofer , Bernhard C. Geiger

The optimization algorithms are crucial in training physics-informed neural networks (PINNs), as unsuitable methods may lead to poor solutions. Compared to the common gradient descent (GD) algorithm, implicit gradient descent (IGD)…

Machine Learning · Computer Science 2025-08-04 Xianliang Xu , Ting Du , Wang Kong , Bin Shan , Ye Li , Zhongyi Huang

Physics-informed neural networks (PINNs) as a means of discretizing partial differential equations (PDEs) are garnering much attention in the Computational Science and Engineering (CS&E) world. At least two challenges exist for PINNs at…

Computational Physics · Physics 2023-01-23 Michael Penwarden , Shandian Zhe , Akil Narayan , Robert M. Kirby

As a typical application of deep learning, physics-informed neural network (PINN) {has been} successfully used to find numerical solutions of partial differential equations (PDEs), but how to improve the limited accuracy is still a great…

Machine Learning · Computer Science 2022-08-09 Zhi-Yong Zhang , Hui Zhang , Li-Sheng Zhang , Lei-Lei Guo

Learning solutions of partial differential equations (PDEs) with Physics-Informed Neural Networks (PINNs) is an attractive alternative approach to traditional solvers due to its flexibility and ease of incorporating observed data. Despite…

Machine Learning · Computer Science 2022-05-13 Wei Peng , Weien Zhou , Xiaoya Zhang , Wen Yao , Zheliang Liu

This work focuses on the behavior of stochastic gradient descent (SGD) in solving least-squares regression with physics-informed neural networks (PINNs). Past work on this topic has been based on the over-parameterization regime, whose…

Machine Learning · Computer Science 2025-07-23 Zhihan Zeng , Yiqi Gu

Partial differential equations (PDEs) serve as the cornerstone of mathematical physics. In recent years, Physics-Informed Neural Networks (PINNs) have significantly reduced the dependence on large datasets by embedding physical laws…

Machine Learning · Computer Science 2025-06-09 Wenxuan Huo , Qiang He , Gang Zhu , Weifeng Huang