English
Related papers

Related papers: Gradient Scaling Effects in Adaptive Spectral PINN…

200 papers

In this paper, we present the adaptive physics-informed neural networks (PINNs) for resolving three dimensional (3D) dynamic thermo-mechanical coupling problems in large-size-ratio functionally graded materials (FGMs). The physical laws…

Computational Engineering, Finance, and Science · Computer Science 2023-06-16 Lin Qiu , Yanjie Wang , Tian He , Yan Gu , Fajie Wang

Physics-Informed Neural Networks (PINNs) have emerged recently as a promising application of deep neural networks to the numerical solution of nonlinear partial differential equations (PDEs). However, it has been recognized that adaptive…

Machine Learning · Computer Science 2024-06-21 Levi McClenny , Ulisses Braga-Neto

Physics-informed neural networks (PINNs) have recently emerged as effective methods for solving partial differential equations (PDEs) in various problems. Substantial research focuses on the failure modes of PINNs due to their frequent…

Machine Learning · Computer Science 2024-10-01 Yesom Park , Changhoon Song , Myungjoo Kang

Physics informed neural network (PINN) based solution methods for differential equations have recently shown success in a variety of scientific computing applications. Several authors have reported difficulties, however, when using PINNs to…

Numerical Analysis · Mathematics 2023-10-16 Arnav Gangal , Luis Kim , Sean P. Carney

Driven by the need for more efficient and seamless integration of physical models and data, physics-informed neural networks (PINNs) have seen a surge of interest in recent years. However, ensuring the reliability of their convergence and…

Machine Learning · Computer Science 2023-07-04 Sokratis J. Anagnostopoulos , Juan Diego Toscano , Nikolaos Stergiopulos , George Em Karniadakis

Physics-informed neural networks (PINNs) have gained prominence in recent years and are now effectively used in a number of applications. However, their performance remains unstable due to the complex landscape of the loss function. To…

Machine Learning · Computer Science 2025-09-30 Dmitry Bylinkin , Mikhail Aleksandrov , Savelii Chezhegov , Aleksandr Beznosikov

Brain-inspired spiking neural networks (SNNs) are recognized as a promising avenue for achieving efficient, low-energy neuromorphic computing. Recent advancements have focused on directly training high-performance SNNs by estimating the…

Neural and Evolutionary Computing · Computer Science 2025-05-20 Jiaqiang Jiang , Lei Wang , Runhao Jiang , Jing Fan , Rui Yan

Physics-Informed Neural Networks (PINNs) are becoming a popular method for solving PDEs, due to their mesh-free nature and their ability to handle high-dimensional problems where traditional numerical solvers often struggle. Despite their…

Numerical Analysis · Mathematics 2025-08-26 Yuzhen Li , Liang Li , Stéphane Lanteri , Bin Li

In the context of over-parameterization, there is a line of work demonstrating that randomly initialized (stochastic) gradient descent (GD) converges to a globally optimal solution at a linear convergence rate for the quadratic loss…

Machine Learning · Computer Science 2025-06-16 Xianliang Xu , Ting Du , Wang Kong , Bin Shan , Ye Li , Zhongyi Huang

Physics-informed neural networks (PINNs) provide a promising framework for solving inverse problems governed by partial differential equations (PDEs) by integrating observational data and physical constraints in a unified optimization…

Machine Learning · Computer Science 2026-04-07 Yongsheng Chen , Yong Chen , Wei Guo , Xinghui Zhong

Physics-Informed Neural Networks (PINNs) have emerged as a powerful, mesh-free paradigm for solving partial differential equations (PDEs). However, they notoriously struggle with stiff, multi-scale, and nonlinear systems due to the inherent…

Machine Learning · Computer Science 2026-03-24 Julian Evan Chrisnanto , Nurfauzi Fadillah , Yulison Herry Chrisnanto

Physics-informed neural networks (PINNs) have been proven as a promising way for solving various partial differential equations, especially high-dimensional ones and those with irregular boundaries. However, their capabilities in real…

Dynamical Systems · Mathematics 2026-03-27 Guojie Li , Wuyue Yang , Liu Hong

This work addresses the accurate and efficient simulation of physical phenomena governed by parametric Partial Differential Equations (PDEs) characterized by varying boundary conditions, where parametric instances modify not only the…

Numerical Analysis · Mathematics 2026-03-10 Francesco Della Santa , Sandra Pieraccini , Maria Strazzullo

Gradient-based optimization of neural differential equations and other parameterized dynamical systems fundamentally relies on the ability to differentiate numerical solutions with respect to model parameters. In stiff systems, it has been…

Machine Learning · Computer Science 2025-08-05 Colby Fronk , Linda Petzold

Understanding the asymptotic behavior of gradient-descent training of deep neural networks is essential for revealing inductive biases and improving network performance. We derive the infinite-time training limit of a mathematically…

Machine Learning · Statistics 2022-02-08 Samuel Lippl , L. F. Abbott , SueYeon Chung

In many scientific and engineering (e.g., physical, biochemical, medical) practices, data generated through expensive experiments or large-scale simulations, are often sparse and noisy. Physics-informed neural network (PINN) incorporates…

Machine Learning · Computer Science 2025-10-21 Kai-liang Lu

Implicit Neural Representations (INRs) have recently shown impressive results, but their fundamental capacity, implicit biases, and scaling behavior remain poorly understood. We investigate the performance of diverse INRs across a suite of…

Image and Video Processing · Electrical Eng. & Systems 2025-10-27 Namhoon Kim , Sara Fridovich-Keil

Deep learning based approaches like Physics-informed neural networks (PINNs) and DeepONets have shown promise on solving PDE constrained optimization (PDECO) problems. However, existing methods are insufficient to handle those PDE…

Machine Learning · Computer Science 2023-04-12 Zhongkai Hao , Chengyang Ying , Hang Su , Jun Zhu , Jian Song , Ze Cheng

The concepts and techniques of physics-informed neural networks (PINNs) is studied and limitations are identified to make it efficient to approximate dynamical equations. Potential working research domains are explored for increasing the…

Computational Physics · Physics 2023-01-13 Siddharth Rout

Deep spiking neural networks (SNNs) are promising neural networks for their model capacity from deep neural network architecture and energy efficiency from SNNs' operations. To train deep SNNs, recently, spatio-temporal backpropagation…

Neural and Evolutionary Computing · Computer Science 2023-08-02 Seongsik Park , Jeonghee Jo , Jongkil Park , Yeonjoo Jeong , Jaewook Kim , Suyoun Lee , Joon Young Kwak , Inho Kim , Jong-Keuk Park , Kyeong Seok Lee , Gye Weon Hwang , Hyun Jae Jang