English
Related papers

Related papers: PDE-aware Optimizer for Physics-informed Neural Ne…

200 papers

In this paper, we show a physics-informed neural network solver for the time-dependent surface PDEs. Unlike the traditional numerical solver, no extension of PDE and mesh on the surface is needed. We show a simplified prior estimate of the…

Machine Learning · Computer Science 2021-03-26 Zhiwei Fang , Justin Zhang , Xiu Yang

Physics-informed neural networks (PINNs) have attracted significant attention for solving partial differential equations (PDEs) in recent years because they alleviate the curse of dimensionality that appears in traditional methods. However,…

Machine Learning · Computer Science 2024-03-15 Yihang Gao , Ka Chun Cheung , Michael K. Ng

Physics Informed Neural Networks (PINNs) are shown to be a promising method for the approximation of Partial Differential Equations (PDEs). PINNs approximate the PDE solution by minimizing physics-based loss functions over a given domain.…

Numerical Analysis · Mathematics 2022-09-13 Shoaib Goraya , Nahil Sobh , Arif Masud

In the past, we have presented a systematic computational framework for analyzing self-similar and traveling wave dynamics in nonlinear partial differential equations (PDEs) by dynamically factoring out continuous symmetries such as…

Partial differential equation (PDE)-constrained optimization arises in many scientific and engineering domains, such as energy systems, fluid dynamics and material design. In these problems, the decision variables (e.g., control inputs or…

Machine Learning · Computer Science 2026-01-21 Yusuf Guven , Vincenzo Di Vito , Ferdinando Fioretto

While Physics-Informed Neural Networks (PINNs) are powerful for solving Partial Differential Equations (PDEs), their training is often paralyzed by gradient pathology. The gradients from the PDE residuals and boundary constraints oppose…

Machine Learning · Computer Science 2026-05-26 Yichen Luo , Peiyu Zhu , Dongxiao Hu , Jia Wang , Tailin Wu , Dapeng Lan , Yu Liu , Zhibo Pang

A significant advancement in Neural Network (NN) research is the integration of domain-specific knowledge through custom loss functions. This approach addresses a crucial challenge: how can models utilize physics or mathematical principles…

Machine Learning · Computer Science 2025-03-27 Seyedeh Azadeh Fallah Mortezanejad , Ruochen Wang , Ali Mohammad-Djafari

Neural networks are universal approximators and are studied for their use in solving differential equations. However, a major criticism is the lack of error bounds for obtained solutions. This paper proposes a technique to rigorously…

Computational Engineering, Finance, and Science · Computer Science 2023-06-07 Shuheng Liu , Xiyue Huang , Pavlos Protopapas

Physics-informed neural networks (PINNs) incorporate physical knowledge from the problem domain as a soft constraint on the loss function, but recent work has shown that this can lead to optimization difficulties. Here, we study the impact…

Machine Learning · Computer Science 2022-07-12 Shashank Subramanian , Robert M. Kirby , Michael W. Mahoney , Amir Gholami

We present a novel framework combining Deep Operator Networks (DeepONets) with Physics-Informed Neural Networks (PINNs) to solve partial differential equations (PDEs) and estimate their unknown parameters. By integrating data-driven…

Machine Learning · Computer Science 2025-08-05 Amogh Raj , Carol Eunice Gudumotou , Sakol Bun , Keerthana Srinivasa , Arash Sarshar

Compared to purely data-driven methods, a key feature of physics-informed neural networks (PINNs) - a proven powerful tool for solving partial differential equations (PDEs) - is the embedding of PDE constraints into the loss function. The…

Computational Physics · Physics 2024-09-04 Shuning Lin , Yong Chen

We present a new data-driven reduced-order modeling approach to efficiently solve parametrized partial differential equations (PDEs) for many-query problems. This work is inspired by the concept of implicit neural representation (INR),…

Numerical Analysis · Mathematics 2023-11-30 Tianshu Wen , Kookjin Lee , Youngsoo Choi

Physics-informed neural networks (PINNs) have recently emerged as promising data-driven PDE solvers showing encouraging results on various PDEs. However, there is a fundamental limitation of training PINNs to solve multi-dimensional PDEs…

Machine Learning · Computer Science 2023-11-01 Junwoo Cho , Seungtae Nam , Hyunmo Yang , Seok-Bae Yun , Youngjoon Hong , Eunbyung Park

Deep learning based approaches like Physics-informed neural networks (PINNs) and DeepONets have shown promise on solving PDE constrained optimization (PDECO) problems. However, existing methods are insufficient to handle those PDE…

Machine Learning · Computer Science 2023-04-12 Zhongkai Hao , Chengyang Ying , Hang Su , Jun Zhu , Jian Song , Ze Cheng

Physics-informed neural networks (PINNs) have proven a suitable mathematical scaffold for solving inverse ordinary (ODE) and partial differential equations (PDE). Typical inverse PINNs are formulated as soft-constrained multi-objective…

Machine Learning · Computer Science 2023-04-17 Gabriel S. Gusmão , Andrew J. Medford

We present pseudo-differential enhanced physics-informed neural networks (PINNs), an extension of gradient enhancement but in Fourier space. Gradient enhancement of PINNs dictates that the PDE residual is taken to a higher differential…

Machine Learning · Computer Science 2026-05-06 Andrew Gracyk

In this paper, we develop a new optimization framework for the least squares learning problem via fully connected neural networks or physics-informed neural networks. The gradient descent sometimes behaves inefficiently in deep learning…

Machine Learning · Computer Science 2025-05-01 Yaru Liu , Yiqi Gu , Michael K. Ng

Physics informed neural networks (PINNs) are deep learning based techniques for solving partial differential equations (PDEs) encounted in computational science and engineering. Guided by data and physical laws, PINNs find a neural network…

Numerical Analysis · Mathematics 2020-12-30 Yeonjong Shin , Jerome Darbon , George Em Karniadakis

Physics informed neural network (PINN) based solution methods for differential equations have recently shown success in a variety of scientific computing applications. Several authors have reported difficulties, however, when using PINNs to…

Numerical Analysis · Mathematics 2023-10-16 Arnav Gangal , Luis Kim , Sean P. Carney

Physics-informed neural networks (PINNs) have recently emerged as a promising way to compute the solutions of partial differential equations (PDEs) using deep neural networks. However, despite their significant success in various fields, it…

Numerical Analysis · Mathematics 2024-07-15 Seungchan Ko , Sang Hyeon Park