English
Related papers

Related papers: Bi-level Physics-Informed Neural Networks for PDE …

200 papers

Bilevel optimization enjoys a wide range of applications in emerging machine learning and signal processing problems such as hyper-parameter optimization, image reconstruction, meta-learning, adversarial training, and reinforcement…

Machine Learning · Computer Science 2025-01-08 Han Shen , Quan Xiao , Tianyi Chen

Inverse problems arise across scientific and engineering domains, where the goal is to infer hidden parameters or physical fields from indirect and noisy observations. Classical approaches, such as variational regularization and Bayesian…

Machine Learning · Statistics 2025-12-03 Ali Mohammad-Djafari , Ning Chu , Li Wang

The optimization algorithms are crucial in training physics-informed neural networks (PINNs), as unsuitable methods may lead to poor solutions. Compared to the common gradient descent (GD) algorithm, implicit gradient descent (IGD)…

Machine Learning · Computer Science 2025-08-04 Xianliang Xu , Ting Du , Wang Kong , Bin Shan , Ye Li , Zhongyi Huang

Physics-informed neural networks (PINNs) have recently emerged as a popular approach for solving forward and inverse problems involving partial differential equations (PDEs). Compared to fully connected neural networks, PINNs based on…

Numerical Analysis · Mathematics 2025-08-06 Jiahao Song , Wenbo Cao , Weiwei Zhang

Deep neural networks (DNN) have been used to model nonlinear relations between physical quantities. Those DNNs are embedded in physical systems described by partial differential equations (PDE) and trained by minimizing a loss function that…

Numerical Analysis · Mathematics 2020-02-26 Kailai Xu , Eric Darve

Physics Informed Neural Networks (PINNs) have frequently been used for the numerical approximation of Partial Differential Equations (PDEs). The goal of this paper is to construct PINNs along with a computable upper bound of the error,…

Numerical Analysis · Mathematics 2022-12-19 Lewin Ernst , Karsten Urban

Physics-informed neural networks (PINNs) were recently proposed in [1] as an alternative way to solve partial differential equations (PDEs). A neural network (NN) represents the solution while a PDE-induced NN is coupled to the solution NN,…

Computational Physics · Physics 2019-10-22 Xiaoli Chen , Jinqiao Duan , George Em Karniadakis

Physics-Informed Neural Networks (PINNs) are becoming a popular method for solving PDEs, due to their mesh-free nature and their ability to handle high-dimensional problems where traditional numerical solvers often struggle. Despite their…

Numerical Analysis · Mathematics 2025-08-26 Yuzhen Li , Liang Li , Stéphane Lanteri , Bin Li

Despite the great promise of the physics-informed neural networks (PINNs) in solving forward and inverse problems, several technical challenges are present as roadblocks for more complex and realistic applications. First, most existing…

Computational Engineering, Finance, and Science · Computer Science 2022-01-26 Han Gao , Matthew J. Zahr , Jian-Xun Wang

Physics-informed neural networks (PINNs) are an emerging technique to solve partial differential equations (PDEs). In this work, we propose a simple but effective PINN approach for the phase-field model of ferroelectric microstructure…

Materials Science · Physics 2024-09-06 Lan Shang , Sizheng Zheng , Jin Wang , Jie Wang

Physics-informed neural networks (PINNs) have been widely used to develop neural surrogates for solutions of Partial Differential Equations. A drawback of PINNs is that they have to be retrained with every change in initial-boundary…

Machine Learning · Computer Science 2023-08-21 Ritam Majumdar , Vishal Jadhav , Anirudh Deodhar , Shirish Karande , Lovekesh Vig , Venkataramana Runkana

Physics-Informed Neural Networks (PINNs) are a class of deep neural networks that are trained, using automatic differentiation, to compute the response of systems governed by partial differential equations (PDEs). The training of PINNs is…

Machine Learning · Computer Science 2021-04-27 Mohammad Amin Nabian , Rini Jasmine Gladstone , Hadi Meidani

Physics-informed neural networks (PINNs) are known to suffer from optimization difficulty. In this work, we reveal the connection between the optimization difficulty of PINNs and activation functions. Specifically, we show that PINNs…

Machine Learning · Computer Science 2023-11-27 Honghui Wang , Lu Lu , Shiji Song , Gao Huang

Physics-informed neural networks (PINNs) have emerged as promising surrogate modes for solving partial differential equations (PDEs). Their effectiveness lies in the ability to capture solution-related features through neural networks.…

Machine Learning · Computer Science 2023-07-13 Junjun Yan , Xinhai Chen , Zhichao Wang , Enqiang Zhou , Jie Liu

Physics-informed neural networks (PINNs) have received significant attention as a unified framework for forward, inverse, and surrogate modeling of problems governed by partial differential equations (PDEs). Training PINNs for forward…

Machine Learning · Computer Science 2022-06-22 Ehsan Haghighat , Danial Amini , Ruben Juanes

Physics informed neural networks (PINNs) require regularity of solutions of the underlying PDE to guarantee accurate approximation. Consequently, they may fail at approximating discontinuous solutions of PDEs such as nonlinear hyperbolic…

Numerical Analysis · Mathematics 2022-07-19 Tim De Ryck , Siddhartha Mishra , Roberto Molinaro

Many types of physics-informed neural network models have been proposed in recent years as approaches for learning solutions to differential equations. When a particular task requires solving a differential equation at multiple…

Machine Learning · Computer Science 2021-11-02 Filipe de Avila Belbute-Peres , Yi-fan Chen , Fei Sha

Bilevel programs (BPs) find a wide range of applications in fields such as energy, transportation, and machine learning. As compared to BPs with continuous (linear/convex) optimization problems in both levels, the BPs with discrete decision…

Optimization and Control · Mathematics 2024-07-25 Bo Zhou , Ruiwei Jiang , Siqian Shen

Physics-Informed Neural Network (PINN) has proven itself a powerful tool to obtain the numerical solutions of nonlinear partial differential equations (PDEs) leveraging the expressivity of deep neural networks and the computing power of…

Numerical Analysis · Mathematics 2023-06-12 Yanlai Chen , Shawn Koohy

Physics-Informed Neural Networks (PINNs) have emerged as a promising paradigm for solving partial differential equations (PDEs) by embedding physical laws into neural network training objectives. However, their deployment on…

Machine Learning · Computer Science 2025-12-11 Jinming Lu , Jiayi Tian , Yequan Zhao , Hai Li , Zheng Zhang