English
Related papers

Related papers: An operator preconditioning perspective on trainin…

200 papers

In this paper, we show a physics-informed neural network solver for the time-dependent surface PDEs. Unlike the traditional numerical solver, no extension of PDE and mesh on the surface is needed. We show a simplified prior estimate of the…

Machine Learning · Computer Science 2021-03-26 Zhiwei Fang , Justin Zhang , Xiu Yang

Deep learning based approaches like Physics-informed neural networks (PINNs) and DeepONets have shown promise on solving PDE constrained optimization (PDECO) problems. However, existing methods are insufficient to handle those PDE…

Machine Learning · Computer Science 2023-04-12 Zhongkai Hao , Chengyang Ying , Hang Su , Jun Zhu , Jian Song , Ze Cheng

Training Physics-Informed Neural Networks (PINNs) on stiff time-dependent PDEs remains highly unstable. Through rigorous ablation studies, we identify a surprisingly critical factor: the enforcement of initial conditions. We present the…

Numerical Analysis · Mathematics 2025-10-09 Baoli Hao , Ulisses Braga-Neto , Chun Liu , Lifan Wang , Ming Zhong

Physics-informed neural networks (PINNs) have emerged as promising surrogate modes for solving partial differential equations (PDEs). Their effectiveness lies in the ability to capture solution-related features through neural networks.…

Machine Learning · Computer Science 2023-07-13 Junjun Yan , Xinhai Chen , Zhichao Wang , Enqiang Zhou , Jie Liu

Physics-informed neural networks (PINNs) are revolutionizing science and engineering practice by bringing together the power of deep learning to bear on scientific computation. In forward modeling problems, PINNs are meshless partial…

Machine Learning · Computer Science 2023-11-28 Yicheng Wang , Xiaotian Han , Chia-Yuan Chang , Daochen Zha , Ulisses Braga-Neto , Xia Hu

Kernel-based approach to operator approximation for partial differential equations has been shown to be unconditionally stable for linear PDEs and numerically exhibit unconditional stability for non-linear PDEs. These methods have the same…

Numerical Analysis · Mathematics 2025-11-25 Andrew Christlieb , Sining Gong , Hyoseon Yang

We investigate the inverse problem for Partial Differential Equations (PDEs) in scenarios where the parameters of the given PDE dynamics may exhibit changepoints at random time. We employ Physics-Informed Neural Networks (PINNs) - universal…

Machine Learning · Statistics 2024-04-03 Zhikang Dong , Pawel Polak

Deep learning models trained on finite data lack a complete understanding of the physical world. On the other hand, physics-informed neural networks (PINNs) are infused with such knowledge through the incorporation of mathematically…

Neural and Evolutionary Computing · Computer Science 2026-02-23 Jian Cheng Wong , Abhishek Gupta , Chin Chun Ooi , Pao-Hsiung Chiu , Jiao Liu , Yew-Soon Ong

Physics-Informed Neural Networks (PINNs), which incorporate PDEs as soft constraints, train with a composite loss function that contains multiple training point types: different types of collocation points chosen during training to enforce…

Machine Learning · Computer Science 2024-04-15 Gregory Kang Ruey Lau , Apivich Hemachandra , See-Kiong Ng , Bryan Kian Hsiang Low

We propose characteristics-informed neural networks (CINN), a simple and efficient machine learning approach for solving forward and inverse problems involving hyperbolic PDEs. Like physics-informed neural networks (PINN), CINN is a…

Machine Learning · Computer Science 2023-01-16 Ulisses Braga-Neto

Neural operators are a type of deep architecture that learns to solve (i.e. learns the nonlinear solution operator of) partial differential equations (PDEs). The current state of the art for these models does not provide explicit…

Machine Learning · Computer Science 2022-08-03 Emilia Magnani , Nicholas Krämer , Runa Eschenhagen , Lorenzo Rosasco , Philipp Hennig

Physics-informed neural network (PINN) is a powerful emerging method for studying forward-inverse problems of partial differential equations (PDEs), even from limited sample data. Variable coefficient PDEs, which model real-world phenomena,…

Computational Physics · Physics 2025-03-07 Hui-Juan Zhou , Yong Chen

Physics-Informed Neural Networks (PINNs) have emerged as a highly active research topic across multiple disciplines in science and engineering, including computational geomechanics. PINNs offer a promising approach in different applications…

Computational Engineering, Finance, and Science · Computer Science 2024-04-30 Yared W. Bekele

A significant advancement in Neural Network (NN) research is the integration of domain-specific knowledge through custom loss functions. This approach addresses a crucial challenge: how can models utilize physics or mathematical principles…

Machine Learning · Computer Science 2025-03-27 Seyedeh Azadeh Fallah Mortezanejad , Ruochen Wang , Ali Mohammad-Djafari

In the recent years, Physics Informed Neural Networks (PINNs) have received strong interest as a method to solve PDE driven systems, in particular for data assimilation purpose. This method is still in its infancy, with many shortcomings…

Machine Learning · Computer Science 2025-03-20 Nilo Schwencke , Cyril Furtlehner

We study physics-informed neural networks (PINNs) as numerical tools for the optimal control of semilinear partial differential equations. We first recall the classical direct and indirect viewpoints for optimal control of PDEs, and then…

Optimization and Control · Mathematics 2026-04-07 Zhen Zhang , Shanqing Liu , Alessandro Alla , Jerome Darbon , George Em Karniadakis

This paper empirically studies commonly observed training difficulties of Physics-Informed Neural Networks (PINNs) on dynamical systems. Our results indicate that fixed points which are inherent to these systems play a key role in the…

Machine Learning · Computer Science 2023-02-14 Franz M. Rohrhofer , Stefan Posch , Clemens Gößnitzer , Bernhard C. Geiger

Traffic state estimation (TSE) fundamentally involves solving high-dimensional spatiotemporal partial differential equations (PDEs) governing traffic flow dynamics from limited, noisy measurements. While Physics-Informed Neural Networks…

Machine Learning · Computer Science 2025-08-19 Zhihao Li , Ting Wang , Guojian Zou , Ruofei Wang , Ye Li

Many physical and engineering systems require solving direct problems to predict behavior and inverse problems to determine unknown parameters from measurement. In this work, we study both aspects for systems governed by differential…

Numerical Analysis · Mathematics 2026-03-04 Noura Al Helwani , Sophie Moufawad , Georges Sakr

In the context of training neural network-based approximations of solutions of parameter-dependent PDEs, we investigate the effect of preconditioning via well-conditioned frame representations of operators and demonstrate a significant…

Numerical Analysis · Mathematics 2026-02-02 Markus Bachmayr , Wolfgang Dahmen , Chenguang Duan , Mathias Oster