English
Related papers

Related papers: Improved Physics-informed neural networks loss fun…

200 papers

Physics-informed neural networks (PINNs) have been proposed to learn the solution of partial differential equations (PDE). In PINNs, the residual form of the PDE of interest and its boundary conditions are lumped into a composite objective…

Computational Physics · Physics 2022-05-24 Shamsulhaq Basir , Inanc Senocak

Physics-informed neural networks (PINNs) have earned high expectations in solving partial differential equations (PDEs), but their optimization usually faces thorny challenges due to the unique derivative-dependent loss function. By…

Machine Learning · Computer Science 2025-05-20 Haixu Wu , Yuezhou Ma , Hang Zhou , Huikun Weng , Jianmin Wang , Mingsheng Long

Physics-informed neural networks (PINNs) are effective in solving integer-order partial differential equations (PDEs) based on scattered and noisy data. PINNs employ standard feedforward neural networks (NNs) with the PDEs explicitly…

Computational Physics · Physics 2021-11-03 Guofei Pang , Lu Lu , George Em Karniadakis

Physics-informed neural networks (PINNs) have been widely applied to solve partial differential equations (PDEs) by enforcing outputs and gradients of deep models to satisfy target equations. Due to the limitation of numerical computation,…

Machine Learning · Computer Science 2024-10-24 Haixu Wu , Huakun Luo , Yuezhou Ma , Jianmin Wang , Mingsheng Long

The machine learning literature contains several constructions for prediction intervals that are intuitively reasonable but ultimately ad-hoc in that they do not come with provable performance guarantees. We present methods from the…

Machine Learning · Statistics 2020-02-25 Danijel Kivaranovic , Kory D. Johnson , Hannes Leeb

We propose a new loss function for supervised and physics-informed training of neural networks and operators that incorporates a posteriori error estimate. More specifically, during the training stage, the neural network learns additional…

Numerical Analysis · Mathematics 2024-02-09 Vladimir Fanaskov , Alexander Rudikov , Ivan Oseledets

Due to the inherent imbalance in real-world datasets, na\"ive Empirical Risk Minimization (ERM) tends to bias the learning process towards the majority classes, hindering generalization to minority classes. To rebalance the learning…

Machine Learning · Computer Science 2025-12-09 Zitai Wang , Qianqian Xu , Zhiyong Yang , Zhikang Xu , Linchao Zhang , Xiaochun Cao , Qingming Huang

Nowadays, deep learning is the standard approach for a wide range of problems, including biometrics, such as face recognition and speech recognition, etc. Biometric problems often use deep learning models to extract features from images,…

Computer Vision and Pattern Recognition · Computer Science 2022-02-14 Pedro Silva , Gladston Moreira , Vander Freitas , Rodrigo Silva , David Menotti , Eduardo Luz

Physics-informed neural networks (PINNs) have proven to be a promising method for the rapid solving of partial differential equations (PDEs) in both forward and inverse problems. However, due to the smoothness assumption of functions…

Computational Physics · Physics 2026-03-25 Guoqiang Lei , D. Exposito , Xuerui Mao

Advancing loss function design is pivotal for optimizing neural network training and performance. This work introduces Random Linear Projections (RLP) loss, a novel approach that enhances training efficiency by leveraging geometric…

Machine Learning · Computer Science 2024-06-03 Shyam Venkatasubramanian , Ahmed Aloui , Vahid Tarokh

We propose a randomized physics-informed neural network (PINN) or rPINN method for uncertainty quantification in inverse partial differential equation (PDE) problems with noisy data. This method is used to quantify uncertainty in the…

Machine Learning · Computer Science 2024-07-08 Yifei Zong , David Barajas-Solano , Alexandre M. Tartakovsky

We present a novel loss formulation for efficient learning of complex dynamics from governing physics, typically described by partial differential equations (PDEs), using physics-informed neural networks (PINNs). In our experiments,…

Machine Learning · Computer Science 2023-11-01 Jian Cheng Wong , Pao-Hsiung Chiu , Chinchun Ooi , My Ha Dao , Yew-Soon Ong

Regularization and normalization have become indispensable components in training deep neural networks, resulting in faster training and improved generalization performance. We propose the projected error function regularization loss (PER)…

Machine Learning · Computer Science 2020-04-28 Taejong Joo , Donggu Kang , Byunghoon Kim

Many common loss functions such as mean-squared-error, cross-entropy, and reconstruction loss are unnecessarily rigid. Under a probabilistic interpretation, these common losses correspond to distributions with fixed shapes and scales. We…

Machine Learning · Computer Science 2020-10-05 Mark Hamilton , Evan Shelhamer , William T. Freeman

In this paper, we develop a new optimization framework for the least squares learning problem via fully connected neural networks or physics-informed neural networks. The gradient descent sometimes behaves inefficiently in deep learning…

Machine Learning · Computer Science 2025-05-01 Yaru Liu , Yiqi Gu , Michael K. Ng

Physics-informed neural networks (PINNs) provide a promising framework for solving inverse problems governed by partial differential equations (PDEs) by integrating observational data and physical constraints in a unified optimization…

Machine Learning · Computer Science 2026-04-07 Yongsheng Chen , Yong Chen , Wei Guo , Xinghui Zhong

We investigate the use of Physics-Informed Neural Networks (PINNs) for solving the wave equation. Whilst PINNs have been successfully applied across many physical systems, the wave equation presents unique challenges due to the multi-scale,…

Computational Physics · Physics 2020-06-23 Ben Moseley , Andrew Markham , Tarje Nissen-Meyer

This work introduces the Nirenberg Neural Network: a numerical approach to the Nirenberg problem of prescribing Gaussian curvature on $S^2$ for metrics that are pointwise conformal to the round metric. Our mesh-free physics-informed neural…

For decades, solutions to regional scale landslide prediction have mostly relied on data-driven models, by definition, disconnected from the physics of the failure mechanism. The success and spread of such tools came from the ability to…

Geophysics · Physics 2024-12-04 Ashok Dahal , Luigi Lombardo

Physics-informed neural networks (PINNs) have received significant attention as a unified framework for forward, inverse, and surrogate modeling of problems governed by partial differential equations (PDEs). Training PINNs for forward…

Machine Learning · Computer Science 2022-06-22 Ehsan Haghighat , Danial Amini , Ruben Juanes