English
Related papers

Related papers: Implicit Stochastic Gradient Descent for Training …

200 papers

Physics-informed neural networks (PINNs) offer a promising avenue for tackling both forward and inverse problems in partial differential equations (PDEs) by incorporating deep learning with fundamental physics principles. Despite their…

Machine Learning · Computer Science 2024-02-06 Hemanth Saratchandran , Shin-Fang Chng , Simon Lucey

This study investigates the potential accuracy boundaries of physics-informed neural networks, contrasting their approach with previous similar works and traditional numerical methods. We find that selecting improved optimization algorithms…

Computational Physics · Physics 2024-12-16 Jorge F. Urbán , Petros Stefanou , José A. Pons

Multi-task learning through composite loss functions is fundamental to modern deep learning, yet optimizing competing objectives remains challenging. We present new theoretical and practical approaches for addressing directional conflicts…

Machine Learning · Computer Science 2025-09-22 Sifan Wang , Ananyae Kumar Bhartari , Bowen Li , Paris Perdikaris

The Physics-Informed Neural Network (PINN) approach is a new and promising way to solve partial differential equations using deep learning. The $L^2$ Physics-Informed Loss is the de-facto standard in training Physics-Informed Neural…

Machine Learning · Computer Science 2023-01-02 Chuwei Wang , Shanda Li , Di He , Liwei Wang

Physics-Informed Neural Networks (PINNs) often suffer from slow convergence, training instability, and reduced accuracy on challenging partial differential equations due to the anisotropic and rapidly varying geometry of their loss…

Machine Learning · Computer Science 2026-04-20 Kang An , Chenhao Si , Shiqian Ma , Ming Yan

In this work, we study physics-informed neural networks (PINNs) constrained by partial differential equations (PDEs) and their application in approximating PDEs with two characteristic scales. From a continuous perspective, our formulation…

Optimization and Control · Mathematics 2024-09-06 Michael Hintermüller , Denis Korolev

Physics-informed neural networks (PINNs) are an increasingly powerful way to solve partial differential equations, generate digital twins, and create neural surrogates of physical models. In this manuscript we detail the inner workings of…

In this study, we present and validate the predictive capability of the Physics-Informed Neural Networks (PINNs) methodology for solving a variety of engineering and biological dynamical systems governed by ordinary differential equations…

Machine Learning · Computer Science 2025-11-19 Tyrus Whitman , Andrew Particka , Christopher Diers , Ian Griffin , Charuka Wickramasinghe , Pradeep Ranaweera

Natural Gradient Descent (NGD) has emerged as a promising optimization algorithm for training neural network-based solvers for partial differential equations (PDEs), such as Physics-Informed Neural Networks (PINNs). However, its practical…

Numerical Analysis · Mathematics 2026-05-28 Ivan Bioli , Carlo Marcati , Giancarlo Sangalli

We revisit the original approach of using deep learning and neural networks to solve differential equations by incorporating the knowledge of the equation. This is done by adding a dedicated term to the loss function during the optimization…

Machine Learning · Computer Science 2023-04-05 Hubert Baty , Leo Baty

Optimization algorithms are pivotal in advancing various scientific and industrial fields but often encounter obstacles such as trapping in local minima, saddle points, and plateaus (flat regions), which makes the convergence to reasonable…

Optimization and Control · Mathematics 2026-01-15 Amir M. Vahedi , Horea T. Ilies

Physics informed neural network (PINN) based solution methods for differential equations have recently shown success in a variety of scientific computing applications. Several authors have reported difficulties, however, when using PINNs to…

Numerical Analysis · Mathematics 2023-10-16 Arnav Gangal , Luis Kim , Sean P. Carney

Physics-informed neural networks (PINNs) have lately received significant attention as a representative deep learning-based technique for solving partial differential equations (PDEs). Most fully connected network-based PINNs use automatic…

Machine Learning · Computer Science 2024-09-30 Zixue Xiang , Wei Peng , Wen Yao

This work considers stochastic Galerkin approximations of linear elliptic partial differential equations (PDEs) with stochastic forcing terms and stochastic diffusion coefficients, that cannot be bounded uniformly away from zero and…

Numerical Analysis · Mathematics 2026-01-12 Fabio Musco , Andrea Barth

In this work, we develop interface-gated physics-informed neural networks (IG-PINNs) to solve elliptic interface equations. In IG-PINNs, we use a fully connected neural network to capture the smooth behavior across the entire domain. In…

Numerical Analysis · Mathematics 2025-12-09 Jiachun Zheng , Yunqing Huang , Nianyu Yi

The great success of Physics-Informed Neural Networks (PINN) in solving partial differential equations (PDEs) has significantly advanced our simulation and understanding of complex physical systems in science and engineering. However, many…

Numerical Analysis · Mathematics 2024-09-10 Hao Zhang , Longxiang Jiang , Xinkun Chu , Yong Wen , Luxiong Li , Yonghao Xiao , Liyuan Wang

Neural networks can be trained to solve partial differential equations (PDEs) by using the PDE residual as the loss function. This strategy is called "physics-informed neural networks" (PINNs), but it currently cannot produce high-accuracy…

Machine Learning · Computer Science 2024-04-11 Qi Zeng , Yash Kothari , Spencer H. Bryngelson , Florian Schäfer

In this study, we utilize the emerging Physics Informed Neural Networks (PINNs) approach for the first time to predict the flow field of a compressor cascade. Different from conventional training methods, a new adaptive learning strategy…

Machine Learning · Computer Science 2024-05-08 Zhihui Li , Francesco Montomoli , Sanjiv Sharma

A large number of magnetohydrodynamic (MHD) equilibrium calculations are often required for uncertainty quantification, optimization, and real-time diagnostic information, making MHD equilibrium codes vital to the field of plasma physics.…

Physics-informed neural networks (PINNs) have emerged as a promising numerical method based on deep learning for modeling boundary value problems, showcasing promising results in various fields. In this work, we use PINNs to discretize…

Computational Physics · Physics 2024-06-10 Michel Nohra , Steven Dufour
‹ Prev 1 3 4 5 6 7 10 Next ›