English
Related papers

Related papers: Convergence of Stochastic Gradient Methods for Wid…

200 papers

Physics-Informed Neural Network (PINN) has become a commonly used machine learning approach to solve partial differential equations (PDE). But, facing high-dimensional secondorder PDE problems, PINN will suffer from severe scalability…

Machine Learning · Computer Science 2023-02-27 Di He , Shanda Li , Wenlei Shi , Xiaotian Gao , Jia Zhang , Jiang Bian , Liwei Wang , Tie-Yan Liu

Physics-informed neural networks (PINNs) are an influential method of solving differential equations and estimating their parameters given data. However, since they make use of neural networks, they provide only a point estimate of…

Machine Learning · Computer Science 2024-05-15 Lena Podina , Mahdi Torabi Rad , Mohammad Kohandel

This paper is a step-by-step, self-contained guide to the complete training cycle of a Physics-Informed Neural Network (PINN) -- a topic that existing tutorials and guides typically delegate to automatic differentiation libraries without…

Numerical Analysis · Mathematics 2026-04-21 Abdeladhim Tahimi

Addressing high-dimensional partial differential equations to derive effective actions within the functional renormalization group is formidable, especially when considering various field configurations, including inhomogeneous states, even…

Disordered Systems and Neural Networks · Physics 2024-08-05 Takeru Yokota

Physics-informed neural networks (PINNs) have been widely applied to solve partial differential equations (PDEs) by enforcing outputs and gradients of deep models to satisfy target equations. Due to the limitation of numerical computation,…

Machine Learning · Computer Science 2024-10-24 Haixu Wu , Huakun Luo , Yuezhou Ma , Jianmin Wang , Mingsheng Long

Physics-informed neural networks (PINNs) are one popular approach to incorporate a priori knowledge about physical systems into the learning framework. PINNs are known to be robust for smaller training sets, derive better generalization…

Machine Learning · Computer Science 2024-06-19 Birgit Hillebrecht , Benjamin Unger

The application of deep learning methods to speed up the resolution of challenging power flow problems has recently shown very encouraging results. However, power system dynamics are not snap-shot, steady-state operations. These dynamics…

Machine Learning · Computer Science 2022-06-22 Mostafa Mohammadian , Kyri Baker , Ferdinando Fioretto

In this study, we utilize the emerging Physics Informed Neural Networks (PINNs) approach for the first time to predict the flow field of a compressor cascade. Different from conventional training methods, a new adaptive learning strategy…

Machine Learning · Computer Science 2024-05-08 Zhihui Li , Francesco Montomoli , Sanjiv Sharma

The research in Artificial Intelligence methods with potential applications in science has become an essential task in the scientific community last years. Physics Informed Neural Networks (PINNs) is one of this methods and represent a…

Computational Physics · Physics 2023-07-24 Luis Medrano Navarro , Luis Martín Moreno , Sergio G Rodrigo

The field of artificial neural network (ANN) training has garnered significant attention in recent years, with researchers exploring various mathematical techniques for optimizing the training process. In particular, this paper focuses on…

Functional Analysis · Mathematics 2023-06-23 Arzu Ahmadova

The concepts and techniques of physics-informed neural networks (PINNs) is studied and limitations are identified to make it efficient to approximate dynamical equations. Potential working research domains are explored for increasing the…

Computational Physics · Physics 2023-01-13 Siddharth Rout

State-of-the-art training algorithms for deep learning models are based on stochastic gradient descent (SGD). Recently, many variations have been explored: perturbing parameters for better accuracy (such as in Extragradient), limiting SGD…

Machine Learning · Computer Science 2022-03-23 Amirkeivan Mohtashami , Martin Jaggi , Sebastian U. Stich

Partial differential equations (PDEs) are an essential computational kernel in physics and engineering. With the advance of deep learning, physics-informed neural networks (PINNs), as a mesh-free method, have shown great potential for fast…

Machine Learning · Computer Science 2023-06-19 Junjun Yan , Xinhai Chen , Zhichao Wang , Enqiang Zhoui , Jie Liu

Most stochastic gradient descent algorithms can optimize neural networks that are sub-differentiable in their parameters; however, this implies that the neural network's activation function must exhibit a degree of continuity which limits…

Neural and Evolutionary Computing · Computer Science 2021-12-16 Anastasis Kratsios , Behnoosh Zamanlooy

This paper presents NSGA-PINN, a multi-objective optimization framework for effective training of Physics-Informed Neural Networks (PINNs). The proposed framework uses the Non-dominated Sorting Genetic Algorithm (NSGA-II) to enable…

Machine Learning · Computer Science 2023-03-08 Binghang Lu , Christian B. Moya , Guang Lin

We propose a consistent physics-informed neural networks (CPINNs) framework for elliptic obstacle problems formulated as variational inequalities. The method is based on a mixed loss functional that is rigorously aligned with the stability…

Numerical Analysis · Mathematics 2026-04-03 Arbaz Khan , Kent-Andre Mardal , Shiv Mishra

Physics-informed Neural Networks (PINNs) have been shown to be effective in solving partial differential equations by capturing the physics induced constraints as a part of the training loss function. This paper shows that a PINN can be…

Machine Learning · Computer Science 2023-05-08 Chandrajit Bajaj , Luke McLennan , Timothy Andeen , Avik Roy

Physics-Informed Neural Networks (PINNs) are machine learning tools that approximate the solution of general partial differential equations (PDEs) by adding them in some form as terms of the loss/cost function of a Neural Network. Most…

Numerical Analysis · Mathematics 2022-08-29 Antonio Tadeu Azevedo Gomes , Larissa Miguez da Silva , Frederic Valentin

Physics-informed neural network (PINN) is a data-driven solver for partial and ordinary differential equations(ODEs/PDEs). It provides a unified framework to address both forward and inverse problems. However, the complexity of the…

Machine Learning · Computer Science 2024-01-17 Abdul Hannan Mustajab , Hao Lyu , Zarghaam Rizvi , Frank Wuttke

Physics-Informed Neural Networks (PINNs) often suffer from slow convergence, training instability, and reduced accuracy on challenging partial differential equations due to the anisotropic and rapidly varying geometry of their loss…

Machine Learning · Computer Science 2026-04-20 Kang An , Chenhao Si , Shiqian Ma , Ming Yan