English
Related papers

Related papers: Understanding and mitigating gradient pathologies …

200 papers

Power flow analysis plays a critical role in the control and operation of power systems. The high computational burden of traditional solution methods led to a shift towards data-driven approaches, exploiting the availability of digital…

Systems and Control · Electrical Eng. & Systems 2024-09-17 Victor Eeckhout , Hossein Fani , Md Umar Hashmi , Geert Deconinck

Physics informed neural networks (PINNs) represent a very popular class of neural solvers for partial differential equations. In practice, one often employs stochastic gradient descent type algorithms to train the neural network. Therefore,…

Machine Learning · Computer Science 2025-09-01 Bangti Jin , Longjun Wu

Physics-informed neural networks (PINNs) have emerged as a promising deep learning method, capable of solving forward and inverse problems governed by differential equations. Despite their recent advance, it is widely acknowledged that…

Machine Learning · Computer Science 2024-06-11 Franz M. Rohrhofer , Stefan Posch , Clemens Gößnitzer , Bernhard C. Geiger

There have been extensive studies on solving differential equations using physics-informed neural networks. While this method has proven advantageous in many cases, a major criticism lies in its lack of analytical error bounds. Therefore,…

Neural and Evolutionary Computing · Computer Science 2022-07-05 Shuheng Liu , Xiyue Huang , Pavlos Protopapas

We revisit the original approach of using deep learning and neural networks to solve differential equations by incorporating the knowledge of the equation. This is done by adding a dedicated term to the loss function during the optimization…

Machine Learning · Computer Science 2023-04-05 Hubert Baty , Leo Baty

In recent years, the researches about solving partial differential equations (PDEs) based on artificial neural network have attracted considerable attention. In these researches, the neural network models are usually designed depend on…

Neural and Evolutionary Computing · Computer Science 2024-05-21 Bo Zhang , Chao Yang

Physics-informed neural networks (PINNs) have emerged as a powerful paradigm for solving partial differential equations (PDEs) by embedding physical laws directly into neural network training. However, solving high-fidelity PDEs remains…

Machine Learning · Computer Science 2026-02-03 Olaf Yunus Laitinen Imanov

We propose a self-supervised physics-informed neural network (PINN) framework that adaptively balances physics-based and data-driven supervision for scientific machine learning under data scarcity. Unlike prior PINNs that rely on fixed or…

Machine Learning · Computer Science 2026-05-08 Reza Pirayeshshirazinezhad

Physics-informed neural networks (PINNs) are a versatile tool in the burgeoning field of scientific machine learning for solving partial differential equations (PDEs). However, determining suitable training strategies for them is not…

Numerical Analysis · Mathematics 2026-03-09 Saad Qadeer , Panos Stinis

Deep neural networks (DNN) have been used to model nonlinear relations between physical quantities. Those DNNs are embedded in physical systems described by partial differential equations (PDE) and trained by minimizing a loss function that…

Numerical Analysis · Mathematics 2020-02-26 Kailai Xu , Eric Darve

We introduce a novel physics-informed approach for accurately modeling aggregation kinetics which provides a comprehensive solution in a single run by outputting all model parameters simultaneously, a clear advancement over traditional…

Dynamical Systems · Mathematics 2024-10-16 Farzona Mukhamedova , Ivan Tyukin , Nikolai Brilliantov

Combining physics with machine learning models has advanced the performance of machine learning models in many different applications. In this paper, we evaluate adding a weak physics constraint, i.e., a physics-based empirical…

Geophysics · Physics 2024-03-11 Qingkai Kong , William R. Walter , Ruijia Wang , Brandon Schmandt

Physics-Informed Neural Networks (PINNs) have emerged as a powerful tool for integrating physics-based constraints and data to address forward and inverse problems in machine learning. Despite their potential, the implementation of PINNs…

Optimization and Control · Mathematics 2024-12-19 Alan Williams , Christopher Leon , Alexander Scheinker

Physics-informed Machine Learning has recently become attractive for learning physical parameters and features from simulation and observation data. However, most existing methods do not ensure that the physics, such as balance laws (e.g.,…

Numerical Analysis · Mathematics 2021-09-10 Satish Karra , Bulbul Ahmmed , Maruti K. Mudunuru

Neural networks (NNs) accelerate simulations of quantum dissipative dynamics. Ensuring that these simulations adhere to fundamental physical laws is crucial, but has been largely ignored in the state-of-the-art NN approaches. We show that…

Chemical Physics · Physics 2024-09-06 Arif Ullah , Yu Huang , Ming Yang , Pavlo O. Dral

Despite the success achieved by the analysis of supervised learning algorithms in the framework of statistical mechanics, reinforcement learning has remained largely untouched. Here we move towards closing the gap by analyzing the dynamics…

Statistical Mechanics · Physics 2022-09-02 Riccardo Fabbricatore , Vladimir V. Palyulin

Physics-informed neural networks (PINNs) have recently emerged as effective methods for solving partial differential equations (PDEs) in various problems. Substantial research focuses on the failure modes of PINNs due to their frequent…

Machine Learning · Computer Science 2024-10-01 Yesom Park , Changhoon Song , Myungjoo Kang

The remarkable practical success of deep learning has revealed some major surprises from a theoretical perspective. In particular, simple gradient methods easily find near-optimal solutions to non-convex optimization problems, and despite…

Statistics Theory · Mathematics 2021-03-17 Peter L. Bartlett , Andrea Montanari , Alexander Rakhlin

Physics-informed neural networks (PINNs) offer a promising avenue for tackling both forward and inverse problems in partial differential equations (PDEs) by incorporating deep learning with fundamental physics principles. Despite their…

Machine Learning · Computer Science 2024-02-06 Hemanth Saratchandran , Shin-Fang Chng , Simon Lucey

Physics-informed neural networks (PINNs) have emerged as a prominent approach for solving partial differential equations (PDEs) by minimizing a combined loss function that incorporates both boundary loss and PDE residual loss. Despite their…

Machine Learning · Computer Science 2025-01-16 Youngsik Hwang , Dong-Young Lim