English
Related papers

Related papers: Convergence of Stochastic Gradient Methods for Wid…

200 papers

Physics informed neural networks (PINNs) are deep learning based techniques for solving partial differential equations (PDEs) encounted in computational science and engineering. Guided by data and physical laws, PINNs find a neural network…

Numerical Analysis · Mathematics 2020-12-30 Yeonjong Shin , Jerome Darbon , George Em Karniadakis

A physics-informed neural network (PINN) uses physics-augmented loss functions, e.g., incorporating the residual term from governing partial differential equations (PDEs), to ensure its output is consistent with fundamental physics laws.…

Machine Learning · Computer Science 2022-12-16 Jian Cheng Wong , Chinchun Ooi , Abhishek Gupta , Yew-Soon Ong

This paper introduces a framework based on physics-informed neural networks (PINNs) for addressing key challenges in nonlinear lattices, including solution approximation, bifurcation diagram construction, and linear stability analysis. We…

Numerical Analysis · Mathematics 2025-07-22 Muhammad Luthfi Shahab , Fidya Almira Suheri , Rudy Kusdiantara , Hadi Susanto

Physics-Informed Neural Networks have shown unique utility in parameterising the solution of a well-defined partial differential equation using automatic differentiation and residual losses. Though they provide theoretical guarantees of…

Machine Learning · Computer Science 2022-05-17 Vignesh Gopakumar , Stanislas Pamela , Debasmita Samaddar

Physics informed neural network (PINN) based solution methods for differential equations have recently shown success in a variety of scientific computing applications. Several authors have reported difficulties, however, when using PINNs to…

Numerical Analysis · Mathematics 2023-10-16 Arnav Gangal , Luis Kim , Sean P. Carney

Physics-informed neural networks (PINNs) have recently emerged as a prominent paradigm for solving partial differential equations (PDEs), yet their training strategies remain underexplored. While hard prioritization methods inspired by…

Machine Learning · Computer Science 2025-12-22 Zhaoqian Gao , Min Yanga

We consider the approximation of a class of dynamic partial differential equations (PDE) of second order in time by the physics-informed neural network (PINN) approach, and provide an error analysis of PINN for the wave equation, the…

Numerical Analysis · Mathematics 2023-03-23 Yanxia Qian , Yongchao Zhang , Yunqing Huang , Suchuan Dong

Physics-informed neural networks (PINNs) have recently emerged as effective methods for solving partial differential equations (PDEs) in various problems. Substantial research focuses on the failure modes of PINNs due to their frequent…

Machine Learning · Computer Science 2024-10-01 Yesom Park , Changhoon Song , Myungjoo Kang

It has been shown that gradient descent can yield the zero training loss in the over-parametrized regime (the width of the neural networks is much larger than the number of data points). In this work, combining the ideas of some existing…

Optimization and Control · Mathematics 2019-11-05 Lei Li

Physics-Informed Neural Networks (PINNs) have emerged as a highly active research topic across multiple disciplines in science and engineering, including computational geomechanics. PINNs offer a promising approach in different applications…

Computational Engineering, Finance, and Science · Computer Science 2024-04-30 Yared W. Bekele

In solving partial differential equations (PDEs), machine learning utilizing physical laws has received considerable attention owing to advantages such as mesh-free solutions, unsupervised learning, and feasibility for solving…

Machine Learning · Computer Science 2026-03-25 Tetsuro Tsuchino , Motoki Shiga

While the popularity of physics-informed neural networks (PINNs) is steadily rising, to this date, PINNs have not been successful in simulating multi-scale and singular perturbation problems. In this work, we present a new training paradigm…

Machine Learning · Computer Science 2024-03-27 Zhiwei Fang , Sifan Wang , Paris Perdikaris

Physics-informed neural networks (PINNs) [31] use automatic differentiation to solve partial differential equations (PDEs) by penalizing the PDE in the loss function at a random set of points in the domain of interest. Here, we develop a…

Neural and Evolutionary Computing · Computer Science 2019-12-03 E. Kharazmi , Z. Zhang , G. E. Karniadakis

We develop improved physics-informed neural networks (PINNs) for high-order and high-dimensional power system models described by nonlinear ordinary differential equations. We propose some novel enhancements to improve PINN training and…

Machine Learning · Computer Science 2024-10-11 Vineet Jagadeesan Nair

Physics-informed neural networks (PINNs) are trained using physical equations and can also incorporate unmodeled effects by learning from data. PINNs for control (PINCs) of dynamical systems are gaining interest due to their prediction…

Systems and Control · Electrical Eng. & Systems 2024-08-29 Henrik Krauss , Tim-Lukas Habich , Max Bartholdt , Thomas Seel , Moritz Schappler

We study a continuous-time approximation of the stochastic gradient descent process for minimizing the population expected loss in learning problems. The main results establish general sufficient conditions for the convergence, extending…

Machine Learning · Computer Science 2025-11-03 Gabor Lugosi , Eulalia Nualart

Physics-informed neural networks (PINNs) have emerged as a versatile and widely applicable concept across various science and engineering domains over the past decade. This article offers a comprehensive overview of the fundamentals of…

Computational Engineering, Finance, and Science · Computer Science 2024-10-02 Sai Ganga , Ziya Uddin

Multi-task learning through composite loss functions is fundamental to modern deep learning, yet optimizing competing objectives remains challenging. We present new theoretical and practical approaches for addressing directional conflicts…

Machine Learning · Computer Science 2025-09-22 Sifan Wang , Ananyae Kumar Bhartari , Bowen Li , Paris Perdikaris

The utilization of Deep Neural Networks (DNNs) in physical science and engineering applications has gained traction due to their capacity to learn intricate functions. While large datasets are crucial for training DNN models in fields like…

Machine Learning · Computer Science 2025-08-05 Vamsi Sai Krishna Malineni , Suresh Rajendran

This paper explores the difficulties in solving partial differential equations (PDEs) using physics-informed neural networks (PINNs). PINNs use physics as a regularization term in the objective function. However, a drawback of this approach…

Machine Learning · Computer Science 2023-06-21 Shamsulhaq Basir