English
Related papers

Related papers: Convergence of Stochastic Gradient Methods for Wid…

200 papers

Stochastic gradient descent samples uniformly the training set to build an unbiased gradient estimate with a limited number of samples. However, at a given step of the training process, some data are more helpful than others to continue…

Machine Learning · Computer Science 2023-03-30 Thibault Lahire

Physics-informed neural networks (PINNs) provide a deep learning framework for numerically solving partial differential equations (PDEs), and have been widely used in a variety of PDE problems. However, there still remain some challenges in…

Machine Learning · Computer Science 2022-05-19 Wensheng Li , Chao Zhang , Chuncheng Wang , Hanting Guan , Dacheng Tao

Physics-Informed Neural Networks (PINNs) have recently emerged as a promising alternative for solving partial differential equations, offering a mesh-free framework that incorporates physical laws directly into the learning process. In this…

Computational Physics · Physics 2025-04-17 Gal G. Shaviner , Hemanth Chandravamsi , Shimon Pisnoy , Ziv Chen , Steven H. Frankel

Physics-informed neural networks (PINNs) are an increasingly powerful way to solve partial differential equations, generate digital twins, and create neural surrogates of physical models. In this manuscript we detail the inner workings of…

Physics-informed neural networks (PINNs) are a new tool for solving boundary value problems by defining loss functions of neural networks based on governing equations, boundary conditions, and initial conditions. Recent investigations have…

Computational Engineering, Finance, and Science · Computer Science 2023-11-14 Ali Harandi , Ahmad Moeineddin , Michael Kaliske , Stefanie Reese , Shahed Rezaei

Physics-informed neural networks (PINNs) offer a promising avenue for tackling both forward and inverse problems in partial differential equations (PDEs) by incorporating deep learning with fundamental physics principles. Despite their…

Machine Learning · Computer Science 2024-02-06 Hemanth Saratchandran , Shin-Fang Chng , Simon Lucey

Recently, physics-informed neural networks (PINNs) and their variants have gained significant popularity as a scientific computing method for solving partial differential equations (PDEs), whereas accuracy is still its main shortcoming.…

Computational Physics · Physics 2025-03-11 Feng Chen , Yiran Meng , Kegan Li , Chaoran Yang , Jiong Yang

Motivated by recent research on Physics-Informed Neural Networks (PINNs), we make the first attempt to introduce the PINNs for numerical simulation of the elliptic Partial Differential Equations (PDEs) on 3D manifolds. PINNs are one of the…

Numerical Analysis · Mathematics 2021-03-05 Zhuochao Tang , Zhuojia Fu

Physics-informed neural networks (PINNs) are numerical solvers that embed all the physical information of a system into the loss function of a neural network. In this way the learned solution accounts for data (if available), the governing…

Computational Physics · Physics 2025-07-30 Andrés Martínez-Esteban , Pablo Calvo-Barlés , Luis Martín-Moreno , Sergio G Rodrigo

Physics-informed neural networks (PINNs) are at the forefront of scientific machine learning, making possible the creation of machine intelligence that is cognizant of physical laws and able to accurately simulate them. However, today's…

Neural and Evolutionary Computing · Computer Science 2026-02-23 Jian Cheng Wong , Chin Chun Ooi , Abhishek Gupta , Pao-Hsiung Chiu , Joshua Shao Zheng Low , My Ha Dao , Yew-Soon Ong

The equilibrium reconstruction of plasma is a core step in real-time diagnostic tasks in fusion research. This paper explores a multi-stage Physics-Informed Neural Networks(PINNs) approach to solve the Grad-Shafranov equation, achieving…

Plasma Physics · Physics 2025-07-23 Cuizhi Zhou , Kaien Zhu

Physics-informed neural networks (PINNs) have emerged as promising surrogate modes for solving partial differential equations (PDEs). Their effectiveness lies in the ability to capture solution-related features through neural networks.…

Machine Learning · Computer Science 2023-07-13 Junjun Yan , Xinhai Chen , Zhichao Wang , Enqiang Zhou , Jie Liu

Physics Informed Neural Networks (PINNs) have recently gained popularity for solving partial differential equations, given the fact they escape the curse of dimensionality. In this paper, we present Physics Informed Neural Networks as an…

Numerical Analysis · Mathematics 2022-07-26 Umberto Zerbinati

Natural-gradient methods markedly accelerate the training of Physics-Informed Neural Networks (PINNs), yet their Gauss--Newton update must be solved in the parameter space, incurring a prohibitive $O(n^3)$ time complexity, where $n$ is the…

Machine Learning · Computer Science 2025-10-09 Anas Jnini , Flavio Vella

Physics-informed neural networks (PINNs) are a newly emerging research frontier in machine learning, which incorporate certain physical laws that govern a given data set, e.g., those described by partial differential equations (PDEs), into…

Neural and Evolutionary Computing · Computer Science 2023-07-11 Bo Wang , A. K. Qin , Sajjad Shafiei , Hussein Dia , Adriana-Simona Mihaita , Hanna Grzybowska

Physics-Informed Neural Networks (PINNs) have emerged as a promising machine learning approach for solving partial differential equations (PDEs). However, PINNs face significant challenges in balancing multi-objective losses, as multiple…

Computational Engineering, Finance, and Science · Computer Science 2025-10-07 Afrah Farea , Saiful Khan , Mustafa Serdar Celebi

Physics informed neural networks (PINNs) have recently been very successfully applied for efficiently approximating inverse problems for PDEs. We focus on a particular class of inverse problems, the so-called data assimilation or unique…

Numerical Analysis · Mathematics 2023-12-07 Siddhartha Mishra , Roberto Molinaro

Turbulence remains a problem that is yet to be fully understood, with experimental and numerical studies aiming to fully characterise the statistical properties of turbulent flows. Such studies require huge amount of resources to capture,…

Fluid Dynamics · Physics 2022-05-31 Vijay Kag , Kannabiran Seshasayanan , Venkatesh Gopinath

Large-scale optimization problems require algorithms both effective and efficient. One such popular and proven algorithm is Stochastic Gradient Descent which uses first-order gradient information to solve these problems. This paper studies…

Optimization and Control · Mathematics 2021-11-11 Theodoros Mamalis , Dusan Stipanovic , Petros Voulgaris

Physics-informed neural networks (PINNs) are a promising approach for solving partial differential equations (PDEs). Their training, however, is often difficult because multiple loss terms induced by PDE residuals and boundary or initial…

Machine Learning · Computer Science 2026-05-12 Hoyeol Yoon , Seoungbin Bae , Nam Ho-Nguyen , Dabeen Lee