English
Related papers

Related papers: Implicit Stochastic Gradient Descent for Training …

200 papers

Physics-informed neural networks (PINNs) have recently emerged as promising data-driven PDE solvers showing encouraging results on various PDEs. However, there is a fundamental limitation of training PINNs to solve multi-dimensional PDEs…

Machine Learning · Computer Science 2023-11-01 Junwoo Cho , Seungtae Nam , Hyunmo Yang , Seok-Bae Yun , Youngjoon Hong , Eunbyung Park

The simulation of power system dynamics poses a computationally expensive task. Considering the growing uncertainty of generation and demand patterns, thousands of scenarios need to be continuously assessed to ensure the safety of power…

Systems and Control · Electrical Eng. & Systems 2023-11-13 Jochen Stiasny , Spyros Chatzivasileiadis

In this paper we analyze the behaviour of the stochastic gradient descent (SGD), a widely used method in supervised learning for optimizing neural network weights via a minimization of non-convex loss functions. Since the pioneering work of…

Machine Learning · Computer Science 2025-05-13 Davide Barbieri , Matteo Bonforte , Peio Ibarrondo

We propose gradient-enhanced PINNs based on transfer learning (TL-gPINNs) for inverse problems of the function coefficient discovery in order to overcome deficiency of the discrete characterization of the PDE loss in neural networks and…

Numerical Analysis · Mathematics 2023-05-16 Shuning Lin , Yong Chen

Gradient descent prevails in artificial neural network training, but seems inept for spiking neural networks as small parameter changes can cause sudden, disruptive (dis-)appearances of spikes. Here, we demonstrate exact gradient descent…

Neurons and Cognition · Quantitative Biology 2025-01-29 Christian Klos , Raoul-Martin Memmesheimer

The present work investigates the use of physics-informed neural networks (PINNs) for the 3D reconstruction of unsteady gravity currents from limited data. In the PINN context, the flow fields are reconstructed by training a neural network…

Fluid Dynamics · Physics 2023-06-16 Mickaël Delcey , Yoann Cheny , Sébastien Kiesgen de Richter

In recent years, Physics-Informed Neural Networks (PINNs) have become a representative method for solving partial differential equations (PDEs) with neural networks. PINNs provide a novel approach to solving PDEs through optimization…

Computational Physics · Physics 2024-11-28 Weiwei Zhang , Wei Suo , Jiahao Song , Wenbo Cao

Neural networks, a central tool in machine learning, have demonstrated remarkable, high fidelity performance on image recognition and classification tasks. These successes evince an ability to accurately represent high dimensional…

Machine Learning · Statistics 2023-02-08 Grant M. Rotskoff , Eric Vanden-Eijnden

Physics-Informed Neural Networks (PINNs) solve physical systems by incorporating governing partial differential equations directly into neural network training. In electromagnetism, where well-established methodologies such as FDTD and FEM…

Computational Physics · Physics 2026-02-13 Nilufer K. Bulut

Physics-informed neural networks (PINNs), owing to their mesh-free nature, offer a powerful approach for solving high-dimensional partial differential equations (PDEs) in complex geometries, including irregular domains. This capability…

Numerical Analysis · Mathematics 2025-06-06 Hanfei Zhou , Lei Shi

This paper presents a deep learning strategy to simultaneously solve Partial Differential Equations (PDEs) and back-calculate their parameters in the context of deep tunnel excavation. A Physics-Informed Neural Network (PINN) model is…

Computational Physics · Physics 2026-05-29 Alec Tristani , Chloé Arson

There introduce Particle Optimized Gradient Descent (POGD), an algorithm based on the gradient descent but integrates the particle swarm optimization (PSO) principle to achieve the iteration. From the experiments, this algorithm has…

Machine Learning · Computer Science 2022-10-20 Feihu Han , Sida Xing , Sui Yang Khoo

Deep neural networks (DNNs) have achieved remarkable success in computer vision; however, training DNNs for satisfactory performance remains challenging and suffers from sensitivity to empirical selections of an optimization algorithm for…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Haichao Zhang , Kuangrong Hao , Lei Gao , Bing Wei , Xuesong Tang

This paper proposes a meshless deep learning algorithm, enriched physics-informed neural networks (EPINNs), to solve dynamic Poisson-Nernst-Planck (PNP) equations with strong coupling and nonlinear characteristics. The EPINNs takes the…

Machine Learning · Computer Science 2024-02-06 Xujia Huang , Fajie Wang , Benrong Zhang , Hanqing Liu

Physically informed neural networks (PINNs) are a promising emerging method for solving differential equations. As in many other deep learning approaches, the choice of PINN design and training protocol requires careful craftsmanship. Here,…

Machine Learning · Statistics 2023-10-09 Inbar Seroussi , Asaf Miron , Zohar Ringel

In this work, we present the physics-informed neural network (PINN) model applied particularly to dynamic problems in solid mechanics. We focus on forward and inverse problems. Particularly, we show how a PINN model can be used efficiently…

Neural and Evolutionary Computing · Computer Science 2025-12-16 Vijay Kag , Venkatesh Gopinath

We present the application of a class of deep learning, known as Physics Informed Neural Networks (PINN), to learning and discovery in solid mechanics. We explain how to incorporate the momentum balance and constitutive relations into PINN,…

Machine Learning · Computer Science 2020-05-12 Ehsan Haghighat , Maziar Raissi , Adrian Moure , Hector Gomez , Ruben Juanes

The numerical approximation of partial differential equations (PDEs) using neural networks has seen significant advancements through Physics-Informed Neural Networks (PINNs). Despite their straightforward optimization framework and…

Machine Learning · Computer Science 2025-03-19 Namgyu Kang , Jaemin Oh , Youngjoon Hong , Eunbyung Park

Physics-informed neural networks (PINNs) are a new tool for solving boundary value problems by defining loss functions of neural networks based on governing equations, boundary conditions, and initial conditions. Recent investigations have…

Computational Engineering, Finance, and Science · Computer Science 2023-11-14 Ali Harandi , Ahmad Moeineddin , Michael Kaliske , Stefanie Reese , Shahed Rezaei

This paper introduces a framework based on physics-informed neural networks (PINNs) for addressing key challenges in nonlinear lattices, including solution approximation, bifurcation diagram construction, and linear stability analysis. We…

Numerical Analysis · Mathematics 2025-07-22 Muhammad Luthfi Shahab , Fidya Almira Suheri , Rudy Kusdiantara , Hadi Susanto