English
Related papers

Related papers: Probing optimisation in physics-informed neural ne…

200 papers

The optimization algorithms are crucial in training physics-informed neural networks (PINNs), as unsuitable methods may lead to poor solutions. Compared to the common gradient descent (GD) algorithm, implicit gradient descent (IGD)…

Machine Learning · Computer Science 2025-08-04 Xianliang Xu , Ting Du , Wang Kong , Bin Shan , Ye Li , Zhongyi Huang

Physics Informed Neural Networks offer a mesh free framework for solving PDEs but are highly sensitive to loss weight selection. We propose two dimensional analysis based weighting schemes, one based on quantifiable terms, and another also…

Machine Learning · Computer Science 2025-10-01 Yi En Chou , Te Hsin Liu , Chao-An Lin

Recent works have shown that natural gradient methods can significantly outperform standard optimizers when training physics-informed neural networks (PINNs). In this paper, we analyze the training dynamics of PINNs optimized with ANaGRAM,…

Machine Learning · Computer Science 2025-10-21 Nilo Schwencke , Cyriaque Rousselot , Alena Shilova , Cyril Furtlehner

We prove a priori and a posteriori error estimates for physics-informed neural networks (PINNs) for linear PDEs. We analyze elliptic equations in primal and mixed form, elasticity, parabolic, hyperbolic and Stokes equations; and a PDE…

Numerical Analysis · Mathematics 2024-03-11 Marius Zeinhofer , Rami Masri , Kent-André Mardal

Physics-informed neural networks (PINNs) have been proposed to learn the solution of partial differential equations (PDE). In PINNs, the residual form of the PDE of interest and its boundary conditions are lumped into a composite objective…

Computational Physics · Physics 2022-05-24 Shamsulhaq Basir , Inanc Senocak

Neural networks have been used prominently in several machine learning and statistics applications. In general, the underlying optimization of neural networks is non-convex which makes their performance analysis challenging. In this paper,…

Machine Learning · Statistics 2017-10-09 Soheil Feizi , Hamid Javadi , Jesse Zhang , David Tse

Physics-Informed Neural Networks (PINNs) have emerged as powerful tools for solving partial differential equations (PDEs). However, training PINNs from scratch is often computationally intensive and time-consuming. To address this problem,…

Numerical Analysis · Mathematics 2024-10-21 Sidi Wu

Neural networks have recently gained attention in solving inverse problems. One prominent methodology are Physics-Informed Neural Networks (PINNs) which can solve both forward and inverse problems. In the paper at hand, full waveform…

Numerical Analysis · Mathematics 2023-12-05 Leon Herrmann , Tim Bürchner , Felix Dietrich , Stefan Kollmannsberger

While the popularity of physics-informed neural networks (PINNs) is steadily rising, to this date, PINNs have not been successful in simulating multi-scale and singular perturbation problems. In this work, we present a new training paradigm…

Machine Learning · Computer Science 2024-03-27 Zhiwei Fang , Sifan Wang , Paris Perdikaris

Deep learning has been highly successful in some applications. Nevertheless, its use for solving partial differential equations (PDEs) has only been of recent interest with current state-of-the-art machine learning libraries, e.g.,…

Machine Learning · Computer Science 2024-10-22 Hamid El Bahja , Jan Christian Hauffen , Peter Jung , Bubacarr Bah , Issa Karambal

The current work aims to incorporate physics-based loss in Physics Informed Neural Network (PINN) directly using the numerical residual obtained from the governing equation in any dicretized forward solver. PINN's major difficulties in…

Numerical Analysis · Mathematics 2025-09-30 Rahul Halder , Giovanni Stabile , Gianluigi Rozza

Physics-Informed Neural Networks (PINNs) solve physical systems by incorporating governing partial differential equations directly into neural network training. In electromagnetism, where well-established methodologies such as FDTD and FEM…

Computational Physics · Physics 2026-02-13 Nilufer K. Bulut

As a typical application of deep learning, physics-informed neural network (PINN) {has been} successfully used to find numerical solutions of partial differential equations (PDEs), but how to improve the limited accuracy is still a great…

Machine Learning · Computer Science 2022-08-09 Zhi-Yong Zhang , Hui Zhang , Li-Sheng Zhang , Lei-Lei Guo

Quantum Fisher Information (QFI) sets the ultimate precision limit for parameter estimation and is therefore a central quantity in quantum metrology. In time-dependent many-body systems, however, maximizing QFI is a highly non-trivial task…

We explore unique considerations involved in fitting ML models to data with very high precision, as is often required for science applications. We empirically compare various function approximation methods and study how they scale with…

Machine Learning · Computer Science 2023-02-01 Eric J. Michaud , Ziming Liu , Max Tegmark

Quantum control is a ubiquitous research field that has enabled physicists to delve into the dynamics and features of quantum systems, delivering powerful applications for various atomic, optical, mechanical, and solid-state systems. In…

Quantum Physics · Physics 2023-12-11 Ariel Norambuena , Marios Mattheakis , Francisco J. González , Raúl Coto

Modern power systems face significant challenges in state estimation and real-time monitoring, particularly regarding response speed and accuracy under faulty conditions or cyber-attacks. This paper proposes a hybrid approach using…

Machine Learning · Computer Science 2026-04-07 Solon Falas , Markos Asprou , Charalambos Konstantinou , Maria K. Michael

Physics-Informed Neural Networks (PINNs) seek to solve partial differential equations (PDEs) with deep learning. Mainstream approaches that deploy fully-connected multi-layer deep learning architectures require prolonged training to achieve…

Machine Learning · Computer Science 2025-12-16 Shaghayegh Fazliani , Zachary Frangella , Madeleine Udell

Physics informed neural networks (PINNs) are nowadays used as efficient machine learning methods for solving differential equations. However, vanilla-PINNs fail to learn complex problems as ones involving stiff ordinary differential…

Computational Physics · Physics 2023-04-18 Hubert Baty

Multifidelity simulation methodologies are often used in an attempt to judiciously combine low-fidelity and high-fidelity simulation results in an accuracy-increasing, cost-saving way. Candidates for this approach are simulation…

Computational Physics · Physics 2023-01-09 Michael Penwarden , Shandian Zhe , Akil Narayan , Robert M. Kirby