English
Related papers

Related papers: Understanding and mitigating gradient pathologies …

200 papers

This paper proposes a physics-informed learning framework for a class of recurrent neural networks tailored to large-scale and networked systems. The approach aims to learn control-oriented models that preserve the structural and stability…

Systems and Control · Electrical Eng. & Systems 2026-03-27 Daniele Ravasio , Claudia Sbardi , Marcello Farina , Andrea Ballarino

A significant advancement in Neural Network (NN) research is the integration of domain-specific knowledge through custom loss functions. This approach addresses a crucial challenge: how can models utilize physics or mathematical principles…

Machine Learning · Computer Science 2025-03-27 Seyedeh Azadeh Fallah Mortezanejad , Ruochen Wang , Ali Mohammad-Djafari

This paper presents the potential of applying physics-informed neural networks for solving nonlinear multiphysics problems, which are essential to many fields such as biomedical engineering, earthquake prediction, and underground energy…

Computational Engineering, Finance, and Science · Computer Science 2020-07-01 Teeratorn Kadeethum , Thomas M Jorgensen , Hamidreza M Nick

Voltage prediction in distribution grids is a critical yet difficult task for maintaining power system stability. Machine learning approaches, particularly Graph Neural Networks (GNNs), offer significant speedups but suffer from poor…

Machine Learning · Computer Science 2025-12-09 Ehimare Okoyomon , Arbel Yaniv , Christoph Goebel

In the last decade, deep learning has become a major component of artificial intelligence. The workhorse of deep learning is the optimization of loss functions by stochastic gradient descent (SGD). Traditionally in deep learning, neural…

Machine Learning · Computer Science 2021-04-27 Benjamin Scellier

Physics-informed neural networks (PINNs) have great potential for flexibility and effectiveness in forward modeling and inversion of seismic waves. However, coordinate-based neural networks (NNs) commonly suffer from the "spectral bias"…

Geophysics · Physics 2025-06-19 Yi Ding , Su Chen , Hiroe Miyake , Xiaojun Li

We introduce a physics-informed neural framework for modeling static and time-dependent galactic gravitational potentials. The method combines data-driven learning with embedded physical constraints to capture complex, small-scale features…

Astrophysics of Galaxies · Physics 2026-04-02 Charlotte Myers , Nathaniel Starkman , Lina Necib

Physics-based models of dynamical systems are often used to study engineering and environmental systems. Despite their extensive use, these models have several well-known limitations due to simplified representations of the physical…

Machine Learning · Computer Science 2020-09-15 Xiaowei Jia , Jared Willard , Anuj Karpatne , Jordan S Read , Jacob A Zwart , Michael Steinbach , Vipin Kumar

Physics-informed neural networks (PINNs) have emerged as a new learning paradigm for solving partial differential equations (PDEs) by enforcing the constraints of physical equations, boundary conditions (BCs), and initial conditions (ICs)…

Machine Learning · Computer Science 2025-05-21 Chenhong Zhou , Jie Chen , Zaifeng Yang , Ching Eng Png

This work proposes a solution for the problem of training physics-informed networks under partial integro-differential equations. These equations require an infinite or a large number of neural evaluations to construct a single residual for…

Machine Learning · Computer Science 2024-06-12 Ehsan Saleh , Saba Ghaffari , Timothy Bretl , Luke Olson , Matthew West

We propose the use of physics-informed neural networks for solving the shallow-water equations on the sphere in the meteorological context. Physics-informed neural networks are trained to satisfy the differential equations along with the…

Computational Physics · Physics 2024-09-19 Alex Bihlo , Roman O. Popovych

The recent rise of deep learning has led to numerous applications, including solving partial differential equations using Physics-Informed Neural Networks. This approach has proven highly effective in several academic cases. However, their…

Numerical Analysis · Mathematics 2024-10-07 Marien Chenaud , Frédéric Magoulès , José Alves

Harnessing data to discover the underlying governing laws or equations that describe the behavior of complex physical systems can significantly advance our modeling, simulation and understanding of such systems in various science and…

Machine Learning · Computer Science 2021-11-17 Zhao Chen , Yang Liu , Hao Sun

Considerable research has been devoted to deep learning-based predictive models for system prognostics and health management in the reliability and safety community. However, there is limited study on the utilization of deep learning for…

Machine Learning · Statistics 2021-09-07 Taotao Zhou , Enrique Lopez Droguett , Ali Mosleh

Neural networks can be used to learn the solution of partial differential equations (PDEs) on arbitrary domains without requiring a computational mesh. Common approaches integrate differential operators in training neural networks using a…

Machine Learning · Computer Science 2022-07-07 Shamsulhaq Basir , Inanc Senocak

This work is concerned with discovering the governing partial differential equation (PDE) of a physical system. Existing methods have demonstrated the PDE identification from finite observations but failed to maintain satisfying results…

Numerical Analysis · Mathematics 2023-02-09 Pongpisit Thanasutives , Takashi Morita , Masayuki Numao , Ken-ichi Fukui

Physics-informed deep learning has emerged as a promising framework for solving partial differential equations (PDEs). Nevertheless, training these models on complex problems remains challenging, often leading to limited accuracy and…

Machine Learning · Statistics 2025-11-13 Wenqian Chen , Amanda Howard , Panos Stinis

This short note describes the concept of guided training of deep neural networks (DNNs) to learn physically reasonable solutions. DNNs are being widely used to predict phenomena in physics and mechanics. One of the issues of DNNs is that…

Machine Learning · Computer Science 2023-04-25 Kazuo Yonekura

In recent years, a plethora of methods combining deep neural networks and partial differential equations have been developed. A widely known and popular example are physics-informed neural networks. They solve forward and inverse problems…

Optimization and Control · Mathematics 2022-07-04 Bastian Zapf , Johannes Haubner , Miroslav Kuchta , Geir Ringstad , Per Kristian Eide , Kent-Andre Mardal

This study investigates the potential accuracy boundaries of physics-informed neural networks, contrasting their approach with previous similar works and traditional numerical methods. We find that selecting improved optimization algorithms…

Computational Physics · Physics 2024-12-16 Jorge F. Urbán , Petros Stefanou , José A. Pons