English
Related papers

Related papers: Are Two Hidden Layers Still Enough for the Physics…

200 papers

To improve predictive models for STEM applications, supplemental physics-based features computed from input parameters are introduced into single and multiple layers of a deep neural network (DNN). While many studies focus on informing DNNs…

Emerging Technologies · Computer Science 2024-09-02 Nicholus R. Clinkinbeard , Nicole N. Hashemi

Recently, researchers have utilized neural networks to accurately solve partial differential equations (PDEs), enabling the mesh-free method for scientific computation. Unfortunately, the network performance drops when encountering a high…

Machine Learning · Computer Science 2021-09-29 Pongpisit Thanasutives , Masayuki Numao , Ken-ichi Fukui

The recent rise of deep learning has led to numerous applications, including solving partial differential equations using Physics-Informed Neural Networks. This approach has proven highly effective in several academic cases. However, their…

Numerical Analysis · Mathematics 2024-10-07 Marien Chenaud , Frédéric Magoulès , José Alves

Deep learning has been shown to be an effective tool in solving partial differential equations (PDEs) through physics-informed neural networks (PINNs). PINNs embed the PDE residual into the loss function of the neural network, and have been…

Machine Learning · Computer Science 2022-04-06 Jeremy Yu , Lu Lu , Xuhui Meng , George Em Karniadakis

Partial differential equations play a fundamental role in the mathematical modelling of many processes and systems in physical, biological and other sciences. To simulate such processes and systems, the solutions of PDEs often need to be…

Numerical Analysis · Mathematics 2023-02-09 Tamara G. Grossmann , Urszula Julia Komorowska , Jonas Latz , Carola-Bibiane Schönlieb

As an emerging technology in deep learning, physics-informed neural networks (PINNs) have been widely used to solve various partial differential equations (PDEs) in engineering. However, PDEs based on practical considerations contain…

Machine Learning · Computer Science 2021-11-11 Yuhao Huang

A significant advancement in Neural Network (NN) research is the integration of domain-specific knowledge through custom loss functions. This approach addresses a crucial challenge: how can models utilize physics or mathematical principles…

Machine Learning · Computer Science 2025-03-27 Seyedeh Azadeh Fallah Mortezanejad , Ruochen Wang , Ali Mohammad-Djafari

Despite the great promise of the physics-informed neural networks (PINNs) in solving forward and inverse problems, several technical challenges are present as roadblocks for more complex and realistic applications. First, most existing…

Computational Engineering, Finance, and Science · Computer Science 2022-01-26 Han Gao , Matthew J. Zahr , Jian-Xun Wang

Recent work in scientific machine learning has developed so-called physics-informed neural network (PINN) models. The typical approach is to incorporate physical domain knowledge as soft constraints on an empirical loss function and use…

Machine Learning · Computer Science 2021-11-12 Aditi S. Krishnapriyan , Amir Gholami , Shandian Zhe , Robert M. Kirby , Michael W. Mahoney

Physics-Informed Neural Networks (PINNs) are a powerful deep learning method capable of providing solutions and parameter estimations of physical systems. Given the complexity of their neural network structure, the convergence speed is…

Machine Learning · Computer Science 2025-01-28 Sirui Li , Federica Bragone , Matthieu Barreau , Kateryna Morozovska

How to develop slim and accurate deep neural networks has become crucial for real- world applications, especially for those employed in embedded systems. Though previous work along this research line has shown some promising results, most…

Neural and Evolutionary Computing · Computer Science 2019-10-02 Xin Dong , Shangyu Chen , Sinno Jialin Pan

The widespread use of neural networks across different scientific domains often involves constraining them to satisfy certain symmetries, conservation laws, or other domain knowledge. Such constraints are often imposed as soft penalties…

Machine Learning · Computer Science 2020-01-15 Sifan Wang , Yujun Teng , Paris Perdikaris

Physics-Informed Neural Networks (PINNs) have emerged as powerful tools for solving partial differential equations (PDEs). However, training PINNs from scratch is often computationally intensive and time-consuming. To address this problem,…

Numerical Analysis · Mathematics 2024-10-21 Sidi Wu

Physics-informed deep learning has emerged as a promising framework for solving partial differential equations (PDEs). Nevertheless, training these models on complex problems remains challenging, often leading to limited accuracy and…

Machine Learning · Statistics 2025-11-13 Wenqian Chen , Amanda Howard , Panos Stinis

Solving analytically intractable partial differential equations (PDEs) that involve at least one variable defined on an unbounded domain arises in numerous physical applications. Accurately solving unbounded domain PDEs requires efficient…

Machine Learning · Computer Science 2026-05-12 Mingtao Xia , Lucas Böttcher , Tom Chou

Physics-informed neural networks (PINNs) are an increasingly powerful way to solve partial differential equations, generate digital twins, and create neural surrogates of physical models. In this manuscript we detail the inner workings of…

In the present work, a multi-scale framework for neural network enhanced methods is proposed for approximation of function and solution of partial differential equations (PDEs). By introducing the multi-scale concept, the total solution of…

Numerical Analysis · Mathematics 2022-09-07 Xiaodan Ren

This paper investigates multilevel initialization strategies for training very deep neural networks with a layer-parallel multigrid solver. The scheme is based on the continuous interpretation of the training problem as a problem of optimal…

Machine Learning · Computer Science 2019-12-20 Eric C. Cyr , Stefanie Günther , Jacob B. Schroder

Physics-informed deep learning has emerged as a promising alternative for solving partial differential equations. However, for complex problems, training these networks can still be challenging, often resulting in unsatisfactory accuracy…

Machine Learning · Computer Science 2025-09-18 Wenqian Chen , Amanda A. Howard , Panos Stinis

Physics-informed neural networks (PINNs) as a means of discretizing partial differential equations (PDEs) are garnering much attention in the Computational Science and Engineering (CS&E) world. At least two challenges exist for PINNs at…

Computational Physics · Physics 2023-01-23 Michael Penwarden , Shandian Zhe , Akil Narayan , Robert M. Kirby