English
Related papers

Related papers: Attention-enhanced neural differential equations f…

200 papers

Partial differential equations (PDEs) form the backbone of simulations of many natural phenomena, for example in climate modeling, material science, and even financial markets. The application of physics-informed neural networks to…

Quantum Physics · Physics 2026-04-17 Nils Klement , Veronika Eyring , Mierk Schwabe

This paper explores the difficulties in solving partial differential equations (PDEs) using physics-informed neural networks (PINNs). PINNs use physics as a regularization term in the objective function. However, a drawback of this approach…

Machine Learning · Computer Science 2023-06-21 Shamsulhaq Basir

The data-driven discovery of partial differential equations (PDEs) consistent with spatiotemporal data is experiencing a rebirth in machine learning research. Training deep neural networks to learn such data-driven partial differential…

Numerical Analysis · Mathematics 2020-11-10 Hassan Arbabi , Judith E. Bunder , Giovanni Samaey , Anthony J. Roberts , Ioannis G. Kevrekidis

Deep learning has revolutionized the field of computer vision by introducing large scale neural networks with millions of parameters. Training these networks requires massive datasets and leads to intransparent models that can fail to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Tom Fischer , Pascal Peter , Joachim Weickert , Eddy Ilg

Neural solvers for partial differential equations (PDEs) have great potential to generate fast and accurate physics solutions, yet their practicality is currently limited by their generalizability. PDEs evolve over broad scales and exhibit…

Machine Learning · Computer Science 2024-12-06 Anthony Zhou , Amir Barati Farimani

Ordinary and partial differential equations (DE) are used extensively in scientific and mathematical domains to model physical systems. Current literature has focused primarily on deep neural network (DNN) based methods for solving a…

Neural and Evolutionary Computing · Computer Science 2023-06-21 Hyeonjung , Jung , Jayant Gupta , Bharat Jayaprakash , Matthew Eagon , Harish Panneer Selvam , Carl Molnar , William Northrop , Shashi Shekhar

Deriving governing equations in Electromagnetic (EM) environment based on first principles can be quite tough when there are some unknown sources of noise and other uncertainties in the system. For nonlinear multiple-physics electromagnetic…

Computational Physics · Physics 2019-10-31 Bing Xiong , Haiyang Fu , Feng Xu , Yaqiu Jin

Learning dynamics governed by differential equations is crucial for predicting and controlling the systems in science and engineering. Neural Ordinary Differential Equation (NODE), a deep learning model integrated with differential…

Machine Learning · Computer Science 2021-11-09 Shiqi Gong , Qi Meng , Yue Wang , Lijun Wu , Wei Chen , Zhi-Ming Ma , Tie-Yan Liu

Physics informed neural networks (PINNs) have emerged as a powerful tool to provide robust and accurate approximations of solutions to partial differential equations (PDEs). However, PINNs face serious difficulties and challenges when…

Machine Learning · Computer Science 2023-07-11 Rajat Arora

Solving nonlinear partial differential equations (PDEs) with multiple solutions using neural networks has found widespread applications in various fields such as physics, biology, and engineering. However, classical neural network methods…

Machine Learning · Computer Science 2024-05-24 Wenrui Hao , Xinliang Liu , Yahong Yang

Physics-informed neural network architectures have emerged as a powerful tool for developing flexible PDE solvers which easily assimilate data, but face challenges related to the PDE discretization underpinning them. By instead adapting a…

Numerical Analysis · Mathematics 2020-12-11 Ravi G. Patel , Indu Manickam , Nathaniel A. Trask , Mitchell A. Wood , Myoungkyu Lee , Ignacio Tomas , Eric C. Cyr

Owing to the remarkable development of deep learning technology, there have been a series of efforts to build deep learning-based climate models. Whereas most of them utilize recurrent neural networks and/or graph neural networks, we design…

Machine Learning · Computer Science 2021-11-12 Jeehyun Hwang , Jeongwhan Choi , Hwangyong Choi , Kookjin Lee , Dongeun Lee , Noseong Park

The recent rise of deep learning has led to numerous applications, including solving partial differential equations using Physics-Informed Neural Networks. This approach has proven highly effective in several academic cases. However, their…

Numerical Analysis · Mathematics 2024-10-07 Marien Chenaud , Frédéric Magoulès , José Alves

Recent work in deep learning focuses on solving physical systems in the Ordinary Differential Equation or Partial Differential Equation. This current work proposed a variant of Convolutional Neural Networks (CNNs) that can learn the hidden…

Machine Learning · Computer Science 2021-11-02 Mansura Habiba , Barak A. Pearlmutter

We present a method that employs physics-informed deep learning techniques for parametrically solving partial differential equations. The focus is on the steady-state heat equations within heterogeneous solids exhibiting significant phase…

Machine Learning · Computer Science 2024-01-05 Shahed Rezaei , Ahmad Moeineddin , Michael Kaliske , Markus Apel

Partial differential equations (PDEs) are central to scientific modeling. Modern workflows increasingly rely on learning-based components to support model reuse, inference, and integration across large computational processes. Despite the…

Machine Learning · Computer Science 2026-02-20 Yilong Dai , Shengyu Chen , Ziyi Wang , Xiaowei Jia , Yiqun Xie , Vipin Kumar , Runlong Yu

Equations governing physico-chemical processes are usually known at microscopic spatial scales, yet one suspects that there exist equations, e.g. in the form of Partial Differential Equations (PDEs), that can explain the system evolution at…

Machine Learning · Statistics 2021-03-31 Hassan Arbabi , Ioannis Kevrekidis

Recent research has used deep learning to develop partial differential equation (PDE) models in science and engineering. The functional form of the PDE is determined by a neural network, and the neural network parameters are calibrated to…

Machine Learning · Computer Science 2023-10-17 Justin Sirignano , Jonathan MacArt , Konstantinos Spiliopoulos

Unveiling the underlying governing equations of nonlinear dynamic systems remains a significant challenge. Insufficient prior knowledge hinders the determination of an accurate candidate library, while noisy observations lead to imprecise…

Machine Learning · Computer Science 2024-04-30 Mengge Du , Yuntian Chen , Longfeng Nie , Siyu Lou , Dongxiao Zhang

Finding accurate solutions to partial differential equations (PDEs) is a crucial task in all scientific and engineering disciplines. It has recently been shown that machine learning methods can improve the solution accuracy by correcting…

Computational Physics · Physics 2021-01-06 Kiwon Um , Robert Brand , Yun , Fei , Philipp Holl , Nils Thuerey