English
Related papers

Related papers: Characterizing and Mitigating the Difficulty in Tr…

200 papers

This paper explores the difficulties in solving partial differential equations (PDEs) using physics-informed neural networks (PINNs). PINNs use physics as a regularization term in the objective function. However, a drawback of this approach…

Machine Learning · Computer Science 2023-06-21 Shamsulhaq Basir

Recently, researchers have utilized neural networks to accurately solve partial differential equations (PDEs), enabling the mesh-free method for scientific computation. Unfortunately, the network performance drops when encountering a high…

Machine Learning · Computer Science 2021-09-29 Pongpisit Thanasutives , Masayuki Numao , Ken-ichi Fukui

Physics-informed deep learning often faces optimization challenges due to the complexity of solving partial differential equations (PDEs), which involve exploring large solution spaces, require numerous iterations, and can lead to unstable…

In the last decade, deep learning has become a major component of artificial intelligence. The workhorse of deep learning is the optimization of loss functions by stochastic gradient descent (SGD). Traditionally in deep learning, neural…

Machine Learning · Computer Science 2021-04-27 Benjamin Scellier

Several recent works in scientific machine learning have revived interest in the application of neural networks to partial differential equations (PDEs). A popular approach is to aggregate the residual form of the governing PDE and its…

Machine Learning · Computer Science 2023-09-13 Shamsulhaq Basir , Inanc Senocak

Neural operators have emerged as promising surrogate models for solving partial differential equations (PDEs), but struggle to generalise beyond training distributions and are often constrained to a fixed temporal discretisation. This work…

Physics-informed neural networks (PINNs) have emerged as a prominent approach for solving partial differential equations (PDEs) by minimizing a combined loss function that incorporates both boundary loss and PDE residual loss. Despite their…

Machine Learning · Computer Science 2025-01-16 Youngsik Hwang , Dong-Young Lim

The approximation of solutions of partial differential equations (PDEs) with numerical algorithms is a central topic in applied mathematics. For many decades, various types of methods for this purpose have been developed and extensively…

Numerical Analysis · Mathematics 2024-08-26 Lukas Gonon , Arnulf Jentzen , Benno Kuckuck , Siyu Liang , Adrian Riekert , Philippe von Wurstemberger

Physics-informed neural networks (PINNs) have emerged as a promising approach to solving partial differential equations (PDEs) using neural networks, particularly in data-scarce scenarios, due to their unsupervised training capability.…

Machine Learning · Computer Science 2025-03-25 Edgar Torres , Jonathan Schiefer , Mathias Niepert

This work proposes a solution for the problem of training physics-informed networks under partial integro-differential equations. These equations require an infinite or a large number of neural evaluations to construct a single residual for…

Machine Learning · Computer Science 2024-06-12 Ehsan Saleh , Saba Ghaffari , Timothy Bretl , Luke Olson , Matthew West

Backpropagation (BP) remains the dominant and most successful method for training parameters of deep neural network models. However, BP relies on two computationally distinct phases, does not provide a satisfactory explanation of biological…

Machine Learning · Computer Science 2025-11-12 Sander Dalm , Marcel van Gerven , Nasir Ahmad

Physics-Informed Neural Networks (PINNs) have become a prominent application of deep learning in scientific computation, as they are powerful approximators of solutions to nonlinear partial differential equations (PDEs). There have been…

Machine Learning · Computer Science 2023-06-01 Hwijae Son , Sung Woong Cho , Hyung Ju Hwang

Solving inverse problems in physics is central to understanding complex systems and advancing technologies in various fields. Iterative optimization algorithms, commonly used to solve these problems, often encounter local minima, chaos, or…

Machine Learning · Computer Science 2025-01-29 Girnar Goyal , Philipp Holl , Sweta Agrawal , Nils Thuerey

Physics-informed neural networks (PINNs) have been proposed to learn the solution of partial differential equations (PDE). In PINNs, the residual form of the PDE of interest and its boundary conditions are lumped into a composite objective…

Computational Physics · Physics 2022-05-24 Shamsulhaq Basir , Inanc Senocak

Fractional-order differential equations (FDEs) enhance traditional differential equations by extending the order of differential operators from integers to real numbers, offering greater flexibility in modeling complex dynamical systems…

Machine Learning · Computer Science 2025-03-24 Qiyu Kang , Xuhao Li , Kai Zhao , Wenjun Cui , Yanan Zhao , Weihua Deng , Wee Peng Tay

Physics-informed neural networks approach the approximation of differential equations by directly incorporating their structure and given conditions in a loss function. This enables conditions like, e.g., invariants to be easily added…

Machine Learning · Computer Science 2025-08-20 Santosh Humagain , Toni Schneidereit

Recently, neural networks have been widely applied for solving partial differential equations (PDEs). Although such methods have been proven remarkably successful on practical engineering problems, they have not been shown, theoretically or…

Numerical Analysis · Mathematics 2023-03-27 Jonathan W. Siegel , Qingguo Hong , Xianlin Jin , Wenrui Hao , Jinchao Xu

Neural operators are a popular technique in scientific machine learning to learn a mathematical model of the behavior of unknown physical systems from data. Neural operators are especially useful to learn solution operators associated with…

Numerical Analysis · Mathematics 2022-08-05 Nicolas Boullé , Seick Kim , Tianyi Shi , Alex Townsend

Physics-informed neural networks solve partial differential equations by training neural networks. Since this method approximates infinite-dimensional PDE solutions with finite collocation points, minimizing discretization errors by…

Machine Learning · Computer Science 2024-12-11 Takashi Matsubara , Takaharu Yaguchi

In this paper, we investigate the applications of operator learning, specifically DeepONet, for solving nonlinear partial differential equations (PDEs). Unlike conventional function learning methods that require training separate neural…

Machine Learning · Computer Science 2025-09-30 Yahong Yang
‹ Prev 1 2 3 10 Next ›