English
Related papers

Related papers: A Discussion on Solving Partial Differential Equat…

200 papers

The least squares method with deep neural networks as function parametrization has been applied to solve certain high-dimensional partial differential equations (PDEs) successfully; however, its convergence is slow and might not be…

Numerical Analysis · Mathematics 2021-12-30 Yiqi Gu , Haizhao Yang , Chao Zhou

Neural ordinary differential equations (ODEs) have attracted much attention as continuous-time counterparts of deep residual neural networks (NNs), and numerous extensions for recurrent NNs have been proposed. Since the 1980s, ODEs have…

Machine Learning · Computer Science 2022-10-17 Kazuki Irie , Francesco Faccio , Jürgen Schmidhuber

In recent years, deep learning technology has been used to solve partial differential equations (PDEs), among which the physics-informed neural networks (PINNs) emerges to be a promising method for solving both forward and inverse PDE…

Machine Learning · Computer Science 2021-11-03 Xiang Huang , Hongsheng Liu , Beiji Shi , Zidong Wang , Kang Yang , Yang Li , Bingya Weng , Min Wang , Haotian Chu , Jing Zhou , Fan Yu , Bei Hua , Lei Chen , Bin Dong

Many physical processes such as weather phenomena or fluid mechanics are governed by partial differential equations (PDEs). Modelling such dynamical systems using Neural Networks is an active research field. However, current methods are…

Machine Learning · Computer Science 2022-10-12 Andrzej Dulny , Andreas Hotho , Anna Krause

Partial differential equations (PDEs) are ubiquitous in the world around us, modelling phenomena from heat and sound to quantum systems. Recent advances in deep learning have resulted in the development of powerful neural solvers; however,…

Artificial Intelligence · Computer Science 2023-11-13 Yolanne Yi Ran Lee

This paper proposes the Nerual Energy Descent (NED) via neural network evolution equations for a wide class of deep learning problems. We show that deep learning can be reformulated as the evolution of network parameters in an evolution…

Numerical Analysis · Mathematics 2023-02-22 Wenrui Hao , Chunmei Wang , Xingjian Xu , Haizhao Yang

Data-driven methods have recently made great progress in the discovery of partial differential equations (PDEs) from spatial-temporal data. However, several challenges remain to be solved, including sparse noisy data, incomplete candidate…

Computational Physics · Physics 2021-09-28 Hao Xu , Dongxiao Zhang , Junsheng Zeng

This paper studies deep neural networks for solving extremely large linear systems arising from highdimensional problems. Because of the curse of dimensionality, it is expensive to store both the solution and right-hand side vector in such…

Numerical Analysis · Mathematics 2023-03-07 Yiqi Gu , Michael K. Ng

Partial Differential Equations (PDEs) are central to modeling complex systems across physical, biological, and engineering domains, yet traditional numerical methods often struggle with high-dimensional or complex problems. Physics-Informed…

Machine Learning · Computer Science 2026-02-11 Chenggong Zhang

Physics-informed neural networks (PINNs) have recently become a powerful tool for solving partial differential equations (PDEs). However, finding a set of neural network parameters that lead to fulfilling a PDE can be challenging and…

Machine Learning · Computer Science 2023-04-12 Aleksandr Dekhovich , Marcel H. F. Sluiter , David M. J. Tax , Miguel A. Bessa

In recent years, the researches about solving partial differential equations (PDEs) based on artificial neural network have attracted considerable attention. In these researches, the neural network models are usually designed depend on…

Neural and Evolutionary Computing · Computer Science 2024-05-21 Bo Zhang , Chao Yang

In this article, we introduce and analyze a deep learning based approximation algorithm for SPDEs. Our approach employs neural networks to approximate the solutions of SPDEs along given realizations of the driving noise process. If applied…

Numerical Analysis · Mathematics 2025-10-21 Christian Beck , Sebastian Becker , Patrick Cheridito , Arnulf Jentzen , Ariel Neufeld

There have been growing interests in leveraging experimental measurements to discover the underlying partial differential equations (PDEs) that govern complex physical phenomena. Although past research attempts have achieved great success…

Machine Learning · Computer Science 2023-05-23 Chengping Rao , Pu Ren , Yang Liu , Hao Sun

Unlike conventional grid and mesh based methods for solving partial differential equations (PDEs), neural networks have the potential to break the curse of dimensionality, providing approximate solutions to problems where using classical…

Machine Learning · Computer Science 2023-09-01 Marc Finzi , Andres Potapczynski , Matthew Choptuik , Andrew Gordon Wilson

Solving nonlinear partial differential equations (PDEs) with multiple solutions using neural networks has found widespread applications in various fields such as physics, biology, and engineering. However, classical neural network methods…

Machine Learning · Computer Science 2024-05-24 Wenrui Hao , Xinliang Liu , Yahong Yang

Neural networks are discrete entities: subdivided into discrete layers and parametrized by weights which are iteratively optimized via difference equations. Recent work proposes networks with layer outputs which are no longer quantized but…

Neural and Evolutionary Computing · Computer Science 2019-09-09 Stefano Massaroli , Michael Poli , Federico Califano , Angela Faragasso , Jinkyoo Park , Atsushi Yamashita , Hajime Asama

We present a numerical framework for deep neural network (DNN) modeling of unknown time-dependent partial differential equations (PDE) using their trajectory data. Unlike the recent work of [Wu and Xiu, J. Comput. Phys. 2020], where the…

Machine Learning · Computer Science 2021-11-24 Zhen Chen , Victor Churchill , Kailiang Wu , Dongbin Xiu

The numerical solution of partial differential equations (PDEs) is difficult, having led to a century of research so far. Recently, there have been pushes to build neural--numerical hybrid solvers, which piggy-backs the modern trend towards…

Machine Learning · Computer Science 2023-03-21 Johannes Brandstetter , Daniel Worrall , Max Welling

Neural Ordinary Differential Equations (N-ODEs) are a powerful building block for learning systems, which extend residual networks to a continuous-time dynamical system. We propose a Bayesian version of N-ODEs that enables well-calibrated…

Machine Learning · Computer Science 2020-02-19 Andreas Look , Melih Kandemir

This paper explores the difficulties in solving partial differential equations (PDEs) using physics-informed neural networks (PINNs). PINNs use physics as a regularization term in the objective function. However, a drawback of this approach…

Machine Learning · Computer Science 2023-06-21 Shamsulhaq Basir