English
Related papers

Related papers: Optimally weighted loss functions for solving PDEs…

200 papers

Partial differential equations (PDEs) are among the most universal and parsimonious descriptions of natural physical laws, capturing a rich variety of phenomenology and multi-scale physics in a compact and symbolic representation. This…

Machine Learning · Computer Science 2023-03-31 Steven L. Brunton , J. Nathan Kutz

Developing algorithms for solving high-dimensional partial differential equations (PDEs) has been an exceedingly difficult task for a long time, due to the notoriously difficult problem known as the "curse of dimensionality". This paper…

Numerical Analysis · Mathematics 2020-07-17 Jiequn Han , Arnulf Jentzen , Weinan E

This paper studies an unsupervised deep learning-based numerical approach for solving partial differential equations (PDEs). The approach makes use of the deep neural network to approximate solutions of PDEs through the compositional…

Machine Learning · Computer Science 2020-08-26 Zhiqiang Cai , Jingshuang Chen , Min Liu , Xinyu Liu

Neural networks can be used to learn the solution of partial differential equations (PDEs) on arbitrary domains without requiring a computational mesh. Common approaches integrate differential operators in training neural networks using a…

Machine Learning · Computer Science 2022-07-07 Shamsulhaq Basir , Inanc Senocak

The curse of dimensionality is commonly encountered in numerical partial differential equations (PDE), especially when uncertainties have to be modeled into the equations as random coefficients. However, very often the variability of…

Numerical Analysis · Mathematics 2021-07-01 Yuehaw Khoo , Jianfeng Lu , Lexing Ying

We show that the error achievable using physics-informed neural networks for solving systems of differential equations can be substantially reduced when these networks are trained using meta-learned optimization methods rather than to using…

Machine Learning · Computer Science 2023-03-15 Alex Bihlo

We present a method to solve initial and boundary value problems using artificial neural networks. A trial solution of the differential equation is written as a sum of two parts. The first part satisfies the boundary (or initial) conditions…

Computational Physics · Physics 2016-11-15 I. E. Lagaris , A. Likas , D. I. Fotiadis

We present a lightweighted neural PDE representation to discover the hidden structure and predict the solution of different nonlinear PDEs. Our key idea is to leverage the prior of ``translational similarity'' of numerical PDE differential…

Machine Learning · Computer Science 2023-03-14 Ziqian Wu , Xingzhe He , Yijun Li , Cheng Yang , Rui Liu , Shiying Xiong , Bo Zhu

This work proposes a solution for the problem of training physics-informed networks under partial integro-differential equations. These equations require an infinite or a large number of neural evaluations to construct a single residual for…

Machine Learning · Computer Science 2024-06-12 Ehsan Saleh , Saba Ghaffari , Timothy Bretl , Luke Olson , Matthew West

Providing fast and accurate solutions to partial differential equations is a problem of continuous interest to the fields of applied mathematics and physics. With the recent advances in machine learning, the adoption learning techniques in…

Computational Physics · Physics 2019-04-16 S. Mohammad H. Hashemi , Demetri Psaltis

We present two effective methods for solving high-dimensional partial differential equations (PDE) based on randomized neural networks. Motivated by the universal approximation property of this type of networks, both methods extend the…

Numerical Analysis · Mathematics 2023-09-14 Yiran Wang , Suchuan Dong

Using neural networks to solve partial differential equations (PDEs) is gaining popularity as an alternative approach in the scientific computing community. Neural networks can integrate different types of information into the loss…

Machine Learning · Computer Science 2024-05-07 Zhiwei Wang , Lulu Zhang , Zhongwang Zhang , Zhi-Qin John Xu

The combination of Monte Carlo methods and deep learning has recently led to efficient algorithms for solving partial differential equations (PDEs) in high dimensions. Related learning problems are often stated as variational formulations…

Machine Learning · Computer Science 2022-08-08 Lorenz Richter , Julius Berner

In recent years, there has been an increasing interest in using deep learning and neural networks to tackle scientific problems, particularly in solving partial differential equations (PDEs). However, many neural network-based methods, such…

Machine Learning · Computer Science 2025-02-14 Adrian Celaya , Yimo Wang , David Fuentes , Beatrice Riviere

In recent years, Physics-Informed Neural Networks (PINNs) have become a representative method for solving partial differential equations (PDEs) with neural networks. PINNs provide a novel approach to solving PDEs through optimization…

Computational Physics · Physics 2024-11-28 Weiwei Zhang , Wei Suo , Jiahao Song , Wenbo Cao

The success of deep neural networks hinges on our ability to accurately and efficiently optimize high-dimensional, non-convex functions. In this paper, we empirically investigate the loss functions of state-of-the-art networks, and how…

Machine Learning · Computer Science 2017-12-11 Daniel Jiwoong Im , Michael Tao , Kristin Branson

The article discusses the development of various methods and techniques for initializing and training neural networks with a single hidden layer, as well as training a separable physics-informed neural network consisting of neural networks…

Numerical Analysis · Mathematics 2025-07-08 Vasiliy A. Es'kin , Alexey O. Malkhanov , Mikhail E. Smorkalov

Traditional Monte Carlo integration using uniform random sampling exhibits degraded efficiency in low-regularity or high-dimensional problems. We propose a novel deep learning framework based on deterministic number-theoretic sampling…

Numerical Analysis · Mathematics 2025-07-03 Yu Yang , Pingan He , Xiaoling Peng , Qiaolin He

Deep learning has shown successful application in visual recognition and certain artificial intelligence tasks. Deep learning is also considered as a powerful tool with high flexibility to approximate functions. In the present work,…

Machine Learning · Computer Science 2021-12-23 Ayan Chakraborty , Thomas Wick , Xiaoying Zhuang , Timon Rabczuk

Based on neural network and adaptive subspace approximation method, we propose a new machine learning method for solving partial differential equations. The neural network is adopted to build the basis of the finite dimensional subspace.…

Numerical Analysis · Mathematics 2024-12-04 Zhongshuo Lin , Yifan Wang , Hehu Xie