English
Related papers

Related papers: Deep collocation method: A framework for solving P…

200 papers

Throughout many fields, practitioners often rely on differential equations to model systems. Yet, for many applications, the theoretical derivation of such equations and/or accurate resolution of their solutions may be intractable. Instead,…

Machine Learning · Computer Science 2025-01-16 Grant Norman , Jacqueline Wentz , Hemanth Kolla , Kurt Maute , Alireza Doostan

We examine the challenges associated with numerical integration when applying Neural Networks to solve Partial Differential Equations (PDEs). We specifically investigate the Deep Ritz Method (DRM), chosen for its practical applicability and…

Numerical Analysis · Mathematics 2025-05-09 Jamie M. Taylor , David Pardo

We propose a scalable framework for the learning of high-dimensional parametric maps via adaptively constructed residual network (ResNet) maps between reduced bases of the inputs and outputs. When just few training data are available, it is…

Physics-informed neural networks (PINNs) have gained significant attention for solving forward and inverse problems related to partial differential equations (PDEs). While advancements in loss functions and network architectures have…

Machine Learning · Computer Science 2025-08-11 Adrian Celaya , David Fuentes , Beatrice Riviere

We introduce a simple, rigorous, and unified framework for solving nonlinear partial differential equations (PDEs), and for solving inverse problems (IPs) involving the identification of parameters in PDEs, using the framework of Gaussian…

Numerical Analysis · Mathematics 2021-08-12 Yifan Chen , Bamdad Hosseini , Houman Owhadi , Andrew M Stuart

Deep neural networks (DNNs), especially physics-informed neural networks (PINNs), have recently become a new popular method for solving forward and inverse problems governed by partial differential equations (PDEs). However, these methods…

Machine Learning · Computer Science 2023-10-26 Wenbo Cao , Weiwei Zhang

Developing algorithms for solving high-dimensional partial differential equations (PDEs) has been an exceedingly difficult task for a long time, due to the notoriously difficult problem known as the "curse of dimensionality". This paper…

Numerical Analysis · Mathematics 2020-07-17 Jiequn Han , Arnulf Jentzen , Weinan E

Randomized neural networks (RaNNs) are attractive for partial differential equations (PDEs) because they replace expensive end-to-end training with a linear least-squares solve over randomized hidden features. Their practical performance,…

Numerical Analysis · Mathematics 2026-04-28 You Yang , Fei Wang

Empirical interpolation method (EIM) is a well-known technique to efficiently approximate parameterized functions. This paper proposes to use EIM algorithm to efficiently reduce the dimension of the training data within supervised machine…

Machine Learning · Computer Science 2023-05-18 Harbir Antil , Madhu Gupta , Randy Price

Recently, neural network based methods have shown their power in learning more expressive features on the task of knowledge graph embedding (KGE). However, the performance of deep methods often falls behind the shallow ones on simple…

Computation and Language · Computer Science 2022-11-10 Zhu Danhao , Shen Si , Huang Shujian , Yin Chang , Ding Ziqi

Deep neural networks are powerful tools for solving nonlinear problems in science and engineering, but training highly accurate models becomes challenging as problem complexity increases. Non-convex optimization and sensitivity to…

Machine Learning · Computer Science 2026-04-20 Ethan Mulle , Wei Kang , Qi Gong

Deep neural networks (DNNs) have recently emerged as effective tools for approximating solution operators of partial differential equations (PDEs) including evolutionary problems. Classical numerical solvers for such PDEs often face…

Numerical Analysis · Mathematics 2025-09-05 Ke Chen , Meenakshi Krishnan , Haizhao Yang

Solving partial differential equations (PDEs) using neural networks has become a central focus in scientific machine learning. Training neural networks for singularly perturbed problems is particularly challenging due to certain parameters…

Machine Learning · Computer Science 2025-05-30 Chuqi Chen , Yahong Yang , Yang Xiang , Wenrui Hao

Recently proposed numerical algorithms for solving high-dimensional nonlinear partial differential equations (PDEs) based on neural networks have shown their remarkable performance. We review some of them and study their convergence…

Analysis of PDEs · Mathematics 2021-09-17 Maximilien Germain , Huyen Pham , Xavier Warin

Physics-informed deep learning has emerged as a promising framework for solving partial differential equations (PDEs). Nevertheless, training these models on complex problems remains challenging, often leading to limited accuracy and…

Machine Learning · Statistics 2025-11-13 Wenqian Chen , Amanda Howard , Panos Stinis

Numerical solution of partial differential equations (PDEs) plays a vital role in various fields of science and engineering. In recent years, deep neural networks (DNNs) have emerged as a powerful tool for solving PDEs, leveraging their…

Numerical Analysis · Mathematics 2026-02-16 Shuo Ling , Wenjun Ying , Zhen Zhang

We develop a framework for estimating unknown partial differential equations from noisy data, using a deep learning approach. Given noisy samples of a solution to an unknown PDE, our method interpolates the samples using a neural network,…

Machine Learning · Computer Science 2019-10-24 Ali Hasan , João M. Pereira , Robert Ravier , Sina Farsiu , Vahid Tarokh

Approximate solutions of partial differential equations (PDEs) obtained by neural networks are highly affected by hyper parameter settings. For instance, the model training strongly depends on loss function design, including the choice of…

Numerical Analysis · Mathematics 2025-03-13 Hee Jun Yang , Alexander Heinlein , Hyea Hyun Kim

In this paper, we introduce and analyze a new low-rank multilevel strategy for the solution of random diffusion problems. Using a standard stochastic collocation scheme, we first approximate the infinite dimensional random problem by a…

Numerical Analysis · Mathematics 2016-06-20 Jonas Ballani , Daniel Kressner , Michael Peters

Evolutional deep neural networks (EDNN) solve partial differential equations (PDEs) by marching the network representation of the solution fields, using the governing equations. Use of a single network to solve coupled PDEs on large domains…

Numerical Analysis · Mathematics 2024-07-18 Hadden Kim , Tamer A. Zaki