English
Related papers

Related papers: Greedy Training Algorithms for Neural Networks and…

200 papers

Physics-informed neural networks (PINNs) have recently emerged as a prominent paradigm for solving partial differential equations (PDEs), yet their training strategies remain underexplored. While hard prioritization methods inspired by…

Machine Learning · Computer Science 2025-12-22 Zhaoqian Gao , Min Yanga

Learning the solution of partial differential equations (PDEs) with a neural network is an attractive alternative to traditional solvers due to its elegance, greater flexibility and the ease of incorporating observed data. However, training…

Machine Learning · Computer Science 2024-07-18 Katsiaryna Haitsiukevich , Alexander Ilin

Many engineering and scientific fields have recently become interested in modeling terms in partial differential equations (PDEs) with neural networks, which requires solving the inverse problem of learning neural network terms from…

Machine Learning · Computer Science 2026-03-30 Konstantin Riedl , Justin Sirignano , Konstantinos Spiliopoulos

Recent research has used deep learning to develop partial differential equation (PDE) models in science and engineering. The functional form of the PDE is determined by a neural network, and the neural network parameters are calibrated to…

Machine Learning · Computer Science 2023-10-17 Justin Sirignano , Jonathan MacArt , Konstantinos Spiliopoulos

Methods for solving PDEs using neural networks have recently become a very important topic. We provide an a priori error analysis for such methods which is based on the $\mathcal{K}_1(\mathbb{D})$-norm of the solution. We show that the…

Numerical Analysis · Mathematics 2022-07-15 Qingguo Hong , Jonathan W. Siegel , Jinchao Xu

Greedy algorithms, particularly the orthogonal greedy algorithm (OGA), have proven effective in training shallow neural networks for fitting functions and solving partial differential equations (PDEs). In this paper, we extend the…

Numerical Analysis · Mathematics 2025-01-07 Ye Lin , Jiwei Jia , Young Ju Lee , Ran Zhang

We present a unified convergence theory for gradient-based training of neural network methods for partial differential equations (PDEs), covering both physics-informed neural networks (PINNs) and the Deep Ritz method. For linear PDEs, we…

Numerical Analysis · Mathematics 2025-10-09 Wei Zhao , Tao Luo

Currently, deep neural networks are deployed on low-power portable devices by first training a full-precision model using powerful hardware, and then deriving a corresponding low-precision model for efficient inference on such systems.…

Machine Learning · Computer Science 2017-11-15 Hao Li , Soham De , Zheng Xu , Christoph Studer , Hanan Samet , Tom Goldstein

Deep learning has been shown to be an effective tool in solving partial differential equations (PDEs) through physics-informed neural networks (PINNs). PINNs embed the PDE residual into the loss function of the neural network, and have been…

Machine Learning · Computer Science 2022-04-06 Jeremy Yu , Lu Lu , Xuhui Meng , George Em Karniadakis

In recent years, neural networks have achieved remarkable progress in various fields and have also drawn much attention in applying them on scientific problems. A line of methods involving neural networks for solving partial differential…

Numerical Analysis · Mathematics 2025-05-20 Xianliang Xu , Ye Li , Zhongyi Huang

Greedy algorithms have been successfully analyzed and applied in training neural networks for solving variational problems, ensuring guaranteed convergence orders. In this paper, we extend the analysis of the orthogonal greedy algorithm…

Numerical Analysis · Mathematics 2025-04-21 Jinchao Xu , Xiaofeng Xu

Neural networks can be trained to solve partial differential equations (PDEs) by using the PDE residual as the loss function. This strategy is called "physics-informed neural networks" (PINNs), but it currently cannot produce high-accuracy…

Machine Learning · Computer Science 2024-04-11 Qi Zeng , Yash Kothari , Spencer H. Bryngelson , Florian Schäfer

Physics-informed neural networks (PINNs) have emerged as a promising approach to solving partial differential equations (PDEs) using neural networks, particularly in data-scarce scenarios, due to their unsupervised training capability.…

Machine Learning · Computer Science 2025-03-25 Edgar Torres , Jonathan Schiefer , Mathias Niepert

The paper presents a priori error analysis of the shallow neural network approximation to the solution to the indefinite elliptic equation and and cutting-edge implementation of the Orthogonal Greedy Algorithm (OGA) tailored to overcome the…

Numerical Analysis · Mathematics 2024-10-28 Qingguo Hong , Jiwei Jia , Young Ju Lee , Ziqian Li

Neural network-based methods have emerged as powerful tools for solving partial differential equations (PDEs) in scientific and engineering applications, particularly when handling complex domains or incorporating empirical data. These…

Numerical Analysis · Mathematics 2024-10-10 Chuqi Chen , Qixuan Zhou , Yahong Yang , Yang Xiang , Tao Luo

Deep neural networks (DNNs), especially physics-informed neural networks (PINNs), have recently become a new popular method for solving forward and inverse problems governed by partial differential equations (PDEs). However, these methods…

Machine Learning · Computer Science 2023-10-26 Wenbo Cao , Weiwei Zhang

Reduced bases have been introduced for the approximation of parametrized PDEs in applications where many online queries are required. Their numerical efficiency for such problems has been theoretically confirmed in \cite{BCDDPW,DPW}, where…

Numerical Analysis · Mathematics 2020-02-20 Albert Cohen , Wolfgang Dahmen , Ronald DeVore

In this work, we study physics-informed neural networks (PINNs) constrained by partial differential equations (PDEs) and their application in approximating PDEs with two characteristic scales. From a continuous perspective, our formulation…

Optimization and Control · Mathematics 2024-09-06 Michael Hintermüller , Denis Korolev

Two aspects of neural networks that have been extensively studied in the recent literature are their function approximation properties and their training by gradient descent methods. The approximation problem seeks accurate approximations…

Machine Learning · Computer Science 2022-09-20 R. Gentile , G. Welper

Recent works have shown that deep neural networks can be employed to solve partial differential equations, giving rise to the framework of physics informed neural networks. We introduce a generalization for these methods that manifests as a…

Numerical Analysis · Mathematics 2021-03-25 Remco van der Meer , Cornelis Oosterlee , Anastasia Borovykh
‹ Prev 1 2 3 10 Next ›