English
Related papers

Related papers: A Priori Generalization Analysis of the Deep Ritz …

200 papers

By integrating physics-informed neural network (PINN) techniques with domain decomposition method, a deep domain decomposition method is presented for solving elliptic variational inequality problems. Based on the Ritz variation method, the…

Numerical Analysis · Mathematics 2026-03-13 Yiyang Wang , Qijia Zhou , Shengyuan Deng , Chenliang Li

Deep neural network approaches show promise in solving partial differential equations. However, unlike traditional numerical methods, they face challenges in enforcing essential boundary conditions. The widely adopted penalty-type methods,…

Numerical Analysis · Mathematics 2026-05-06 Haijun Yu , Shuo Zhang

The use of deep learning methods for solving PDEs is a field in full expansion. In particular, Physical Informed Neural Networks, that implement a sampling of the physical domain and use a loss function that penalizes the violation of the…

Machine Learning · Computer Science 2021-12-08 Valentin Mercier , Serge Gratton , Pierre Boudier

We propose a deep learning based method, the Deep Ritz Method, for numerically solving variational problems, particularly the ones that arise from partial differential equations. The Deep Ritz method is naturally nonlinear, naturally…

Machine Learning · Computer Science 2017-10-03 Weinan E , Bing Yu

The aim of this article is to provide a firm mathematical foundation for the application of deep gradient flow methods (DGFMs) for the solution of (high-dimensional) partial differential equations (PDEs). We decompose the generalization…

Numerical Analysis · Mathematics 2026-02-26 Chenguang Liu , Antonis Papapantoleon , Jasper Rou

We present two effective methods for solving high-dimensional partial differential equations (PDE) based on randomized neural networks. Motivated by the universal approximation property of this type of networks, both methods extend the…

Numerical Analysis · Mathematics 2023-09-14 Yiran Wang , Suchuan Dong

Developing algorithms for solving high-dimensional partial differential equations (PDEs) has been an exceedingly difficult task for a long time, due to the notoriously difficult problem known as the "curse of dimensionality". This paper…

Numerical Analysis · Mathematics 2020-07-17 Jiequn Han , Arnulf Jentzen , Weinan E

In recent years, tremendous progress has been made on numerical algorithms for solving partial differential equations (PDEs) in a very high dimension, using ideas from either nonlinear (multilevel) Monte Carlo or deep learning. They are…

Numerical Analysis · Mathematics 2021-12-13 Weinan E , Jiequn Han , Arnulf Jentzen

Deep learning algorithms have been successfully applied to numerically solve linear Kolmogorov partial differential equations~(PDEs). A recent research shows that if the initial functions are bounded, the empirical risk minimization (ERM)…

Numerical Analysis · Mathematics 2024-06-25 Jichang Xiao , Xiaoqun Wang

The finite element method, finite difference method, finite volume method and spectral method have achieved great success in solving partial differential equations. However, the high accuracy of traditional numerical methods is at the cost…

Numerical Analysis · Mathematics 2020-09-25 Jian Li , Jing Yue , Wen Zhang , Wansuo Duan

Empirical risk minimization (ERM) and distributionally robust optimization (DRO) are popular approaches for solving stochastic optimization problems that appear in operations management and machine learning. Existing generalization error…

Optimization and Control · Mathematics 2023-09-26 Garud Iyengar , Henry Lam , Tianyu Wang

We study gradient-based regularization methods for neural networks. We mainly focus on two regularization methods: the total variation and the Tikhonov regularization. Applying these methods is equivalent to using neural networks to solve…

Machine Learning · Computer Science 2022-11-09 Lingfeng Li , Xue-Cheng Tai , Jiang Yang

Partial Differential Equations (PDEs) are central to science and engineering. Since solving them is computationally expensive, a lot of effort has been put into approximating their solution operator via both traditional and recently…

Machine Learning · Computer Science 2025-02-14 Alessandro Longhi , Danny Lathouwers , Zoltán Perkó

The gradient discretisation method (GDM) is a generic framework designed recently, as a discretise in spatial space, to partial differential equations. This paper aims to use the GDM to establish a first general error estimate for numerical…

Numerical Analysis · Mathematics 2020-09-22 Yahya Alnashri

In this paper, we study the convergence behavior of the diffuse domain method (DDM) for solving a class of second-order parabolic partial differential equations with Neumann boundary condition posed on general irregular domains. The DDM…

Numerical Analysis · Mathematics 2025-10-06 Wenrui Hao , Lili Ju , Yuejin Xu

In this paper, we explain a new Iterative Method-Fixed Point and develop its convergence theory for finding approximate solutions of nonlinear equations in the setting of Banach spaces. First, we discuss the convergence analysis of our…

General Mathematics · Mathematics 2022-05-10 Nikos Mantzakouras , Eteri Biragova

Established approaches to obtain generalization bounds in data-driven optimization and machine learning mostly build on solutions from empirical risk minimization (ERM), which depend crucially on the functional complexity of the hypothesis…

Optimization and Control · Mathematics 2022-10-14 Yibo Zeng , Henry Lam

This paper analyzes the convergence rate of a deep Galerkin method for the weak solution (DGMW) of second-order elliptic partial differential equations on $\mathbb{R}^d$ with Dirichlet, Neumann, and Robin boundary conditions, respectively.…

Numerical Analysis · Mathematics 2023-02-07 Yuling Jiao , Yanming Lai , Yang Wang , Haizhao Yang , Yunfei Yang

In this paper, we study the statistical limits in terms of Sobolev norms of gradient descent for solving inverse problem from randomly sampled noisy observations using a general class of objective functions. Our class of objective functions…

Numerical Analysis · Mathematics 2022-09-20 Yiping Lu , Jose Blanchet , Lexing Ying

Extreme learning machine (ELM) is a methodology for solving partial differential equations (PDEs) using a single hidden layer feed-forward neural network. It presets the weight/bias coefficients in the hidden layer with random values, which…

Numerical Analysis · Mathematics 2025-04-30 Chang-Ock Lee , Youngkyu Lee , Byungeun Ryoo