English
Related papers

Related papers: Error Estimation for Physics-informed Neural Netwo…

200 papers

We prove rigorous bounds on the errors resulting from the approximation of the incompressible Navier-Stokes equations with (extended) physics informed neural networks. We show that the underlying PDE residual can be made arbitrarily small…

Numerical Analysis · Mathematics 2023-02-03 Tim De Ryck , Ameya D. Jagtap , Siddhartha Mishra

There have been extensive studies on solving differential equations using physics-informed neural networks. While this method has proven advantageous in many cases, a major criticism lies in its lack of analytical error bounds. Therefore,…

Neural and Evolutionary Computing · Computer Science 2022-07-05 Shuheng Liu , Xiyue Huang , Pavlos Protopapas

We propose a very general framework for deriving rigorous bounds on the approximation error for physics-informed neural networks (PINNs) and operator learning architectures such as DeepONets and FNOs as well as for physics-informed operator…

Machine Learning · Computer Science 2022-10-11 Tim De Ryck , Siddhartha Mishra

Physics informed neural networks (PINNs) have recently been widely used for robust and accurate approximation of PDEs. We provide rigorous upper bounds on the generalization error of PINNs approximating solutions of the forward problem for…

Numerical Analysis · Mathematics 2023-12-07 Siddhartha Mishra , Roberto Molinaro

The use of neural networks to solve differential equations, as an alternative to traditional numerical solvers, has increased recently. However, error bounds for the obtained solutions have only been developed for certain equations. In this…

Machine Learning · Computer Science 2024-11-22 Augusto T. Chantada , Pavlos Protopapas , Luca Gomez Bachar , Susana J. Landau , Claudia G. Scóccola

Physics informed neural networks approximate solutions of PDEs by minimizing pointwise residuals. We derive rigorous bounds on the error, incurred by PINNs in approximating the solutions of a large class of linear parabolic PDEs, namely…

Numerical Analysis · Mathematics 2021-07-13 Tim De Ryck , Siddhartha Mishra

Neural networks are universal approximators and are studied for their use in solving differential equations. However, a major criticism is the lack of error bounds for obtained solutions. This paper proposes a technique to rigorously…

Computational Engineering, Finance, and Science · Computer Science 2023-06-07 Shuheng Liu , Xiyue Huang , Pavlos Protopapas

Large-scale dynamics of the oceans and the atmosphere are governed by primitive equations (PEs). Due to the nonlinearity and nonlocality, the numerical study of the PEs is generally challenging. Neural networks have been shown to be a…

Numerical Analysis · Mathematics 2023-03-21 Ruimeng Hu , Quyuan Lin , Alan Raydan , Sui Tang

We carry out an information-theoretical analysis of a two-layer neural network trained from input-output pairs generated by a teacher network with matching architecture, in overparametrized regimes. Our results come in the form of bounds…

Machine Learning · Computer Science 2023-07-13 Francesco Camilli , Daria Tieplova , Jean Barbier

We probabilistically bound the error of a solution to a radial network topology learning problem where both connectivity and line parameters are estimated. In our model, data errors are introduced by the precision of the sensors, i.e.,…

Systems and Control · Electrical Eng. & Systems 2025-08-08 Samuel Talkington , Aditya Rangarajan , Pedro A. de Alcântara , Line Roald , Daniel K. Molzahn , Daniel R. Fuhrmann

We consider information-theoretic bounds on expected generalization error for statistical learning problems in a networked setting. In this setting, there are $K$ nodes, each with its own independent dataset, and the models from each node…

Information Theory · Computer Science 2024-01-17 L. P. Barnes , Alex Dytso , H. V. Poor

We study in this paper lower bounds for the generalization error of models derived from multi-layer neural networks, in the regime where the size of the layers is commensurate with the number of samples in the training data. We show that…

Machine Learning · Statistics 2022-07-08 Inbar Seroussi , Ofer Zeitouni

We derive bounds on the error, in high-order Sobolev norms, incurred in the approximation of Sobolev-regular as well as analytic functions by neural networks with the hyperbolic tangent activation function. These bounds provide explicit…

Numerical Analysis · Mathematics 2021-12-09 Tim De Ryck , Samuel Lanthaler , Siddhartha Mishra

We present a comprehensive framework for deriving rigorous and efficient bounds on the approximation error of deep neural networks in PDE models characterized by branching mechanisms, such as waves, Schr\"odinger equations, and other…

Numerical Analysis · Mathematics 2024-05-24 Claudio Muñoz , Nicolás Valenzuela

Physics-informed neural networks approach the approximation of differential equations by directly incorporating their structure and given conditions in a loss function. This enables conditions like, e.g., invariants to be easily added…

Machine Learning · Computer Science 2025-08-20 Santosh Humagain , Toni Schneidereit

We propose the use of physics-informed neural networks for solving the shallow-water equations on the sphere in the meteorological context. Physics-informed neural networks are trained to satisfy the differential equations along with the…

Computational Physics · Physics 2024-09-19 Alex Bihlo , Roman O. Popovych

In recent years, physical informed neural networks (PINNs) have been shown to be a powerful tool for solving PDEs empirically. However, numerical analysis of PINNs is still missing. In this paper, we prove the convergence rate to PINNs for…

Numerical Analysis · Mathematics 2022-04-13 Yuling Jiao , Yanming Lai , Dingwei Li , Xiliang Lu , Fengru Wang , Yang Wang , Jerry Zhijian Yang

This paper follows up on a recent work of Neu et al. (2021) and presents some new information-theoretic upper bounds for the generalization error of machine learning models, such as neural networks, trained with SGD. We apply these bounds…

Machine Learning · Computer Science 2022-03-22 Ziqiao Wang , Yongyi Mao

We consider the subcritical nonlinear Schr\"odinger (NLS) in dimension one posed on the unbounded real line. Several previous works have considered the deep neural network approximation of NLS solutions from the numerical and theoretical…

Analysis of PDEs · Mathematics 2025-06-27 Miguel Á. Alejo , Lucrezia Cossetti , Luca Fanelli , Claudio Muñoz , Nicolás Valenzuela

This paper focuses on understanding how the generalization error scales with the amount of the training data for deep neural networks (DNNs). Existing techniques in statistical learning require computation of capacity measures, such as VC…

Machine Learning · Computer Science 2021-05-06 Devansh Bisla , Apoorva Nandini Saridena , Anna Choromanska
‹ Prev 1 2 3 10 Next ›