English
Related papers

Related papers: Error estimates for DeepOnets: A deep learning fra…

200 papers

To quantify uncertainties in inverse problems of partial differential equations (PDEs), we formulate them into statistical inference problems using Bayes' formula. Recently, well-justified infinite-dimensional Bayesian analysis methods have…

Numerical Analysis · Mathematics 2026-02-09 Junxiong Jia , Yanni Wu , Peijun Li , Deyu Meng

Deep neural networks have emerged as powerful tools for learning operators defined over infinite-dimensional function spaces. However, existing theories frequently encounter difficulties related to dimensionality and limited…

Machine Learning · Computer Science 2026-05-12 Jianfei Li , Shuo Huang , Han Feng , Ding-Xuan Zhou , Gitta Kutyniok

We present a comprehensive framework for deriving rigorous and efficient bounds on the approximation error of deep neural networks in PDE models characterized by branching mechanisms, such as waves, Schr\"odinger equations, and other…

Numerical Analysis · Mathematics 2024-05-24 Claudio Muñoz , Nicolás Valenzuela

Despite the practical success of deep neural networks, a comprehensive theoretical framework that can predict practically relevant scores, such as the test accuracy, from knowledge of the training data is currently lacking. Huge…

Disordered Systems and Neural Networks · Physics 2024-06-27 R. Pacelli , S. Ariosto , M. Pastore , F. Ginelli , M. Gherardi , P. Rotondo

A key challenge in scientific machine learning is solving partial differential equations (PDEs) on complex domains, where the curved geometry complicates the approximation of functions and their derivatives required by differential…

Numerical Analysis · Mathematics 2025-09-26 Hanfei Zhou , Lei Shi

The problem of extending a function $f$ defined on a training data $\mathcal{C}$ on an unknown manifold $\mathbb{X}$ to the entire manifold and a tubular neighborhood of this manifold is considered in this paper. For $\mathbb{X}$ embedded…

Machine Learning · Computer Science 2016-07-26 Charles K. Chui , H. N. Mhaskar

Deep operator networks (DeepONets, DONs) offer a distinct advantage over traditional neural networks in their ability to be trained on multi-resolution data. This property becomes especially relevant in real-world scenarios where…

Machine Learning · Computer Science 2023-10-05 Katarzyna Michałowska , Somdatta Goswami , George Em Karniadakis , Signe Riemer-Sørensen

In this paper we use neural networks to learn governing equations from data. Specifically we reconstruct the right-hand side of a system of ODEs $\dot{x}(t) = f(t, x(t))$ directly from observed uniformly time-sampled data using a neural…

Machine Learning · Computer Science 2021-08-18 Elisa Negrini , Giovanna Citti , Luca Capogna

Neural operators aim to learn mappings between infinite-dimensional function spaces, but their performance often degrades on complex or irregular geometries due to the lack of geometry-aware representations. We propose the Finite Element…

Numerical Analysis · Mathematics 2026-02-03 Shiyuan Li , Hossein Salahshoor

We establish convergence of the training dynamics of residual neural networks (ResNets) to their joint infinite depth L, hidden width M, and embedding dimension D limit. Specifically, we consider ResNets with two-layer perceptron blocks in…

Machine Learning · Statistics 2026-03-23 Louis-Pierre Chaintron , Lénaïc Chizat , Javier Maass

We use Deep Operator Networks (DeepONets) to perform super-resolution reconstruction of the solutions of two types of partial differential equations and compare the model predictions with the results obtained using conventional…

Image and Video Processing · Electrical Eng. & Systems 2024-10-29 Siyuan Yang

In this work, we consider the non-invasive medical imaging modality of Electrical Impedance Tomography (EIT), where the goal is to recover the conductivity in a medium from boundary current-to-voltage measurements, i.e., the…

Machine Learning · Computer Science 2026-04-15 Anuj Abhishek , Thilo Strauss

The advent of fast sensing technologies allows for real-time model updates in many applications where the model parameters are uncertain. Bayesian algorithms, such as ensemble smoothers, offer a real-time probabilistic inversion accounting…

Geophysics · Physics 2022-05-26 Muzammil Hussain Rammay , Sergey Alyaev , Ahmed H Elsheikh

Design and optimal control problems are among the fundamental, ubiquitous tasks we face in science and engineering. In both cases, we aim to represent and optimize an unknown (black-box) function that associates a performance/outcome to a…

Machine Learning · Computer Science 2021-10-27 Sifan Wang , Mohamed Aziz Bhouri , Paris Perdikaris

Deep Operator Network (DeepONet) is a neural network framework for learning nonlinear operators such as those from ordinary differential equations (ODEs) describing complex systems. Multiple-input deep neural operators (MIONet) extended…

Machine Learning · Computer Science 2023-11-30 Zhihao Kong , Amirhossein Mollaali , Christian Moya , Na Lu , Guang Lin

We develop a new theoretical framework to analyze the generalization error of deep learning, and derive a new fast learning rate for two representative algorithms: empirical risk minimization and Bayesian deep learning. The series of…

Statistics Theory · Mathematics 2017-05-31 Taiji Suzuki

A novel approach to approximate solutions of Stochastic Differential Equations (SDEs) by Deep Neural Networks is derived and analysed. The architecture is inspired by the notion of Deep Operator Networks (DeepONets), which is based on…

Numerical Analysis · Mathematics 2025-12-23 Martin Eigel , Charles Miranda

We prove that deep neural networks are capable of approximating solutions of semilinear Kolmogorov PDE in the case of gradient-independent, Lipschitz-continuous nonlinearities, while the required number of parameters in the networks grow at…

Numerical Analysis · Mathematics 2022-05-31 Petru A. Cioica-Licht , Martin Hutzenthaler , P. Tobias Werner

We perform an average case analysis of the generalization dynamics of large neural networks trained using gradient descent. We study the practically-relevant "high-dimensional" regime where the number of free parameters in the network is on…

Machine Learning · Statistics 2017-10-11 Madhu S. Advani , Andrew M. Saxe

Neural operators have achieved strong performance in learning solution operators of partial differential equations (PDEs), but their inherently continuous representations struggle to capture discontinuities and sharp transitions. Existing…

Machine Learning · Computer Science 2026-05-20 Ha Dang , Sebastian Schmidt , Juergen Hesser