English
Related papers

Related papers: Exponential Convergence of Deep Operator Networks …

200 papers

In recent years, physical informed neural networks (PINNs) have been shown to be a powerful tool for solving PDEs empirically. However, numerical analysis of PINNs is still missing. In this paper, we prove the convergence rate to PINNs for…

Numerical Analysis · Mathematics 2022-04-13 Yuling Jiao , Yanming Lai , Dingwei Li , Xiliang Lu , Fengru Wang , Yang Wang , Jerry Zhijian Yang

Learning operators mapping between infinite-dimensional Banach spaces via neural networks has attracted a considerable amount of attention in recent years. In this paper, we propose an interfaced operator network (IONet) to solve parametric…

Numerical Analysis · Mathematics 2024-06-28 Sidi Wu , Aiqing Zhu , Yifa Tang , Benzhuo Lu

Operator learning has emerged as a promising paradigm for developing efficient surrogate models to solve partial differential equations (PDEs). However, existing approaches often overlook the domain knowledge inherent in the underlying PDEs…

Machine Learning · Computer Science 2025-10-20 Ziqian Li , Kang Liu , Yongcun Song , Hangrui Yue , Enrique Zuazua

Machine learning methods for solving nonlinear partial differential equations (PDEs) are hot topical issues, and different algorithms proposed in the literature show efficient numerical approximation in high dimension. In this paper, we…

Optimization and Control · Mathematics 2022-01-05 Maximilien Germain , Mathieu Laurière , Huyên Pham , Xavier Warin

Deep Operator Networks are an increasingly popular paradigm for solving regression in infinite dimensions and hence solve families of PDEs in one shot. In this work, we aim to establish a first-of-its-kind data-dependent lowerbound on the…

Machine Learning · Computer Science 2024-02-26 Anirbit Mukherjee , Amartya Roy

Deep operator networks (DeepONets) are receiving increased attention thanks to their demonstrated capability to approximate nonlinear operators between infinite-dimensional Banach spaces. However, despite their remarkable early promise,…

Machine Learning · Computer Science 2021-03-23 Sifan Wang , Hanwen Wang , Paris Perdikaris

In recent work it has been established that deep neural networks are capable of approximating solutions to a large class of parabolic partial differential equations without incurring the curse of dimension. However, all this work has been…

Numerical Analysis · Mathematics 2020-08-18 Philipp Grohs , Lukas Herrmann

Deep Operator Networks (DeepOnets) have revolutionized the domain of scientific machine learning for the solution of the inverse problem for dynamical systems. However, their implementation necessitates optimizing a high-dimensional space…

Machine Learning · Computer Science 2024-11-05 Gianluca Fabiani , Ioannis G. Kevrekidis , Constantinos Siettos , Athanasios N. Yannacopoulos

Neural networks with randomly generated hidden weights (RaNNs) have been extensively studied, both as a standalone learning method and as an initialization for fully trainable deep learning methods. In this work, we study RaNN expressivity…

Numerical Analysis · Mathematics 2026-05-26 Muhammed Ali Mehmood , Lukas Gonon

Physics-informed Neural Networks (PINNs) have been shown as a promising approach for solving both forward and inverse problems of partial differential equations (PDEs). Meanwhile, the neural operator approach, including methods such as Deep…

Machine Learning · Computer Science 2023-10-31 Bin Lin , Zhiping Mao , Zhicheng Wang , George Em Karniadakis

This paper addresses inverse problems (in a broad sense) for two classes of multivariate neural network (NN) operators, with particular emphasis on saturation results, and both analytical and semi-analytical inverse theorems. One of the key…

Functional Analysis · Mathematics 2025-05-13 Danilo Costarelli

This monograph presents a comprehensive treatment of second order divergence form elliptic operators with bounded measurable t-independent coefficients in spaces of fractional smoothness, in Besov and weighted Sobolev classes. We establish…

Analysis of PDEs · Mathematics 2013-09-24 Ariel Barton , Svitlana Mayboroda

Deep neural networks are highly expressive machine learning models with the ability to interpolate arbitrary datasets. Deep nets are typically optimized via first-order methods and the optimization process crucially depends on the…

Machine Learning · Statistics 2019-11-12 Talha Cihad Gulcu

Recent research has used deep learning to develop partial differential equation (PDE) models in science and engineering. The functional form of the PDE is determined by a neural network, and the neural network parameters are calibrated to…

Machine Learning · Computer Science 2023-10-17 Justin Sirignano , Jonathan MacArt , Konstantinos Spiliopoulos

Deep neural networks (DNNs) have achieved remarkable success in numerous domains, and their application to PDE-related problems has been rapidly advancing. This paper provides an estimate for the generalization error of learning Lipschitz…

Machine Learning · Computer Science 2023-10-04 Ke Chen , Chunmei Wang , Haizhao Yang

We establish convergence of the training dynamics of residual neural networks (ResNets) to their joint infinite depth L, hidden width M, and embedding dimension D limit. Specifically, we consider ResNets with two-layer perceptron blocks in…

Machine Learning · Statistics 2026-03-23 Louis-Pierre Chaintron , Lénaïc Chizat , Javier Maass

In this work, we investigate a neural network based solver for optimal control problems (without / with box constraint) for linear and semilinear second-order elliptic problems. It utilizes a coupled system derived from the first-order…

Optimization and Control · Mathematics 2024-05-09 Yongcheng Dai , Bangti Jin , Ramesh Sau , Zhi Zhou

Ordinary and partial differential equations (ODEs/PDEs) play a paramount role in analyzing and simulating complex dynamic processes across all corners of science and engineering. In recent years machine learning tools are aspiring to…

Machine Learning · Computer Science 2021-06-11 Sifan Wang , Paris Perdikaris

Recently, several deep learning (DL) methods for approximating high-dimensional partial differential equations (PDEs) have been proposed. The interest that these methods have generated in the literature is in large part due to simulations…

Numerical Analysis · Mathematics 2026-04-30 Julia Ackermann , Arnulf Jentzen , Thomas Kruse , Benno Kuckuck , Joshua Lee Padgett

The aim of this article is to analyze numerical schemes using two-layer neural networks with infinite width for the resolution of the high-dimensional Poisson-Neumann partial differential equations (PDEs) with Neumann boundary conditions.…

Numerical Analysis · Mathematics 2023-07-14 Mathias Dus , Virginie Ehrlacher