English
Related papers

Related papers: Deep Neural Operator Learning for Probabilistic Mo…

200 papers

Boundary conditions (BCs) are important groups of physics-enforced constraints that are necessary for solutions of Partial Differential Equations (PDEs) to satisfy at specific spatial locations. These constraints carry important physical…

Machine Learning · Computer Science 2023-03-06 Nadim Saad , Gaurav Gupta , Shima Alizadeh , Danielle C. Maddix

Approximation rates are analyzed for deep surrogates of maps between infinite-dimensional function spaces, arising e.g. as data-to-solution maps of linear and nonlinear partial differential equations. Specifically, we study approximation…

Numerical Analysis · Mathematics 2024-02-09 Lukas Herrmann , Christoph Schwab , Jakob Zech

Pre-training has been investigated to improve the efficiency and performance of training neural operators in data-scarce settings. However, it is largely in its infancy due to the inherent complexity and diversity, such as long…

Machine Learning · Computer Science 2024-05-08 Zhongkai Hao , Chang Su , Songming Liu , Julius Berner , Chengyang Ying , Hang Su , Anima Anandkumar , Jian Song , Jun Zhu

Neural Operators offer a powerful, data-driven tool for solving parametric PDEs as they can represent maps between infinite-dimensional function spaces. In this work, we employ physics-informed Neural Operators in the context of…

Machine Learning · Statistics 2023-03-08 Sebastian Kaltenbach , Paris Perdikaris , Phaedon-Stelios Koutsourelakis

Universal approximation theorems establish the expressive capacity of neural network architectures. For dynamical systems, existing results are limited to finite time horizons or systems with a globally stable equilibrium, leaving…

Dynamical Systems · Mathematics 2026-02-12 Abel Sagodi , Il Memming Park

Multiple operator learning concerns learning operator families $\{G[\alpha]:U\to V\}_{\alpha\in W}$ indexed by an operator descriptor $\alpha$. Training data are collected hierarchically by sampling operator instances $\alpha$, then input…

Machine Learning · Computer Science 2026-04-03 Adrien Weihs , Hayden Schaeffer

Neural operators have emerged as a powerful tool for solving partial differential equations (PDEs) and other complex scientific computing tasks. However, the performance of single operator block is often limited, thus often requiring…

Numerical Analysis · Mathematics 2025-07-18 Yichen Wang , Wenlian Lu

Operator regression provides a powerful means of constructing discretization-invariant emulators for partial-differential equations (PDEs) describing physical systems. Neural operators specifically employ deep neural networks to approximate…

Machine Learning · Computer Science 2023-04-18 Katiana Kontolati , Somdatta Goswami , George Em Karniadakis , Michael D. Shields

Singularly perturbed problems present inherent difficulty due to the presence of a thin boundary layer in its solution. To overcome this difficulty, we propose using deep operator networks (DeepONets), a method previously shown to be…

Numerical Analysis · Mathematics 2023-06-30 Ting Du , Zhongyi Huang , Ye Li

Pretraining for partial differential equation (PDE) modeling has recently shown promise in scaling neural operators across datasets to improve generalizability and performance. Despite these advances, our understanding of how pretraining…

Machine Learning · Computer Science 2024-10-03 Anthony Zhou , Cooper Lorsung , AmirPouya Hemmasian , Amir Barati Farimani

Neural networks have been applied to control problems, typically by combining data, differential equation residuals, and objective costs in the training loss or by incorporating auxiliary architectural components. Instead, we propose a…

Optimization and Control · Mathematics 2026-04-10 Oliver G. S. Lundqvist , Fabricio Oliveira

We consider deep neural networks with a Lipschitz continuous activation function and with weight matrices of variable widths. We establish a uniform convergence analysis framework in which sufficient conditions on weight matrices and bias…

Machine Learning · Computer Science 2023-06-05 Yuesheng Xu , Haizhang Zhang

Unlike ODEs, whose models involve system matrices and whose controllers involve vector or matrix gains, PDE models involve functions in those roles functional coefficients, dependent on the spatial variables, and gain functions dependent on…

Systems and Control · Electrical Eng. & Systems 2023-03-21 Miroslav Krstic , Luke Bhan , Yuanyuan Shi

Operator learning problems arise in many key areas of scientific computing where Partial Differential Equations (PDEs) are used to model physical systems. In such scenarios, the operators map between Banach or Hilbert spaces. In this work,…

Machine Learning · Computer Science 2024-10-31 Ben Adcock , Nick Dexter , Sebastian Moraga

We present a comprehensive framework for deriving rigorous and efficient bounds on the approximation error of deep neural networks in PDE models characterized by branching mechanisms, such as waves, Schr\"odinger equations, and other…

Numerical Analysis · Mathematics 2024-05-24 Claudio Muñoz , Nicolás Valenzuela

Recently deep learning surrogates and neural operators have shown promise in solving partial differential equations (PDEs). However, they often require a large amount of training data and are limited to bounded domains. In this work, we…

Machine Learning · Computer Science 2023-08-25 Zhiwei Fang , Sifan Wang , Paris Perdikaris

Unlike classical artificial neural networks, which require retraining for each new set of parametric inputs, the Deep Operator Network (DeepONet), a lately introduced deep learning framework, approximates linear and nonlinear solution…

Computational Engineering, Finance, and Science · Computer Science 2024-03-25 Shashank Kushwaha , Jaewan Park , Seid Koric , Junyan He , Iwona Jasiuk , Diab Abueidda

Machine learning for partial differential equations (PDEs) is a hot topic. In this paper we introduce and analyse a Deep BSDE scheme for nonlinear integro-PDEs with unbounded nonlocal operators -problems arising in e.g. stochastic control…

Analysis of PDEs · Mathematics 2024-07-15 Espen Robstad Jakobsen , Sehail Mazid

The paper establishes generalization bounds for multitask deep neural networks using operator-theoretic techniques. The authors propose a tighter bound than those derived from conventional norm based methods by leveraging small condition…

Machine Learning · Computer Science 2026-05-29 Mahdi Mohammadigohari , Giuseppe Di Fatta , Giuseppe Nicosia , Panos M. Pardalos

Deep Operator Networks are an increasingly popular paradigm for solving regression in infinite dimensions and hence solve families of PDEs in one shot. In this work, we aim to establish a first-of-its-kind data-dependent lowerbound on the…

Machine Learning · Computer Science 2024-02-26 Anirbit Mukherjee , Amartya Roy