English
Related papers

Related papers: On universal approximation and error bounds for Fo…

200 papers

By learning the mappings between infinite function spaces using carefully designed neural networks, the operator learning methodology has exhibited significantly more efficiency than traditional methods in solving complex problems such as…

Numerical Analysis · Mathematics 2023-03-06 Ziyuan Liu , Haifeng Wang , Hong Zhang , Kaijuna Bao , Xu Qian , Songhe Song

Traditionally, classical numerical schemes have been employed to solve partial differential equations (PDEs) using computational methods. Recently, neural network-based methods have emerged. Despite these advancements, neural network-based…

Numerical Analysis · Mathematics 2024-05-14 Taeyoung Kim , Myungjoo Kang

Recently, deep Convolutional Neural Networks (CNNs) have proven to be successful when employed in areas such as reduced order modeling of parametrized PDEs. Despite their accuracy and efficiency, the approaches available in the literature…

Numerical Analysis · Mathematics 2023-01-26 Nicola Rares Franco , Stefania Fresca , Andrea Manzoni , Paolo Zunino

The standard Universal Approximation Theorem for operator neural networks (NNs) holds for arbitrary width and bounded depth. Here, we prove that operator NNs of bounded width and arbitrary depth are universal approximators for continuous…

Machine Learning · Computer Science 2021-09-24 Annan Yu , Chloé Becquey , Diana Halikias , Matthew Esmaili Mallory , Alex Townsend

The study of universal approximation of arbitrary functions $f: \mathcal{X} \to \mathcal{Y}$ by neural networks has a rich and thorough history dating back to Kolmogorov (1957). In the case of learning finite dimensional maps, many authors…

Machine Learning · Computer Science 2019-10-04 William H. Guss , Ruslan Salakhutdinov

Fourier Neural Operators (FNOs) have demonstrated exceptional accuracy in mapping functional spaces by leveraging Fourier transforms to establish a connection with underlying physical principles. However, their opaque inner workings often…

Fluid Dynamics · Physics 2025-11-04 Marco Cayuela , Vincent Le Chenadec , Peter Schmid , Taraneh Sayadi

Many real-world problems, like modelling environment dynamics, physical processes, time series etc., involve solving Partial Differential Equations (PDEs) parameterised by problem-specific conditions. Recently, a deep learning architecture…

Quantum Physics · Physics 2023-06-28 Nishant Jain , Jonas Landman , Natansh Mathur , Iordanis Kerenidis

Recent advancements in operator-type neural networks have shown promising results in approximating the solutions of spatiotemporal Partial Differential Equations (PDEs). However, these neural networks often entail considerable training…

Machine Learning · Computer Science 2025-05-08 Shuhao Cao , Francesco Brarda , Ruipeng Li , Yuanzhe Xi

Modeling complex systems using standard neural ordinary differential equations (NODEs) often faces some essential challenges, including high computational costs and susceptibility to local optima. To address these challenges, we propose a…

Machine Learning · Computer Science 2024-05-24 Xin Li , Jingdong Zhang , Qunxi Zhu , Chengli Zhao , Xue Zhang , Xiaojun Duan , Wei Lin

The classical development of neural networks has primarily focused on learning mappings between finite-dimensional Euclidean spaces. Recently, this has been generalized to neural operators that learn mappings between function spaces. For…

Operator learning has emerged as a new paradigm for the data-driven approximation of nonlinear operators. Despite its empirical success, the theoretical underpinnings governing the conditions for efficient operator learning remain…

Machine Learning · Computer Science 2024-10-21 Nikola B. Kovachki , Samuel Lanthaler , Hrushikesh Mhaskar

Neural operators serve as universal approximators for general continuous operators. In this paper, we derive the approximation rate of solution operators for the nonlinear parabolic partial differential equations (PDEs), contributing to the…

Machine Learning · Computer Science 2024-10-04 Takashi Furuya , Koichi Taniguchi , Satoshi Okuda

Fourier neural operators (FNOs) provide a mesh-independent way to learn solution operators for partial differential equations, yet their efficacy for magnetized turbulence is largely unexplored. Here we train an FNO surrogate for the 2-D…

High Energy Astrophysical Phenomena · Physics 2025-07-03 Roberta Duarte , Rodrigo Nemmen , Reinaldo Santos-Lima

A plentitude of applications in scientific computing requires the approximation of mappings between Banach spaces. Recently introduced Fourier Neural Operator (FNO) and Deep Operator Network (DeepONet) can provide this functionality. For…

Numerical Analysis · Mathematics 2024-04-02 V. Fanaskov , I. Oseledets

Neural Operators (NOs) are machine learning models designed to solve partial differential equations (PDEs) by learning to map between function spaces. Neural Operators such as the Deep Operator Network (DeepONet) and the Fourier Neural…

Machine Learning · Computer Science 2025-04-30 W. Diab , M. Al-Kobaisi

Neural operators have emerged as a powerful, discretization-invariant framework for solving partial differential equations (PDEs). Although established approaches like the Deep Operator Network (DeepONet) have successfully achieved…

Machine Learning · Computer Science 2026-05-20 Abderrahim Bendahi , Adrien Fradin , Johan Peralez , Julie Digne , Madiha Nadri

Neural operators have emerged as powerful tools for learning solution operators of partial differential equations. However, in time-dependent problems, standard training strategies such as teacher forcing introduce a mismatch between…

Machine Learning · Computer Science 2025-05-28 Zaijun Ye , Chen-Song Zhang , Wansheng Wang

Fourier Neural Operators are deep learning models that learn mappings between function spaces and can be used to learn and solve partial differential equations (PDEs), in some cases significantly faster than traditional PDE solvers. Within…

Machine Learning · Computer Science 2026-05-05 Michael F. Staddon

Neural operators have been validated as promising deep surrogate models for solving partial differential equations (PDEs). Despite the critical role of boundary conditions in PDEs, however, only a limited number of neural operators robustly…

Numerical Analysis · Mathematics 2023-12-13 Ziyuan Liu , Yuhang Wu , Daniel Zhengyu Huang , Hong Zhang , Xu Qian , Songhe Song

This paper presents a method for modeling transient fluid flow in subsurface reservoir systems based on the developed neural operator architecture (TFNO-opt). Reservoir systems are complex dynamic objects with distributed parameters…

Machine Learning · Computer Science 2025-10-21 Daniil D. Sirota , Sergey A. Khan , Sergey L. Kostikov , Kirill A. Butov