English
Related papers

Related papers: Neural Operator: Learning Maps Between Function Sp…

200 papers

Fourier neural operators (FNOs) have recently been proposed as an effective framework for learning operators that map between infinite-dimensional spaces. We prove that FNOs are universal, in the sense that they can approximate any…

Numerical Analysis · Mathematics 2021-12-21 Nikola Kovachki , Samuel Lanthaler , Siddhartha Mishra

Machine learning approaches for solving partial differential equations require learning mappings between function spaces. While convolutional or graph neural networks are constrained to discretized functions, neural operators present a…

Computationally efficient surrogates for parametrized physical models play a crucial role in science and engineering. Operator learning provides data-driven surrogates that map between function spaces. However, instead of full-field…

Machine Learning · Computer Science 2024-12-31 Daniel Zhengyu Huang , Nicholas H. Nelsen , Margaret Trautner

Operator learning offers a robust framework for approximating mappings between infinite-dimensional function spaces. It has also become a powerful tool for solving inverse problems in the computational sciences. This chapter surveys…

Numerical Analysis · Mathematics 2025-12-08 Nicholas H. Nelsen , Yunan Yang

Neural operators are neural network-based surrogate models for approximating solution operators of parametric partial differential equations, enabling efficient many-query computations in science and engineering. Many applications,…

Numerical Analysis · Mathematics 2026-02-03 Mingyu Han , Daniel Zhengyu Huang , Yuhan Wang , Yanshu Zhang , Jiayi Zhou

A computed approximation of the solution operator to a system of partial differential equations (PDEs) is needed in various areas of science and engineering. Neural operators have been shown to be quite effective at predicting these…

Machine Learning · Computer Science 2024-12-02 Zan Ahmad , Shiyi Chen , Minglang Yin , Avisha Kumar , Nicolas Charon , Natalia Trayanova , Mauro Maggioni

With the emergence of powerful representations of continuous data in the form of neural fields, there is a need for discretization invariant learning: an approach for learning maps between functions on continuous domains without being…

Machine Learning · Computer Science 2023-10-23 Clinton J. Wang , Polina Golland

An important application of neural networks to scientific computing has been the learning of non-linear operators. In this framework, a neural network is trained to fit a non-linear map between two infinite dimensional spaces, for example,…

Machine Learning · Computer Science 2026-02-03 Shao-Ting Chiu , Aditya Nambiar , Ali Syed , Jonathan W. Siegel , Ulisses Braga-Neto

Neural ordinary differential equations (Neural ODEs) propose the idea that a sequence of layers in a neural network is just a discretisation of an ODE, and thus can instead be directly modelled by a parameterised ODE. This idea has had…

Machine Learning · Computer Science 2024-05-07 Christina Runkel , Ander Biguri , Carola-Bibiane Schönlieb

Neural operators (NOs) are designed to learn maps between infinite-dimensional function spaces. We propose a novel reframing of their use. By introducing an auxiliary base-space, any finite-dimensional function can be viewed as an operator…

Machine Learning · Computer Science 2026-05-11 Vasilis Niarchos , Angelos Sirbu , Sokratis Trifinopoulos

Neural operator architectures approximate operators between infinite-dimensional Banach spaces of functions. They are gaining increased attention in computational science and engineering, due to their potential both to accelerate…

Numerical Analysis · Mathematics 2024-06-18 Samuel Lanthaler , Zongyi Li , Andrew M. Stuart

This focused review explores a range of neural operator architectures for approximating solutions to parametric partial differential equations (PDEs), emphasizing high-level concepts and practical implementation strategies. The study covers…

Computational Engineering, Finance, and Science · Computer Science 2025-03-10 Prashant K. Jha

Neural operators have emerged as powerful tools for learning nonlinear mappings between function spaces, enabling real-time prediction of complex dynamics in diverse scientific and engineering applications. With their growing adoption in…

Computational Engineering, Finance, and Science · Computer Science 2025-10-14 Weiheng Zhong , Qibang Liu , Diab Abueidda , Seid Koric , Hadi Meidani

A class of neural networks that gained particular interest in the last years are neural ordinary differential equations (neural ODEs). We study input-output relations of neural ODEs using dynamical systems theory and prove several results…

Dynamical Systems · Mathematics 2023-09-29 Christian Kuehn , Sara-Viola Kuntz

The study of universal approximation of arbitrary functions $f: \mathcal{X} \to \mathcal{Y}$ by neural networks has a rich and thorough history dating back to Kolmogorov (1957). In the case of learning finite dimensional maps, many authors…

Machine Learning · Computer Science 2019-10-04 William H. Guss , Ruslan Salakhutdinov

Neural operators have emerged as a powerful tool for solving partial differential equations (PDEs) and other complex scientific computing tasks. However, the performance of single operator block is often limited, thus often requiring…

Numerical Analysis · Mathematics 2025-07-18 Yichen Wang , Wenlian Lu

Operator learning aims to discover properties of an underlying dynamical system or partial differential equation (PDE) from data. Here, we present a step-by-step guide to operator learning. We explain the types of problems and PDEs amenable…

Numerical Analysis · Mathematics 2025-04-30 Nicolas Boullé , Alex Townsend

Standard neural networks can approximate general nonlinear operators, represented either explicitly by a combination of mathematical operators, e.g., in an advection-diffusion-reaction partial differential equation, or simply as a black…

Machine Learning · Computer Science 2022-07-19 Somdatta Goswami , Aniruddha Bora , Yue Yu , George Em Karniadakis

Operator learning has emerged as a promising paradigm for developing efficient surrogate models to solve partial differential equations (PDEs). However, existing approaches often overlook the domain knowledge inherent in the underlying PDEs…

Machine Learning · Computer Science 2025-10-20 Ziqian Li , Kang Liu , Yongcun Song , Hangrui Yue , Enrique Zuazua

We study the derivative-informed learning of nonlinear operators between infinite-dimensional separable Hilbert spaces by neural networks. Such operators can arise from the solution of partial differential equations (PDEs), and are used in…

Numerical Analysis · Mathematics 2025-04-14 Dingcheng Luo , Thomas O'Leary-Roseberry , Peng Chen , Omar Ghattas