English
Related papers

Related papers: Nonlocality and Nonlinearity Implies Universality …

200 papers

The classical development of neural networks has primarily focused on learning mappings between finite dimensional Euclidean spaces or finite sets. We propose a generalization of neural networks to learn operators, termed neural operators,…

Neural operators can learn nonlinear mappings between function spaces and offer a new simulation paradigm for real-time prediction of complex dynamics for realistic diverse applications as well as for system identification in science and…

Computational Physics · Physics 2022-03-23 Lu Lu , Xuhui Meng , Shengze Cai , Zhiping Mao , Somdatta Goswami , Zhongqiang Zhang , George Em Karniadakis

While many problems in machine learning focus on learning mappings between finite-dimensional spaces, scientific applications require approximating mappings between function spaces, i.e., operators. We study the problem of learning…

Machine Learning · Computer Science 2025-10-30 Adrien Weihs , Jingmin Sun , Zecheng Zhang , Hayden Schaeffer

The study of universal approximation of arbitrary functions $f: \mathcal{X} \to \mathcal{Y}$ by neural networks has a rich and thorough history dating back to Kolmogorov (1957). In the case of learning finite dimensional maps, many authors…

Machine Learning · Computer Science 2019-10-04 William H. Guss , Ruslan Salakhutdinov

Neural operators have emerged as a powerful tool for learning mappings between infinite-dimensional function spaces. However, their approximation properties in Sobolev norms remain poorly quantified, even though these norms control both…

Machine Learning · Computer Science 2026-05-12 Nicole Hao

Despite the recent popularity of attention-based neural architectures in core AI fields like natural language processing (NLP) and computer vision (CV), their potential in modeling complex physical systems remains under-explored. Learning…

Machine Learning · Computer Science 2024-08-15 Yue Yu , Ning Liu , Fei Lu , Tian Gao , Siavash Jafarzadeh , Stewart Silling

Classical neural networks are known for their ability to approximate mappings between finite-dimensional spaces, but they fall short in capturing complex operator dynamics across infinite-dimensional function spaces. Neural operators, in…

Neural and Evolutionary Computing · Computer Science 2025-12-11 Bo Zhang

We study the approximation and statistical complexity of learning collections of operators in a shared multi-task setting, with a focus on the Multiple Neural Operators (MNO) architecture. For broad classes of Lipschitz multiple operator…

Machine Learning · Computer Science 2026-05-22 Adrien Weihs , Hayden Schaeffer

Neural operators have emerged as a powerful, data-driven paradigm for learning solution operators of partial differential equations (PDEs). State-of-the-art architectures, such as the Fourier Neural Operator (FNO), have achieved remarkable…

Machine Learning · Computer Science 2025-08-08 Saman Pordanesh , Pejman Shahsavari , Hossein Ghadjari

Operator learning refers to the application of ideas from machine learning to approximate (typically nonlinear) operators mapping between Banach spaces of functions. Such operators often arise from physical models expressed in terms of…

Machine Learning · Computer Science 2024-02-27 Nikola B. Kovachki , Samuel Lanthaler , Andrew M. Stuart

Recently, operator learning, or learning mappings between infinite-dimensional function spaces, has garnered significant attention, notably in relation to learning partial differential equations from data. Conceptually clear when outlined…

Fourier neural operators (FNOs) are a recently introduced neural network architecture for learning solution operators of partial differential equations (PDEs), which have been shown to perform significantly better than comparable deep…

Fourier Neural Operators (FNOs) have emerged as promising surrogates for partial differential equation solvers. In this work, we extensively tested FNOs on a variety of systems with non-linear and non-stationary properties, using a wide…

Computational Engineering, Finance, and Science · Computer Science 2025-11-13 Rad Haghi , Bipin Gaikwad , Abani Patra

Neural operators have emerged as powerful data-driven surrogates for learning solution operators of parametric partial differential equations (PDEs). However, widely used Fourier Neural Operators (FNOs) rely on global Fourier…

Operator learning is the approximation of operators between infinite dimensional Banach spaces using machine learning approaches. While most progress in this area has been driven by variants of deep neural networks such as the Deep Operator…

Machine Learning · Computer Science 2025-09-11 Chunyang Liao , Deanna Needell , Hayden Schaeffer

Time-periodic quantum systems exhibit a rich variety of far-from-equilibrium phenomena and serve as ideal platforms for quantum engineering and control. However, simulating their dynamics with conventional numerical methods remains…

Quantum Physics · Physics 2025-09-10 Zihao Qi , Yang Peng , Christopher Earls

Neural Operators (NOs) are a leading method for surrogate modeling of partial differential equations. Unlike traditional neural networks, which approximate individual functions, NOs learn the mappings between function spaces. While NOs have…

Astrophysics of Galaxies · Physics 2025-08-01 Keith Poletti , Stella S. R. Offner , Rachel A. Ward

Modeling high-frequency information is a critical challenge in scientific machine learning. For instance, fully turbulent flow simulations of the Navier-Stokes equations at Reynolds numbers 3500 and above can generate high-frequency signals…

Machine Learning · Computer Science 2026-01-13 Marimuthu Kalimuthu , David Holzmüller , Mathias Niepert

Neural operator (NO) architectures learn nonlinear maps between infinite-dimensional function spaces and are widely used to accelerate simulation and enable data-driven model discovery. While universality results ensure expressivity, they…

Optimization and Control · Mathematics 2026-03-02 Takashi Furuya , Anastasis Kratsios

A wide range of scientific problems, such as those described by continuous-time dynamical systems and partial differential equations (PDEs), are naturally formulated on function spaces. While function spaces are typically…