English
Related papers

Related papers: Nonlocality and Nonlinearity Implies Universality …

200 papers

Fourier Neural Operators (FNO) offer a principled approach to solving challenging partial differential equations (PDE) such as turbulent flows. At the core of FNO is a spectral layer that leverages a discretization-convergent representation…

Machine Learning · Computer Science 2024-03-06 Robert Joseph George , Jiawei Zhao , Jean Kossaifi , Zongyi Li , Anima Anandkumar

We obtain a new universal approximation theorem for continuous (possibly nonlinear) operators on arbitrary Banach spaces using the Leray-Schauder mapping. Moreover, we introduce and study a method for operator learning in Banach spaces…

Numerical Analysis · Mathematics 2026-03-17 Emanuele Zappala

Neural Operators (NOs) have emerged as powerful tools for learning mappings between function spaces. Among them, the kernel integral operator has been widely used in universally approximating architectures. Following the original…

Machine Learning · Computer Science 2026-01-30 Haoze Song , Zhihao Li , Xiaobo Zhang , Zecheng Gan , Zhilu Lai , Wei Wang

Neural operators (NO) are discretization invariant deep learning methods with functional output and can approximate any continuous operator. NO have demonstrated the superiority of solving partial differential equations (PDEs) over other…

Numerical Analysis · Mathematics 2024-02-02 Jianguo Huang , Yue Qiu

Motivated by the rapidly growing field of mathematics for operator approximation with neural networks, we present a novel universal operator approximation theorem for a broad class of encoder-decoder architectures. In this study, we focus…

Functional Analysis · Mathematics 2025-04-01 Janek Gödeke , Pascal Fernsel

Microstructural evolution, particularly grain growth, plays a critical role in shaping the physical, optical, and electronic properties of materials. Traditional phase-field modeling accurately simulates these phenomena but is…

Materials Science · Physics 2026-04-15 Iman Peivaste , Ahmed Makradi , Salim Belouettar

Fourier Neural Operator (FNO) is a popular operator learning framework. It not only achieves the state-of-the-art performance in many tasks, but also is efficient in training and prediction. However, collecting training data for the FNO can…

Machine Learning · Computer Science 2024-04-01 Shibo Li , Xin Yu , Wei Xing , Mike Kirby , Akil Narayan , Shandian Zhe

Neural operators have become an effective framework for learning mappings between function spaces, yet most existing architectures realize operators within a single representational domain, such as physical, spectral, or latent space. In…

Machine Learning · Computer Science 2026-05-14 Hanli Qiao , George Em Karniadakis , Muhammad Muniruzzaman

Simulation of urban wind environments is crucial for urban planning, pollution control, and renewable energy utilization. However, the computational requirements of high-fidelity computational fluid dynamics (CFD) methods make them…

Machine Learning · Computer Science 2025-01-13 Cheng Chen , Geng Tian , Shaoxiang Qin , Senwen Yang , Dingyang Geng , Dongxue Zhan , Jinqiu Yang , David Vidal , Liangzhu Leon Wang

Neural Operators (NOs) are machine learning models designed to solve partial differential equations (PDEs) by learning to map between function spaces. Neural Operators such as the Deep Operator Network (DeepONet) and the Fourier Neural…

Machine Learning · Computer Science 2025-04-30 W. Diab , M. Al-Kobaisi

Neural operators learn to map initial conditions to the terminal solution of partial differential equations (PDEs), providing a surrogate for the full operator mapping. This enables rapid prediction across different input configurations.…

Machine Learning · Computer Science 2026-05-14 Runlong Xie , An Luo

We present approximation theories and efficient training methods for derivative-informed Fourier neural operators (DIFNOs) with applications to PDE-constrained optimization. A DIFNO is an FNO trained by minimizing its prediction error…

Machine Learning · Computer Science 2026-03-17 Boyuan Yao , Dingcheng Luo , Lianghao Cao , Nikola Kovachki , Thomas O'Leary-Roseberry , Omar Ghattas

Partial Differential Equation (PDE) problems often exhibit strong local spatial structures, and effectively capturing these structures is critical for approximating their solutions. Recently, the Fourier Neural Operator (FNO) has emerged as…

Machine Learning · Computer Science 2025-06-05 Chaoyu Liu , Davide Murari , Lihao Liu , Yangming Li , Chris Budd , Carola-Bibiane Schönlieb

Neural operators have emerged as transformative tools for learning mappings between infinite-dimensional function spaces, offering useful applications in solving complex partial differential equations (PDEs). This paper presents a rigorous…

Numerical Analysis · Mathematics 2026-01-23 Vu-Anh Le , Mehmet Dik

Fourier Neural Operators (FNOs) have been promoted as fast, mesh-invariant surrogates for partial-differential equation solvers, with seismic studies reporting orders-of-magnitude speedup over classical methods. We revisit those claims by…

Geophysics · Physics 2025-08-18 Dimitri Voytan , Litan Li

Neural operator architectures employ neural networks to approximate operators mapping between Banach spaces of functions; they may be used to accelerate model evaluations via emulation, or to discover models from data. Consequently, the…

Machine Learning · Computer Science 2025-03-11 Samuel Lanthaler , Andrew M. Stuart

Operator learning is a recent development in the simulation of Partial Differential Equations (PDEs) by means of neural networks. The idea behind this approach is to learn the behavior of an operator, such that the resulting neural network…

Numerical Analysis · Mathematics 2025-01-15 Ahmed Abdeljawad , Thomas Dittrich

Deep learning surrogate models have shown promise in solving partial differential equations (PDEs). Among them, the Fourier neural operator (FNO) achieves good accuracy, and is significantly faster compared to numerical solvers, on a…

Machine Learning · Computer Science 2024-05-03 Zongyi Li , Daniel Zhengyu Huang , Burigede Liu , Anima Anandkumar

Several non-linear operators in stochastic analysis, such as solution maps to stochastic differential equations, depend on a temporal structure which is not leveraged by contemporary neural operators designed to approximate general maps…

Dynamical Systems · Mathematics 2025-04-11 Luca Galimberti , Anastasis Kratsios , Giulia Livieri

The computational efficiency of many neural operators, widely used for learning solutions of PDEs, relies on the fast Fourier transform (FFT) for performing spectral computations. As the FFT is limited to equispaced (rectangular) grids,…