English
Related papers

Related papers: Fourier Neural Operators for Non-Markovian Process…

200 papers

Operator learning is a variant of machine learning that is designed to approximate maps between function spaces from data. The Fourier Neural Operator (FNO) is one of the main model architectures used for operator learning. The FNO combines…

Numerical Analysis · Mathematics 2025-09-29 Samuel Lanthaler , Andrew M. Stuart , Margaret Trautner

Vision transformers have delivered tremendous success in representation learning. This is primarily due to effective token mixing through self attention. However, this scales quadratically with the number of pixels, which becomes infeasible…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 John Guibas , Morteza Mardani , Zongyi Li , Andrew Tao , Anima Anandkumar , Bryan Catanzaro

Solving Singularly Perturbed Differential Equations (SPDEs) poses computational challenges arising from the rapid transitions in their solutions within thin regions. The effectiveness of deep learning in addressing differential equations…

Machine Learning · Computer Science 2024-09-10 Ye Li , Ting Du , Yiwen Pang , Zhongyi Huang

Neural operators excel as deterministic surrogates, but inevitably collapse to the conditional mean when applied to stochastic PDEs, discarding the variance and tail structure upon which uncertainty quantification depends. Recovering this…

Machine Learning · Computer Science 2026-05-18 Kai Hidajat

This paper presents a method for modeling transient fluid flow in subsurface reservoir systems based on the developed neural operator architecture (TFNO-opt). Reservoir systems are complex dynamic objects with distributed parameters…

Machine Learning · Computer Science 2025-10-21 Daniil D. Sirota , Sergey A. Khan , Sergey L. Kostikov , Kirill A. Butov

The computational efficiency of many neural operators, widely used for learning solutions of PDEs, relies on the fast Fourier transform (FFT) for performing spectral computations. As the FFT is limited to equispaced (rectangular) grids,…

In the study of subsurface seismic imaging, solving the acoustic wave equation is a pivotal component in existing models. The advancement of deep learning enables solving partial differential equations, including wave equations, by applying…

Machine Learning · Computer Science 2023-03-10 Bian Li , Hanchen Wang , Shihang Feng , Xiu Yang , Youzuo Lin

Neural operators such as the Fourier Neural Operator (FNO) have been shown to provide resolution-independent deep learning models that can learn mappings between function spaces. For example, an initial condition can be mapped to the…

Machine Learning · Computer Science 2024-07-02 Aditya Kashi , Arka Daw , Muralikrishnan Gopalakrishnan Meena , Hao Lu

Neural operators extend data-driven models to map between infinite-dimensional functional spaces. While these operators perform effectively in either the time or frequency domain, their performance may be limited when applied to…

Machine Learning · Computer Science 2024-06-06 Karn Tiwari , N M Anoop Krishnan , A P Prathosh

We apply Fourier neural operators (FNOs), a state-of-the-art operator learning technique, to forecast the temporal evolution of experimentally measured velocity fields. FNOs are a recently developed machine learning method capable of…

Fluid Dynamics · Physics 2023-01-23 Peter I Renn , Cong Wang , Sahin Lale , Zongyi Li , Anima Anandkumar , Morteza Gharib

Microstructural evolution, particularly grain growth, plays a critical role in shaping the physical, optical, and electronic properties of materials. Traditional phase-field modeling accurately simulates these phenomena but is…

Materials Science · Physics 2026-04-15 Iman Peivaste , Ahmed Makradi , Salim Belouettar

The Monte Carlo-type Neural Operator (MCNO) introduces a framework for learning solution operators of one-dimensional partial differential equations (PDEs) by directly learning the kernel function and approximating the associated integral…

Machine Learning · Computer Science 2025-12-04 Salah Eddine Choutri , Prajwal Chauhan , Othmane Mazhar , Saif Eddin Jabari

We introduce the Laplace neural operator (LNO), which leverages the Laplace transform to decompose the input space. Unlike the Fourier Neural Operator (FNO), LNO can handle non-periodic signals, account for transient responses, and exhibit…

Machine Learning · Computer Science 2023-05-31 Qianying Cao , Somdatta Goswami , George Em Karniadakis

Learning accurate and stable time-advancement operators for nonlinear partial differential equations (PDEs) remains challenging, particularly for chaotic, stiff, and long-horizon dynamical systems. While neural operator methods such as the…

Machine Learning · Computer Science 2025-12-23 Rixin Yu

Neural operators (NO) are discretization invariant deep learning methods with functional output and can approximate any continuous operator. NO have demonstrated the superiority of solving partial differential equations (PDEs) over other…

Numerical Analysis · Mathematics 2024-02-02 Jianguo Huang , Yue Qiu

Partial Differential Equation (PDE) problems often exhibit strong local spatial structures, and effectively capturing these structures is critical for approximating their solutions. Recently, the Fourier Neural Operator (FNO) has emerged as…

Machine Learning · Computer Science 2025-06-05 Chaoyu Liu , Davide Murari , Lihao Liu , Yangming Li , Chris Budd , Carola-Bibiane Schönlieb

Parametric differential equations of the form du/dt = f(u, x, t, p) are fundamental in science and engineering. While deep learning frameworks such as the Fourier Neural Operator (FNO) can efficiently approximate solutions, they struggle…

Machine Learning · Computer Science 2025-06-03 Abdolmehdi Behroozi , Chaopeng Shen and , Daniel Kifer

The physics-informed neural operator (PINO) is a machine learning paradigm that has demonstrated promising results for learning solutions to partial differential equations (PDEs). It leverages the Fourier Neural Operator to learn solution…

We present a Fourier neural network (FNN) that can be mapped directly to the Fourier decomposition. The choice of activation and loss function yields results that replicate a Fourier series expansion closely while preserving a…

Machine Learning · Computer Science 2021-04-30 Marieme Ngom , Oana Marin

The Monte Carlo-type Neural Operator (MCNO) introduces a lightweight architecture for learning solution operators for parametric PDEs by directly approximating the kernel integral using a Monte Carlo approach. Unlike Fourier Neural…

Machine Learning · Computer Science 2025-11-25 Salah Eddine Choutri , Prajwal Chauhan , Othmane Mazhar , Saif Eddin Jabari