English
Related papers

Related papers: Frequency Bias and OOD Generalization in Neural Op…

200 papers

Neural operators improve conventional neural networks by expanding their capabilities of functional mappings between different function spaces to solve partial differential equations (PDEs). One of the most notable methods is the Fourier…

Machine Learning · Computer Science 2024-07-29 Xuanle Zhao , Yue Sun , Tielin Zhang , Bo Xu

Neural operators have emerged as a powerful, discretization-invariant framework for solving partial differential equations (PDEs). Although established approaches like the Deep Operator Network (DeepONet) have successfully achieved…

Machine Learning · Computer Science 2026-05-20 Abderrahim Bendahi , Adrien Fradin , Johan Peralez , Julie Digne , Madiha Nadri

Neural operators (NO) are discretization invariant deep learning methods with functional output and can approximate any continuous operator. NO have demonstrated the superiority of solving partial differential equations (PDEs) over other…

Numerical Analysis · Mathematics 2024-02-02 Jianguo Huang , Yue Qiu

Fourier Neural Operators (FNOs) have emerged as leading surrogates for solver operators for various functional problems, yet their stability, generalization and frequency behavior lack a principled explanation. We present a systematic…

Machine Learning · Computer Science 2026-02-05 Taeyoung Kim

Neural operators approximate PDE solution maps, but they need not respect the symmetries of the governing equation. In out-of-distribution (OOD) regimes, a standard neural operator must often learn coordinate alignment and physical…

Machine Learning · Computer Science 2026-05-19 Jiaxiao Xu , Changhong Mou , Yeyu Zhang , Fengxiang He

Fourier neural operators (FNOs) provide a mesh-independent way to learn solution operators for partial differential equations, yet their efficacy for magnetized turbulence is largely unexplored. Here we train an FNO surrogate for the 2-D…

High Energy Astrophysical Phenomena · Physics 2025-07-03 Roberta Duarte , Rodrigo Nemmen , Reinaldo Santos-Lima

Fourier Neural Operators (FNOs) have proven to be an efficient and effective method for resolution-independent operator learning in a broad variety of application areas across scientific machine learning. A key reason for their success is…

Deep learning has been demonstrated with tremendous success in recent years. Despite so, its performance in practice often degenerates drastically when encountering out-of-distribution (OoD) data, i.e. training and test data are sampled…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Haoyue Bai

Neural operators have emerged as powerful tools for learning solution operators of partial differential equations (PDEs). However, standard spectral methods based on Fourier transforms struggle with problems involving discontinuous…

Computational Physics · Physics 2026-05-20 Giorgio M. Cavallazzi , Miguel Pérez Cuadrado , Alfredo Pinelli

We propose the Factorized Fourier Neural Operator (F-FNO), a learning-based approach for simulating partial differential equations (PDEs). Starting from a recently proposed Fourier representation of flow fields, the F-FNO bridges the…

Machine Learning · Computer Science 2023-03-03 Alasdair Tran , Alexander Mathews , Lexing Xie , Cheng Soon Ong

Fourier Neural Operators (FNOs) excel on tasks using functional data, such as those originating from partial differential equations. Such characteristics render them an effective approach for simulating the time evolution of quantum…

Ordinary differential equations (ODEs), via their induced flow maps, provide a powerful framework to parameterize invertible transformations for the purpose of representing complex probability distributions. While such models have achieved…

Statistics Theory · Mathematics 2023-09-06 Youssef Marzouk , Zhi Ren , Sven Wang , Jakob Zech

Time-periodic quantum systems exhibit a rich variety of far-from-equilibrium phenomena and serve as ideal platforms for quantum engineering and control. However, simulating their dynamics with conventional numerical methods remains…

Quantum Physics · Physics 2025-09-10 Zihao Qi , Yang Peng , Christopher Earls

Pretraining for partial differential equation (PDE) modeling has recently shown promise in scaling neural operators across datasets to improve generalizability and performance. Despite these advances, our understanding of how pretraining…

Machine Learning · Computer Science 2024-10-03 Anthony Zhou , Cooper Lorsung , AmirPouya Hemmasian , Amir Barati Farimani

Partial differential equations (PDEs) are central to describing complex physical system simulations. Their expensive solution techniques have led to an increased interest in deep neural network based surrogates. However, the practical…

Machine Learning · Computer Science 2022-11-17 Jayesh K. Gupta , Johannes Brandstetter

Long-term fluid dynamics forecasting is a critically important problem in science and engineering. While neural operators have emerged as a promising paradigm for modeling systems governed by partial differential equations (PDEs), they…

Machine Learning · Computer Science 2026-03-31 Huanshuo Dong , Hao Wu , Hong Wang , Qin-Yi Zhang , Zhezheng Hao

Fourier Neural Operators (FNOs) have been promoted as fast, mesh-invariant surrogates for partial-differential equation solvers, with seismic studies reporting orders-of-magnitude speedup over classical methods. We revisit those claims by…

Geophysics · Physics 2025-08-18 Dimitri Voytan , Litan Li

Neural operators are a new type of models that can map between function spaces, allowing trained models to emulate the solution operators of partial differential equations (PDEs). This paper proposes a multigrid Fourier neural operator…

Numerical Analysis · Mathematics 2025-05-22 Zi-Hao Guo , Hou-Biao Li

Neural ordinary differential equations (NODEs), one of the most influential works of the differential equation-based deep learning, are to continuously generalize residual networks and opened a new field. They are currently utilized for…

Machine Learning · Computer Science 2023-12-19 Woojin Cho , Seunghyeon Cho , Hyundong Jin , Jinsung Jeon , Kookjin Lee , Sanghyun Hong , Dongeun Lee , Jonghyun Choi , Noseong Park

Neural operators have been validated as promising deep surrogate models for solving partial differential equations (PDEs). Despite the critical role of boundary conditions in PDEs, however, only a limited number of neural operators robustly…

Numerical Analysis · Mathematics 2023-12-13 Ziyuan Liu , Yuhang Wu , Daniel Zhengyu Huang , Hong Zhang , Xu Qian , Songhe Song