English
Related papers

Related papers: Pretraining a Neural Operator in Lower Dimensions

200 papers

Solving Singularly Perturbed Differential Equations (SPDEs) poses computational challenges arising from the rapid transitions in their solutions within thin regions. The effectiveness of deep learning in addressing differential equations…

Machine Learning · Computer Science 2024-09-10 Ye Li , Ting Du , Yiwen Pang , Zhongyi Huang

Partial Differential Equation (PDE) problems often exhibit strong local spatial structures, and effectively capturing these structures is critical for approximating their solutions. Recently, the Fourier Neural Operator (FNO) has emerged as…

Machine Learning · Computer Science 2025-06-05 Chaoyu Liu , Davide Murari , Lihao Liu , Yangming Li , Chris Budd , Carola-Bibiane Schönlieb

Fourier Neural Operators (FNO) have emerged as promising solutions for efficiently solving partial differential equations (PDEs) by learning infinite-dimensional function mappings through frequency domain transformations. However, the…

Machine Learning · Computer Science 2025-05-22 Tianyu Chen , Haoyi Zhou , Ying Li , Hao Wang , Zhenzhe Zhang , Tianchen Zhu , Shanghang Zhang , Jianxin Li

Neural operators effectively solve PDE problems from data without knowing the explicit equations, which learn the map from the input sequences of observed samples to the predicted values. Most existing works build the model in the original…

Machine Learning · Computer Science 2024-12-23 Tian Wang , Chuang Wang

Neural operators have emerged as promising surrogate models for solving partial differential equations (PDEs), but struggle to generalise beyond training distributions and are often constrained to a fixed temporal discretisation. This work…

We propose the Factorized Fourier Neural Operator (F-FNO), a learning-based approach for simulating partial differential equations (PDEs). Starting from a recently proposed Fourier representation of flow fields, the F-FNO bridges the…

Machine Learning · Computer Science 2023-03-03 Alasdair Tran , Alexander Mathews , Lexing Xie , Cheng Soon Ong

Deep learning surrogate models have shown promise in solving partial differential equations (PDEs). Among them, the Fourier neural operator (FNO) achieves good accuracy, and is significantly faster compared to numerical solvers, on a…

Machine Learning · Computer Science 2024-05-03 Zongyi Li , Daniel Zhengyu Huang , Burigede Liu , Anima Anandkumar

Partial differential equations (PDEs) govern diverse physical phenomena, yet high-fidelity numerical solutions are computationally expensive and Machine Learning approaches lack generalization. While Scientific Foundation Models (SFMs) aim…

Machine Learning · Computer Science 2026-05-13 Hamda Hmida , Hsiu-Wen Chang , Youssef Mesri

Neural operators (NOs) provide a new paradigm for efficiently solving partial differential equations (PDEs), but their training depends on costly high-fidelity data from numerical solvers, limiting applications in complex systems. We…

Computational Physics · Physics 2026-05-18 Wen You , Shaoqian Zhou , Xuhui Meng

Neural networks have shown promising potential in accelerating the numerical simulation of systems governed by partial differential equations (PDEs). Different from many existing neural network surrogates operating on high-dimensional…

Machine Learning · Computer Science 2025-01-09 Zijie Li , Saurabh Patil , Francis Ogoke , Dule Shu , Wilson Zhen , Michael Schneier , John R. Buchanan, , Amir Barati Farimani

Recent developments in mechanical, aerospace, and structural engineering have driven a growing need for efficient ways to model and analyse structures at much larger and more complex scales than before. While established numerical methods…

Machine Learning · Computer Science 2025-07-29 Rui Wu , Nikola Kovachki , Burigede Liu

We present approximation theories and efficient training methods for derivative-informed Fourier neural operators (DIFNOs) with applications to PDE-constrained optimization. A DIFNO is an FNO trained by minimizing its prediction error…

Machine Learning · Computer Science 2026-03-17 Boyuan Yao , Dingcheng Luo , Lianghao Cao , Nikola Kovachki , Thomas O'Leary-Roseberry , Omar Ghattas

Fourier Neural Operators are deep learning models that learn mappings between function spaces and can be used to learn and solve partial differential equations (PDEs), in some cases significantly faster than traditional PDE solvers. Within…

Machine Learning · Computer Science 2026-05-05 Michael F. Staddon

Recent advancements in operator-type neural networks have shown promising results in approximating the solutions of spatiotemporal Partial Differential Equations (PDEs). However, these neural networks often entail considerable training…

Machine Learning · Computer Science 2025-05-08 Shuhao Cao , Francesco Brarda , Ruipeng Li , Yuanzhe Xi

Predicting the microstructural and morphological evolution of materials through phase-field modelling is computationally intensive, particularly for high-throughput parametric studies. While neural operators such as the Fourier neural…

Machine Learning · Computer Science 2026-03-11 Nanxi Chen , Airong Chen , Rujin Ma

Partial differential equations (PDEs) govern a wide range of physical phenomena, but their numerical solution remains computationally demanding, especially when repeated simulations are required across many parameter settings. Recent…

Machine Learning · Computer Science 2026-05-13 Hamda Hmida , Hsiu-Wen Chang Joly , Youssef Mesri

We introduce the Neural Preconditioning Operator (NPO), a novel approach designed to accelerate Krylov solvers in solving large, sparse linear systems derived from partial differential equations (PDEs). Unlike classical preconditioners that…

Computational Engineering, Finance, and Science · Computer Science 2025-02-10 Zhihao Li , Di Xiao , Zhilu Lai , Wei Wang

Neural operators improve conventional neural networks by expanding their capabilities of functional mappings between different function spaces to solve partial differential equations (PDEs). One of the most notable methods is the Fourier…

Machine Learning · Computer Science 2024-07-29 Xuanle Zhao , Yue Sun , Tielin Zhang , Bo Xu

Designing universal artificial intelligence (AI) solver for partial differential equations (PDEs) is an open-ended problem and a significant challenge in science and engineering. Currently, data-driven solvers have achieved great success,…

Machine Learning · Computer Science 2025-02-24 Qinglong Ma , Peizhi Zhao , Sen Wang , Tao Song

Neural operators such as the Fourier Neural Operator (FNO) have been shown to provide resolution-independent deep learning models that can learn mappings between function spaces. For example, an initial condition can be mapped to the…

Machine Learning · Computer Science 2024-07-02 Aditya Kashi , Arka Daw , Muralikrishnan Gopalakrishnan Meena , Hao Lu