English
Related papers

Related papers: Model-Parallel Fourier Neural Operators as Learned…

200 papers

We present approximation theories and efficient training methods for derivative-informed Fourier neural operators (DIFNOs) with applications to PDE-constrained optimization. A DIFNO is an FNO trained by minimizing its prediction error…

Machine Learning · Computer Science 2026-03-17 Boyuan Yao , Dingcheng Luo , Lianghao Cao , Nikola Kovachki , Thomas O'Leary-Roseberry , Omar Ghattas

Designing universal artificial intelligence (AI) solver for partial differential equations (PDEs) is an open-ended problem and a significant challenge in science and engineering. Currently, data-driven solvers have achieved great success,…

Machine Learning · Computer Science 2025-02-24 Qinglong Ma , Peizhi Zhao , Sen Wang , Tao Song

Modeling complex systems using standard neural ordinary differential equations (NODEs) often faces some essential challenges, including high computational costs and susceptibility to local optima. To address these challenges, we propose a…

Machine Learning · Computer Science 2024-05-24 Xin Li , Jingdong Zhang , Qunxi Zhu , Chengli Zhao , Xue Zhang , Xiaojun Duan , Wei Lin

Fourier Neural Operators (FNOs) have demonstrated exceptional accuracy in mapping functional spaces by leveraging Fourier transforms to establish a connection with underlying physical principles. However, their opaque inner workings often…

Fluid Dynamics · Physics 2025-11-04 Marco Cayuela , Vincent Le Chenadec , Peter Schmid , Taraneh Sayadi

Neural operators (NOs) are designed to learn maps between infinite-dimensional function spaces. We propose a novel reframing of their use. By introducing an auxiliary base-space, any finite-dimensional function can be viewed as an operator…

Machine Learning · Computer Science 2026-05-11 Vasilis Niarchos , Angelos Sirbu , Sokratis Trifinopoulos

Neural operators are becoming the default tools to learn solutions to governing partial differential equations (PDEs) in weather and ocean forecasting applications. Despite early promising achievements, significant challenges remain,…

Machine Learning · Computer Science 2025-10-14 Vahidreza Jahanmard , Ali Ramezani-Kebrya , Robinson Hordoir

Partial Differential Equation (PDE) problems often exhibit strong local spatial structures, and effectively capturing these structures is critical for approximating their solutions. Recently, the Fourier Neural Operator (FNO) has emerged as…

Machine Learning · Computer Science 2025-06-05 Chaoyu Liu , Davide Murari , Lihao Liu , Yangming Li , Chris Budd , Carola-Bibiane Schönlieb

Neural operators have emerged as powerful data-driven surrogates for learning solution operators of parametric partial differential equations (PDEs). However, widely used Fourier Neural Operators (FNOs) rely on global Fourier…

A standard practice in developing image recognition models is to train a model on a specific image resolution and then deploy it. However, in real-world inference, models often encounter images different from the training sets in resolution…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Jinsung Jeon , Hyundong Jin , Jonghyun Choi , Sanghyun Hong , Dongeun Lee , Kookjin Lee , Noseong Park

Fourier Neural Operators (FNOs) offer a principled approach for solving complex partial differential equations (PDEs). However, scaling them to handle more complex PDEs requires increasing the number of Fourier modes, which significantly…

Machine Learning · Computer Science 2025-06-25 Shanda Li , Shinjae Yoo , Yiming Yang

Physics-informed neural operators have emerged as a powerful paradigm for solving parametric partial differential equations (PDEs), particularly in the aerospace field, enabling the learning of solution operators that generalize across…

Machine Learning · Computer Science 2025-06-24 Jing Wang , Biao Chen , Hairun Xie , Rui Wang , Yifan Xia , Jifa Zhang , Hui Xu

We introduce the Laplace neural operator (LNO), which leverages the Laplace transform to decompose the input space. Unlike the Fourier Neural Operator (FNO), LNO can handle non-periodic signals, account for transient responses, and exhibit…

Machine Learning · Computer Science 2023-05-31 Qianying Cao , Somdatta Goswami , George Em Karniadakis

This paper presents a method for modeling transient fluid flow in subsurface reservoir systems based on the developed neural operator architecture (TFNO-opt). Reservoir systems are complex dynamic objects with distributed parameters…

Machine Learning · Computer Science 2025-10-21 Daniil D. Sirota , Sergey A. Khan , Sergey L. Kostikov , Kirill A. Butov

This study investigates the application of machine learning, specifically Fourier Neural Operator (FNO) and Convolutional Neural Network (CNN), to learn time-advancement operators for parametric partial differential equations (PDEs). Our…

Machine Learning · Computer Science 2024-02-19 Rixin Yu , Erdzan Hodzic

Fourier Neural Operators (FNO) have emerged as promising solutions for efficiently solving partial differential equations (PDEs) by learning infinite-dimensional function mappings through frequency domain transformations. However, the…

Machine Learning · Computer Science 2025-05-22 Tianyu Chen , Haoyi Zhou , Ying Li , Hao Wang , Zhenzhe Zhang , Tianchen Zhu , Shanghang Zhang , Jianxin Li

Global urbanization has underscored the significance of urban microclimates for human comfort, health, and building/urban energy efficiency. They profoundly influence building design and urban planning as major environmental impacts.…

Machine Learning · Computer Science 2023-10-03 Wenhui Peng , Shaoxiang Qin , Senwen Yang , Jianchun Wang , Xue Liu , Liangzhu Leon Wang

Physics-Informed Neural Operators provide efficient, high-fidelity simulations for systems governed by partial differential equations (PDEs). However, most existing studies focus only on multi-scale, multi-physics systems within a single…

Machine Learning · Computer Science 2025-07-08 Weidong Wu , Yong Zhang , Lili Hao , Yang Chen , Xiaoyan Sun , Dunwei Gong

Classical sequential models employed in time-series prediction rely on learning the mappings from the past to the future instances by way of a hidden state. The Hidden states characterise the historical information and encode the required…

Machine Learning · Computer Science 2023-02-14 Vignesh Gopakumar , Stanislas Pamela , Lorenzo Zanisi

Simulation tools for photoacoustic wave propagation have played a key role in advancing photoacoustic imaging by providing quantitative and qualitative insights into parameters affecting image quality. Classical methods for numerically…

Image and Video Processing · Electrical Eng. & Systems 2023-03-14 Steven Guan , Ko-Tsung Hsu , Parag V. Chitnis

Neural operators can learn nonlinear mappings between function spaces and offer a new simulation paradigm for real-time prediction of complex dynamics for realistic diverse applications as well as for system identification in science and…

Computational Physics · Physics 2022-03-23 Lu Lu , Xuhui Meng , Shengze Cai , Zhiping Mao , Somdatta Goswami , Zhongqiang Zhang , George Em Karniadakis