English
Related papers

Related papers: Frequency Bias and OOD Generalization in Neural Op…

200 papers

Neural operators are becoming the default tools to learn solutions to governing partial differential equations (PDEs) in weather and ocean forecasting applications. Despite early promising achievements, significant challenges remain,…

Machine Learning · Computer Science 2025-10-14 Vahidreza Jahanmard , Ali Ramezani-Kebrya , Robinson Hordoir

Partial differential equations (PDEs) govern a wide variety of dynamical processes in science and engineering, yet obtaining their numerical solutions often requires high-resolution discretizations and repeated evaluations of complex…

Machine Learning · Computer Science 2026-01-26 Valentin Duruisseaux , Jean Kossaifi , Anima Anandkumar

Neural PDE solvers are increasingly used as learned surrogates for families of partial differential equations, where the key machine learning challenge is not only interpolation on a fixed benchmark distribution but generalization under…

Machine Learning · Computer Science 2026-05-26 Lennon Shikhman

Modeling high-frequency information is a critical challenge in scientific machine learning. For instance, fully turbulent flow simulations of the Navier-Stokes equations at Reynolds numbers 3500 and above can generate high-frequency signals…

Machine Learning · Computer Science 2026-01-13 Marimuthu Kalimuthu , David Holzmüller , Mathias Niepert

Operator learning is a variant of machine learning that is designed to approximate maps between function spaces from data. The Fourier Neural Operator (FNO) is one of the main model architectures used for operator learning. The FNO combines…

Numerical Analysis · Mathematics 2025-09-29 Samuel Lanthaler , Andrew M. Stuart , Margaret Trautner

Neural operators have emerged as a powerful, data-driven paradigm for learning solution operators of partial differential equations (PDEs). State-of-the-art architectures, such as the Fourier Neural Operator (FNO), have achieved remarkable…

Machine Learning · Computer Science 2025-08-08 Saman Pordanesh , Pejman Shahsavari , Hossein Ghadjari

Operator learning has emerged as a promising paradigm for developing efficient surrogate models to solve partial differential equations (PDEs). However, existing approaches often overlook the domain knowledge inherent in the underlying PDEs…

Machine Learning · Computer Science 2025-10-20 Ziqian Li , Kang Liu , Yongcun Song , Hangrui Yue , Enrique Zuazua

The use of neural operators in a digital twin model of an offshore floating structure can provide a paradigm shift in structural response prediction and health monitoring, providing valuable information for real-time control. In this work,…

Atmospheric and Oceanic Physics · Physics 2023-12-04 Qianying Cao , Somdatta Goswami , Tapas Tripura , Souvik Chakraborty , George Em Karniadakis

Fourier Neural Operators (FNO) have emerged as promising solutions for efficiently solving partial differential equations (PDEs) by learning infinite-dimensional function mappings through frequency domain transformations. However, the…

Machine Learning · Computer Science 2025-05-22 Tianyu Chen , Haoyi Zhou , Ying Li , Hao Wang , Zhenzhe Zhang , Tianchen Zhu , Shanghang Zhang , Jianxin Li

Data-driven machine learning approaches are being increasingly used to solve partial differential equations (PDEs). They have shown particularly striking successes when training an operator, which takes as input a PDE in some family, and…

Machine Learning · Computer Science 2023-12-04 Tanya Marwah , Ashwini Pokle , J. Zico Kolter , Zachary C. Lipton , Jianfeng Lu , Andrej Risteski

We consider solving partial differential equations (PDEs) with Fourier neural operators (FNOs), which operate in the frequency domain. Since the laws of physics do not depend on the coordinate system used to describe them, it is desirable…

Machine Learning · Computer Science 2023-07-28 Jacob Helwig , Xuan Zhang , Cong Fu , Jerry Kurtin , Stephan Wojtowytsch , Shuiwang Ji

Fourier Neural Operators (FNO) offer a principled approach to solving challenging partial differential equations (PDE) such as turbulent flows. At the core of FNO is a spectral layer that leverages a discretization-convergent representation…

Machine Learning · Computer Science 2024-03-06 Robert Joseph George , Jiawei Zhao , Jean Kossaifi , Zongyi Li , Anima Anandkumar

Recent works have shown that traditional Neural Network (NN) architectures display a marked frequency bias in the learning process. Namely, the NN first learns the low-frequency features before learning the high-frequency ones. In this…

Machine Learning · Computer Science 2024-05-27 Juan Molina , Mircea Petrache , Francisco Sahli Costabal , Matías Courdurier

Neural Operators that directly learn mappings between function spaces, such as Deep Operator Networks (DONs) and Fourier Neural Operators (FNOs), have received considerable attention. Despite the universal approximation guarantees for DONs…

Machine Learning · Computer Science 2025-02-04 Pedro Cisneros-Velarde , Bhavesh Shrimali , Arindam Banerjee

Deep learning surrogate models have shown promise in solving partial differential equations (PDEs). Among them, the Fourier neural operator (FNO) achieves good accuracy, and is significantly faster compared to numerical solvers, on a…

Machine Learning · Computer Science 2024-05-03 Zongyi Li , Daniel Zhengyu Huang , Burigede Liu , Anima Anandkumar

Neural Operators (NOs) are machine learning models designed to solve partial differential equations (PDEs) by learning to map between function spaces. Neural Operators such as the Deep Operator Network (DeepONet) and the Fourier Neural…

Machine Learning · Computer Science 2025-04-30 W. Diab , M. Al-Kobaisi

Traditionally, neural networks have been employed to learn the mapping between finite-dimensional Euclidean spaces. However, recent research has opened up new horizons, focusing on the utilization of deep neural networks to learn operators…

Machine Learning · Computer Science 2025-02-18 Somdatta Goswami , Dimitris G. Giovanis , Bowei Li , Seymour M. J. Spence , Michael D. Shields

Neural operators can learn nonlinear mappings between function spaces and offer a new simulation paradigm for real-time prediction of complex dynamics for realistic diverse applications as well as for system identification in science and…

Computational Physics · Physics 2022-03-23 Lu Lu , Xuhui Meng , Shengze Cai , Zhiping Mao , Somdatta Goswami , Zhongqiang Zhang , George Em Karniadakis

Learning the mapping between two function spaces has garnered considerable research attention. However, learning the solution operator of partial differential equations (PDEs) remains a challenge in scientific computing. Fourier neural…

Machine Learning · Computer Science 2024-03-05 Jin Young Shin , Jae Yong Lee , Hyung Ju Hwang

Solving partial differential equations (PDEs) by neural networks as well as Kolmogorov-Arnold Networks (KANs), including physics-informed neural networks (PINNs), physics-informed KANs (PIKANs), and neural operators, are known to exhibit…

‹ Prev 1 2 3 10 Next ›