English
Related papers

Related papers: Frequency Bias and OOD Generalization in Neural Op…

200 papers

The computational efficiency of many neural operators, widely used for learning solutions of PDEs, relies on the fast Fourier transform (FFT) for performing spectral computations. As the FFT is limited to equispaced (rectangular) grids,…

Frequency shortcuts refer to specific frequency patterns that models heavily rely on for correct classification. Previous studies have shown that models trained on small image datasets often exploit such shortcuts, potentially impairing…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Shunxin Wang , Raymond Veldhuis , Nicola Strisciuglio

The challenge of applying learned knowledge from one domain to solve problems in another related but distinct domain, known as transfer learning, is fundamental in operator learning models that solve Partial Differential Equations (PDEs).…

Machine Learning · Computer Science 2024-08-21 Haoyang Jiang , Yongzhi Qu

Neural operators aim to approximate the solution operator of a system of differential equations purely from data. They have shown immense success in modeling complex dynamical systems across various domains. However, the occurrence of…

Machine Learning · Computer Science 2025-04-01 Christopher Bülte , Philipp Scholl , Gitta Kutyniok

Neural ordinary differential equations (neural ODEs) can effectively learn dynamical systems from time series data, but their behavior on graph-structured data remains poorly understood, especially when applied to graphs with different size…

Physics and Society · Physics 2026-02-10 Moritz Laber , Tina Eliassi-Rad , Brennan Klein

Neural Operators (NOs) are a powerful deep learning framework designed to learn the solution operator that arise from partial differential equations. This study investigates NOs ability to capture the stiff spatio-temporal dynamics of the…

Machine Learning · Computer Science 2026-03-19 Luca Pellegrini

Simulation of urban wind environments is crucial for urban planning, pollution control, and renewable energy utilization. However, the computational requirements of high-fidelity computational fluid dynamics (CFD) methods make them…

Machine Learning · Computer Science 2025-01-13 Cheng Chen , Geng Tian , Shaoxiang Qin , Senwen Yang , Dingyang Geng , Dongxue Zhan , Jinqiu Yang , David Vidal , Liangzhu Leon Wang

In this paper, we introduce Proper Orthogonal Decomposition Neural Operators (PODNO) for solving partial differential equations (PDEs) dominated by high-frequency components. Building on the structure of Fourier Neural Operators (FNO),…

Numerical Analysis · Mathematics 2025-04-28 Zilan Cheng , Zhongjian Wang , Li-Lian Wang , Mejdi Azaiez

In computational physics, a longstanding challenge lies in finding numerical solutions to partial differential equations (PDEs). Recently, research attention has increasingly focused on Neural Operator methods, which are notable for their…

Machine Learning · Computer Science 2025-09-26 Yichen Song , Yalun Wu , Yunbo Wang , Xiaokang Yang

The neural operator has emerged as a powerful tool in learning mappings between function spaces in PDEs. However, when faced with real-world physical data, which are often highly non-uniformly distributed, it is challenging to use…

Machine Learning · Computer Science 2023-06-01 Songming Liu , Zhongkai Hao , Chengyang Ying , Hang Su , Ze Cheng , Jun Zhu

Neural operators have emerged as a powerful tool for solving partial differential equations (PDEs) and other complex scientific computing tasks. However, the performance of single operator block is often limited, thus often requiring…

Numerical Analysis · Mathematics 2025-07-18 Yichen Wang , Wenlian Lu

Accurately predicting long-horizon molecular dynamics (MD) trajectories remains a significant challenge, as existing deep learning methods often struggle to retain fidelity over extended simulations. We hypothesize that one key factor…

Machine Learning · Computer Science 2025-07-01 Fang Sun , Zijie Huang , Haixin Wang , Huacong Tang , Xiao Luo , Wei Wang , Yizhou Sun

Scientific computing using deep learning has seen significant advancements in recent years. There has been growing interest in models that learn the operator from the parameters of a partial differential equation (PDE) to the corresponding…

Machine Learning · Computer Science 2024-02-14 Sung Woong Cho , Jae Yong Lee , Hyung Ju Hwang

We propose a very general framework for deriving rigorous bounds on the approximation error for physics-informed neural networks (PINNs) and operator learning architectures such as DeepONets and FNOs as well as for physics-informed operator…

Machine Learning · Computer Science 2022-10-11 Tim De Ryck , Siddhartha Mishra

Neural operators have emerged as a powerful data-driven paradigm for solving partial differential equations (PDEs), while their accuracy and scalability are still limited, particularly on irregular domains where fluid flows exhibit rich…

Machine Learning · Computer Science 2026-02-26 Qinxuan Wang , Chuang Wang , Mingyu Zhang , Jingwei Sun , Peipei Yang , Shuo Tang , Shiming Xiang

Neural operator learning models have emerged as very effective surrogates in data-driven methods for partial differential equations (PDEs) across different applications from computational science and engineering. Such operator learning…

Machine Learning · Computer Science 2024-05-30 Benjamin Shih , Ahmad Peyvan , Zhongqiang Zhang , George Em Karniadakis

We study learning weak solutions to nonlinear hyperbolic partial differential equations (H-PDE), which have been difficult to learn due to discontinuities in their solutions. We use a physics-informed variant of the Fourier Neural Operator…

Machine Learning · Computer Science 2023-02-17 Bilal Thonnam Thodi , Sai Venkata Ramana Ambadipudi , Saif Eddin Jabari

Reliable digital twins of lithium-ion batteries must achieve high physical fidelity with sub-millisecond speed. In this work, we benchmark three operator-learning surrogates for the Single Particle Model (SPM): Deep Operator Networks…

Machine Learning · Computer Science 2025-08-12 Amir Ali Panahi , Daniel Luder , Billy Wu , Gregory Offer , Dirk Uwe Sauer , Weihan Li

In this paper, we propose physics-informed neural operators (PINO) that combine training data and physics constraints to learn the solution operator of a given family of parametric Partial Differential Equations (PDE). PINO is the first…

Despite their remarkable success in approximating a wide range of operators defined by PDEs, existing neural operators (NOs) do not necessarily perform well for all physics problems. We focus here on high-frequency waves to highlight…

‹ Prev 1 3 4 5 6 7 10 Next ›