English
Related papers

Related papers: Mitigating spectral bias for the multiscale operat…

200 papers

The neural operator has emerged as a powerful tool in learning mappings between function spaces in PDEs. However, when faced with real-world physical data, which are often highly non-uniformly distributed, it is challenging to use…

Machine Learning · Computer Science 2023-06-01 Songming Liu , Zhongkai Hao , Chengyang Ying , Hang Su , Ze Cheng , Jun Zhu

This paper introduces a data-driven operator learning method for multiscale partial differential equations, with a particular emphasis on preserving high-frequency information. Drawing inspiration from the representation of multiscale…

Machine Learning · Computer Science 2024-08-05 Bo Xu , Xinliang Liu , Lei Zhang

Attention mechanisms have emerged as transformative tools in core AI domains such as natural language processing and computer vision. Yet, their largely untapped potential for modeling intricate physical systems presents a compelling…

Machine Learning · Computer Science 2025-05-30 Ning Liu , Yue Yu

Existing neural operator architectures face challenges when solving multiphysics problems with coupled partial differential equations (PDEs) due to complex geometries, interactions between physical variables, and the limited amounts of…

Partial differential equations (PDEs) govern diverse physical phenomena, yet high-fidelity numerical solutions are computationally expensive and Machine Learning approaches lack generalization. While Scientific Foundation Models (SFMs) aim…

Machine Learning · Computer Science 2026-05-13 Hamda Hmida , Hsiu-Wen Chang , Youssef Mesri

In this work, we present an arbitrary-scale super-resolution (SR) method to enhance the resolution of scientific data, which often involves complex challenges such as continuity, multi-scale physics, and the intricacies of high-frequency…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Xihaier Luo , Xiaoning Qian , Byung-Jun Yoon

Neural operators (NOs) struggle with high-contrast multiscale partial differential equations (PDEs), where fine-scale heterogeneities cause large errors. To address this, we use the Generalized Multiscale Finite Element Method (GMsFEM) that…

Real-world scientific applications frequently encounter incomplete observational data due to sensor limitations, geographic constraints, or measurement costs. Although neural operators significantly advanced PDE solving in terms of…

Machine Learning · Computer Science 2026-01-28 Jingren Hou , Hong Wang , Pengyu Xu , Chang Gao , Huafeng Liu , Liping Jing

Neural operators effectively solve PDE problems from data without knowing the explicit equations, which learn the map from the input sequences of observed samples to the predicted values. Most existing works build the model in the original…

Machine Learning · Computer Science 2024-12-23 Tian Wang , Chuang Wang

In solving partial differential equations (PDEs), Fourier Neural Operators (FNOs) have exhibited notable effectiveness. However, FNO is observed to be ineffective with large Fourier kernels that parameterize more frequencies. Current…

Machine Learning · Computer Science 2024-10-10 Shaoxiang Qin , Fuyuan Lyu , Wenhui Peng , Dingyang Geng , Ju Wang , Xing Tang , Sylvie Leroyer , Naiping Gao , Xue Liu , Liangzhu Leon Wang

Memory complexity and data scarcity have so far prohibited learning solution operators of partial differential equations (PDEs) at high resolutions. We address these limitations by introducing a new data efficient and highly parallelizable…

Machine Learning · Computer Science 2023-10-03 Jean Kossaifi , Nikola Kovachki , Kamyar Azizzadenesheli , Anima Anandkumar

Neural operators have emerged as a powerful data-driven paradigm for solving partial differential equations (PDEs), while their accuracy and scalability are still limited, particularly on irregular domains where fluid flows exhibit rich…

Machine Learning · Computer Science 2026-02-26 Qinxuan Wang , Chuang Wang , Mingyu Zhang , Jingwei Sun , Peipei Yang , Shuo Tang , Shiming Xiang

Spectral methods are an important part of scientific computing's arsenal for solving partial differential equations (PDEs). However, their applicability and effectiveness depend crucially on the choice of basis functions used to expand the…

Numerical Analysis · Mathematics 2021-11-10 Brek Meuris , Saad Qadeer , Panos Stinis

Solving high-frequency oscillatory partial differential equations (PDEs) is a critical challenge in scientific computing, with applications in fluid mechanics, quantum mechanics, and electromagnetic wave propagation. Traditional…

Machine Learning · Computer Science 2025-08-04 Xiong Xiong , Zhuo Zhang , Rongchun Hu , Chen Gao , Zichen Deng

In scientific and engineering applications, solving partial differential equations (PDEs) across various parameters and domains normally relies on resource-intensive numerical methods. Neural operators based on deep learning offered a…

Numerical Analysis · Mathematics 2024-06-21 Zhiwei Zhao , Changqing Liu , Yingguang Li , Zhibin Chen , Xu Liu

Recent advancements in operator-type neural networks have shown promising results in approximating the solutions of spatiotemporal Partial Differential Equations (PDEs). However, these neural networks often entail considerable training…

Machine Learning · Computer Science 2025-05-08 Shuhao Cao , Francesco Brarda , Ruipeng Li , Yuanzhe Xi

Neural operators have emerged as an efficient paradigm for solving PDEs, overcoming the limitations of traditional numerical methods and significantly improving computational efficiency. However, due to the diversity and complexity of PDE…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Dengdi Sun , Xiaoya Zhou , Xiao Wang , Hao Si , Wanli Lyu , Jin Tang , Bin Luo

Deep neural operators are recognized as an effective tool for learning solution operators of complex partial differential equations (PDEs). As compared to laborious analytical and computational tools, a single neural operator can predict…

Machine Learning · Statistics 2023-02-14 Navaneeth N , Tapas Tripura , Souvik Chakraborty

The Monte Carlo-type Neural Operator (MCNO) introduces a lightweight architecture for learning solution operators for parametric PDEs by directly approximating the kernel integral using a Monte Carlo approach. Unlike Fourier Neural…

Machine Learning · Computer Science 2025-11-25 Salah Eddine Choutri , Prajwal Chauhan , Othmane Mazhar , Saif Eddin Jabari

Accurate modeling of spatiotemporal dynamics is crucial to understanding complex phenomena across science and engineering. However, this task faces a fundamental challenge when the governing equations are unknown and observational data are…

Computational Physics · Physics 2025-12-15 Rui Zhang , Han Wan , Yang Liu , Hao Sun