English
Related papers

Related papers: FreqMoE: Dynamic Frequency Enhancement for Neural …

200 papers

Recent works have shown that traditional Neural Network (NN) architectures display a marked frequency bias in the learning process. Namely, the NN first learns the low-frequency features before learning the high-frequency ones. In this…

Machine Learning · Computer Science 2024-05-27 Juan Molina , Mircea Petrache , Francisco Sahli Costabal , Matías Courdurier

The recent development of Neural Operator (NeurOp) learning for solutions to the elastic wave equation shows promising results and provides the basis for fast large-scale simulations for different seismological applications. In this paper,…

The physics-informed neural operator (PINO) is a machine learning paradigm that has demonstrated promising results for learning solutions to partial differential equations (PDEs). It leverages the Fourier Neural Operator to learn solution…

Designing universal artificial intelligence (AI) solver for partial differential equations (PDEs) is an open-ended problem and a significant challenge in science and engineering. Currently, data-driven solvers have achieved great success,…

Machine Learning · Computer Science 2025-02-24 Qinglong Ma , Peizhi Zhao , Sen Wang , Tao Song

Time-periodic quantum systems exhibit a rich variety of far-from-equilibrium phenomena and serve as ideal platforms for quantum engineering and control. However, simulating their dynamics with conventional numerical methods remains…

Quantum Physics · Physics 2025-09-10 Zihao Qi , Yang Peng , Christopher Earls

There has recently been increasing attention towards developing foundational neural Partial Differential Equation (PDE) solvers and neural operators through large-scale pretraining. However, unlike vision and language models that make use…

Machine Learning · Computer Science 2024-11-21 AmirPouya Hemmasian , Amir Barati Farimani

Fourier Neural Operators (FNOs) offer a principled approach for solving complex partial differential equations (PDEs). However, scaling them to handle more complex PDEs requires increasing the number of Fourier modes, which significantly…

Machine Learning · Computer Science 2025-06-25 Shanda Li , Shinjae Yoo , Yiming Yang

Physics-informed neural operators have emerged as a powerful paradigm for solving parametric partial differential equations (PDEs), particularly in the aerospace field, enabling the learning of solution operators that generalize across…

Machine Learning · Computer Science 2025-06-24 Jing Wang , Biao Chen , Hairun Xie , Rui Wang , Yifan Xia , Jifa Zhang , Hui Xu

Predicting the microstructural and morphological evolution of materials through phase-field modelling is computationally intensive, particularly for high-throughput parametric studies. While neural operators such as the Fourier neural…

Machine Learning · Computer Science 2026-03-11 Nanxi Chen , Airong Chen , Rujin Ma

Recent large language models (LLMs) have tended to leverage sparsity to reduce computations, employing the sparsely activated mixture-of-experts (MoE) technique. MoE introduces four modules, including token routing, token communication,…

Machine Learning · Computer Science 2025-01-22 Xinglin Pan , Wenxiang Lin , Lin Zhang , Shaohuai Shi , Zhenheng Tang , Rui Wang , Bo Li , Xiaowen Chu

Spectral analysis provides one of the most effective paradigms for information-preserving dimensionality reduction, as simple descriptions of naturally occurring signals are often obtained via few terms of periodic basis functions. In this…

Machine Learning · Computer Science 2022-11-29 Michael Poli , Stefano Massaroli , Federico Berto , Jinykoo Park , Tri Dao , Christopher Ré , Stefano Ermon

Learning the mapping between two function spaces has garnered considerable research attention. However, learning the solution operator of partial differential equations (PDEs) remains a challenge in scientific computing. Fourier neural…

Machine Learning · Computer Science 2024-03-05 Jin Young Shin , Jae Yong Lee , Hyung Ju Hwang

We introduce DiffFNO, a novel diffusion framework for arbitrary-scale super-resolution strengthened by a Weighted Fourier Neural Operator (WFNO). Mode Rebalancing in WFNO effectively captures critical frequency components, significantly…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Xiaoyi Liu , Hao Tang

Neural operators extend data-driven models to map between infinite-dimensional functional spaces. While these operators perform effectively in either the time or frequency domain, their performance may be limited when applied to…

Machine Learning · Computer Science 2024-06-06 Karn Tiwari , N M Anoop Krishnan , A P Prathosh

Many real-world problems, like modelling environment dynamics, physical processes, time series etc., involve solving Partial Differential Equations (PDEs) parameterised by problem-specific conditions. Recently, a deep learning architecture…

Quantum Physics · Physics 2023-06-28 Nishant Jain , Jonas Landman , Natansh Mathur , Iordanis Kerenidis

Fourier Neural Operators (FNOs) have been promoted as fast, mesh-invariant surrogates for partial-differential equation solvers, with seismic studies reporting orders-of-magnitude speedup over classical methods. We revisit those claims by…

Geophysics · Physics 2025-08-18 Dimitri Voytan , Litan Li

Neural operators are a new type of models that can map between function spaces, allowing trained models to emulate the solution operators of partial differential equations (PDEs). This paper proposes a multigrid Fourier neural operator…

Numerical Analysis · Mathematics 2025-05-22 Zi-Hao Guo , Hou-Biao Li

Memory complexity and data scarcity have so far prohibited learning solution operators of partial differential equations (PDEs) at high resolutions. We address these limitations by introducing a new data efficient and highly parallelizable…

Machine Learning · Computer Science 2023-10-03 Jean Kossaifi , Nikola Kovachki , Kamyar Azizzadenesheli , Anima Anandkumar

We propose an extended Fourier neural operator (FNO) architecture for learning state and linear quadratic additive optimal control of systems governed by partial differential equations. Using the Ehrenpreis-Palamodov fundamental principle,…

Machine Learning · Computer Science 2026-04-08 Zhexian Li , Ketan Savla

Neural operators have been validated as promising deep surrogate models for solving partial differential equations (PDEs). Despite the critical role of boundary conditions in PDEs, however, only a limited number of neural operators robustly…

Numerical Analysis · Mathematics 2023-12-13 Ziyuan Liu , Yuhang Wu , Daniel Zhengyu Huang , Hong Zhang , Xu Qian , Songhe Song