中文
相关论文

相关论文: FreqMoE: Dynamic Frequency Enhancement for Neural …

200 篇论文

Neural ODEs (NODEs) have emerged as powerful tools for modeling time series data, offering the flexibility to adapt to varying input scales and capture complex dynamics. However, they face significant challenges: first, their reliance on…

机器学习 · 计算机科学 2025-10-07 Muhao Guo , Yang Weng

As large language models continue to scale, computational costs and resource consumption have emerged as significant challenges. While existing sparsification methods like pruning reduce computational overhead, they risk losing model…

计算与语言 · 计算机科学 2025-09-16 Minxuan Lv , Zhenpeng Su , Leiyu Pan , Yizhe Xiong , Zijia Lin , Hui Chen , Wei Zhou , Jungong Han , Guiguang Ding , Cheng Luo , Di Zhang , Kun Gai , Songlin Hu

We apply Fourier neural operators (FNOs), a state-of-the-art operator learning technique, to forecast the temporal evolution of experimentally measured velocity fields. FNOs are a recently developed machine learning method capable of…

流体动力学 · 物理学 2023-01-23 Peter I Renn , Cong Wang , Sahin Lale , Zongyi Li , Anima Anandkumar , Morteza Gharib

In this paper, we propose physics-informed neural operators (PINO) that combine training data and physics constraints to learn the solution operator of a given family of parametric Partial Differential Equations (PDE). PINO is the first…

Solving non-linear partial differential equations which exhibit chaotic dynamics is an important problem with a wide-range of applications such as predicting weather extremes and financial market risk. Fourier neural operators (FNOs) have…

机器学习 · 计算机科学 2024-10-17 Surbhi Khetrapal , Jaswin Kasi

Fourier Neural Operator (FNO) is a popular operator learning framework. It not only achieves the state-of-the-art performance in many tasks, but also is efficient in training and prediction. However, collecting training data for the FNO can…

机器学习 · 计算机科学 2024-04-01 Shibo Li , Xin Yu , Wei Xing , Mike Kirby , Akil Narayan , Shandian Zhe

We study learning weak solutions to nonlinear hyperbolic partial differential equations (H-PDE), which have been difficult to learn due to discontinuities in their solutions. We use a physics-informed variant of the Fourier Neural Operator…

机器学习 · 计算机科学 2023-02-17 Bilal Thonnam Thodi , Sai Venkata Ramana Ambadipudi , Saif Eddin Jabari

Flexible intelligent metasurfaces (FIMs) offer a new solution for wireless communications by introducing morphological degrees of freedom, dynamically morphing their three-dimensional shape to ensure multipath signals interfere…

信息论 · 计算机科学 2026-04-08 Jian Xiao , Ji Wang , Qimei Cui , Yucang Yang , Xingwang Li , Dusit Niyato , Chau Yuen

Tensor neural networks (TNNs) have demonstrated their superiority in solving high-dimensional problems. However, similar to conventional neural networks, TNNs are also influenced by the Frequency Principle, which limits their ability to…

机器学习 · 计算机科学 2026-05-15 Jizu Huang , Yue Qiu , Rukang You

Developing fast surrogates for Partial Differential Equations (PDEs) will accelerate design and optimization in almost all scientific and engineering applications. Neural networks have been receiving ever-increasing attention and…

机器学习 · 计算机科学 2024-11-21 AmirPouya Hemmasian , Amir Barati Farimani

Neural Operators (NOs) are a leading method for surrogate modeling of partial differential equations. Unlike traditional neural networks, which approximate individual functions, NOs learn the mappings between function spaces. While NOs have…

星系天体物理 · 物理学 2025-08-01 Keith Poletti , Stella S. R. Offner , Rachel A. Ward

Solving cell problems in homogenization is hard, and available deep-learning frameworks fail to match the speed and generality of traditional computational frameworks. More to the point, it is generally unclear what to expect of…

计算工程、金融与科学 · 计算机科学 2025-11-07 Binh Huy Nguyen , Matti Schneider

Neural operators have emerged as powerful surrogates for dynamical systems due to their grid-invariant properties and computational efficiency. However, the Fourier-based neural operator framework inherently truncates high-frequency…

机器学习 · 计算机科学 2026-04-09 Tianyue Yang , Xiao Xue

The UNet-enhanced Fourier Neural Operator (UFNO) extends the Fourier Neural Operator (FNO) by incorporating a parallel UNet pathway, enabling the retention of both high- and low-frequency components. While UFNO improves predictive accuracy…

机器学习 · 计算机科学 2026-01-05 Alhasan Abdellatif , Hannah P. Menke , Florian Doster , Kamaljit Singh , Ahmed H. Elsheikh

Machine learning of partial differential equations from data is a potential breakthrough to solve the lack of physical equations in complex dynamic systems, but because numerical differentiation is ill-posed to noise data, noise has become…

信号处理 · 电气工程与系统科学 2021-11-19 Wenbo Cao , Weiwei Zhang

Fourier Neural Operators are deep learning models that learn mappings between function spaces and can be used to learn and solve partial differential equations (PDEs), in some cases significantly faster than traditional PDE solvers. Within…

机器学习 · 计算机科学 2026-05-05 Michael F. Staddon

Neural PDE solvers are increasingly used as learned surrogates for families of partial differential equations, where the key machine learning challenge is not only interpolation on a fixed benchmark distribution but generalization under…

机器学习 · 计算机科学 2026-05-26 Lennon Shikhman

High-fidelity direct numerical simulation of turbulent flows for most real-world applications remains an outstanding computational challenge. Several machine learning approaches have recently been proposed to alleviate the computational…

Recent normalization-based methods have shown great success in tackling the distribution shift issue, facilitating non-stationary time series forecasting. Since these methods operate in the time domain, they may fail to fully capture the…

机器学习 · 统计学 2024-10-17 Xihao Piao , Zheng Chen , Yushun Dong , Yasuko Matsubara , Yasushi Sakurai

In this paper we present a Fourier feature based deep domain decomposition method (F-D3M) for partial differential equations (PDEs). Currently, deep neural network based methods are actively developed for solving PDEs, but their efficiency…

数值分析 · 数学 2022-05-05 Sen Li , Yingzhi Xia , Yu Liu , Qifeng Liao