中文
相关论文

相关论文: Merging Memory and Space: A State Space Neural Ope…

200 篇论文

Neural Operators (NOs) provide a powerful framework for computations involving physical laws that can be modelled by (integro-) partial differential equations (PDEs), directly learning maps between infinite-dimensional function spaces that…

In this paper, we propose Neumann Series Neural Operator (NSNO) to learn the solution operator of Helmholtz equation from inhomogeneity coefficients and source terms to solutions. Helmholtz equation is a crucial partial differential…

数值分析 · 数学 2024-01-25 Fukai Chen , Ziyang Liu , Guochang Lin , Junqing Chen , Zuoqiang Shi

Neural operator models for solving partial differential equations (PDEs) often rely on global mixing mechanisms-such as spectral convolutions or attention-which tend to oversmooth sharp local dynamics and introduce high computational cost.…

机器学习 · 计算机科学 2025-10-01 Chun-Wun Cheng , Bin Dong , Carola-Bibiane Schönlieb , Angelica I Aviles-Rivero

Accurate and efficient solutions of spatiotemporal partial differential equations (PDEs), such as phase-field models, are fundamental for understanding interfacial dynamics and microstructural evolution in materials science and fluid…

Data-driven machine learning approaches are being increasingly used to solve partial differential equations (PDEs). They have shown particularly striking successes when training an operator, which takes as input a PDE in some family, and…

机器学习 · 计算机科学 2023-12-04 Tanya Marwah , Ashwini Pokle , J. Zico Kolter , Zachary C. Lipton , Jianfeng Lu , Andrej Risteski

Neural operators have emerged as powerful data-driven surrogates for learning solution operators of parametric partial differential equations (PDEs). However, widely used Fourier Neural Operators (FNOs) rely on global Fourier…

Neural Operators (NOs) have emerged as powerful tools for learning mappings between function spaces. Among them, the kernel integral operator has been widely used in universally approximating architectures. Following the original…

机器学习 · 计算机科学 2026-01-30 Haoze Song , Zhihao Li , Xiaobo Zhang , Zecheng Gan , Zhilu Lai , Wei Wang

Linear time-invariant state space models (SSM) are a classical model from engineering and statistics, that have recently been shown to be very promising in machine learning through the Structured State Space sequence model (S4). A core…

机器学习 · 计算机科学 2022-08-08 Albert Gu , Isys Johnson , Aman Timalsina , Atri Rudra , Christopher Ré

The scientific computation methods development in conjunction with artificial intelligence technologies remains a hot research topic. Finding a balance between lightweight and accurate computations is a solid foundation for this direction.…

机器学习 · 计算机科学 2025-07-03 Nikita Sakovich , Dmitry Aksenov , Ekaterina Pleshakova , Sergey Gataullin

Predictive learning for spatio-temporal processes (PL-STP) on complex spatial domains plays a critical role in various scientific and engineering fields, with its essence being the construction of operators between infinite-dimensional…

机器学习 · 计算机科学 2024-09-10 Qinglu Meng , Yingguang Li , Zhiliang Deng , Xu Liu , Gengxiang Chen , Qiutong Wu , Changqing Liu , Xiaozhong Hao

Neural operators (NOs) struggle with high-contrast multiscale partial differential equations (PDEs), where fine-scale heterogeneities cause large errors. To address this, we use the Generalized Multiscale Finite Element Method (GMsFEM) that…

In this paper, we address the issue of modeling and estimating changes in the state of the spatio-temporal dynamical systems based on a sequence of observations like video frames. Traditional numerical simulation systems depend largely on…

机器学习 · 计算机科学 2024-02-12 Kun Wang , Hao Wu , Guibin Zhang , Junfeng Fang , Yuxuan Liang , Yuankai Wu , Roger Zimmermann , Yang Wang

The operator learning has received significant attention in recent years, with the aim of learning a mapping between function spaces. Prior works have proposed deep neural networks (DNNs) for learning such a mapping, enabling the learning…

机器学习 · 统计学 2024-02-15 Yusuke Tanaka , Takaharu Yaguchi , Tomoharu Iwata , Naonori Ueda

The classical development of neural networks has primarily focused on learning mappings between finite dimensional Euclidean spaces or finite sets. We propose a generalization of neural networks to learn operators, termed neural operators,…

We investigate neural ordinary and stochastic differential equations (neural ODEs and SDEs) to model stochastic dynamics in fully and partially observed environments within a model-based reinforcement learning (RL) framework. Through a…

机器学习 · 计算机科学 2026-03-25 Chao Han , Stefanos Ioannou , Luca Manneschi , T. J. Hayward , Michael Mangan , Aditya Gilra , Eleni Vasilaki

Despite the promising performance of state space models (SSMs) in long sequence modeling, limitations still exist. Advanced SSMs like S5 and S6 (Mamba) in addressing non-uniform sampling, their recursive structures impede efficient SSM…

机器学习 · 计算机科学 2024-06-11 Biqing Qi , Junqi Gao , Kaiyan Zhang , Dong Li , Jianxing Liu , Ligang Wu , Bowen Zhou

A novel State-Space Neural Network with Ordered variance (SSNNO) is presented in which the state variables are ordered in decreasing variance. A systematic way of model order reduction with SSNNO is proposed, which leads to a Reduced order…

系统与控制 · 电气工程与系统科学 2024-12-18 Midhun T. Augustine , Mani Bhushan , Sharad Bhartiya

Selective state-space models (SSMs) are an emerging alternative to the Transformer, offering the unique advantage of parallel training and sequential inference. Although these models have shown promising performance on a variety of tasks,…

Partial differential equations (PDEs) are fundamental to modeling complex and nonlinear physical phenomena, but their numerical solution often requires significant computational resources, particularly when a large number of forward full…

计算物理 · 物理学 2025-07-08 Qibang Liu , Seid Koric

Deep operator network (DeepONet) has shown significant promise as surrogate models for systems governed by partial differential equations (PDEs), enabling accurate mappings between infinite-dimensional function spaces. However, when applied…

机器学习 · 计算机科学 2025-10-29 Sharmila Karumuri , Lori Graham-Brady , Somdatta Goswami