中文
相关论文

相关论文: Merging Memory and Space: A State Space Neural Ope…

200 篇论文

Deep neural operators are recognized as an effective tool for learning solution operators of complex partial differential equations (PDEs). As compared to laborious analytical and computational tools, a single neural operator can predict…

机器学习 · 统计学 2023-02-14 Navaneeth N , Tapas Tripura , Souvik Chakraborty

Learning underlying dynamics from data is important and challenging in many real-world scenarios. Incorporating differential equations (DEs) to design continuous networks has drawn much attention recently, however, most prior works make…

机器学习 · 计算机科学 2023-02-03 Yesom Park , Jaemoo Choi , Changyeon Yoon , Chang hoon Song , Myungjoo Kang

We introduce a novel grid-independent model for learning partial differential equations (PDEs) from noisy and partial observations on irregular spatiotemporal grids. We propose a space-time continuous latent neural PDE model with an…

机器学习 · 计算机科学 2023-10-27 Valerii Iakovlev , Markus Heinonen , Harri Lähdesmäki

Interfacial dynamics underlie a wide range of phenomena, including phase transitions, microstructure coarsening, pattern formation, and thin-film growth, and are typically described by stiff, time-dependent nonlinear partial differential…

State space models (SSMs) have gained attention by showing potential to outperform Transformers. However, previous studies have not sufficiently addressed the mechanisms underlying their high performance owing to a lack of theoretical…

机器学习 · 计算机科学 2025-10-02 JingChuan Guan , Tomoyuki Kubota , Yasuo Kuniyoshi , Kohei Nakajima

Partial differential equations (PDEs) are central to scientific modeling. Modern workflows increasingly rely on learning-based components to support model reuse, inference, and integration across large computational processes. Despite the…

机器学习 · 计算机科学 2026-02-20 Yilong Dai , Shengyu Chen , Ziyi Wang , Xiaowei Jia , Yiqun Xie , Vipin Kumar , Runlong Yu

This work explores the in-context learning capabilities of State Space Models (SSMs) and presents, to the best of our knowledge, the first theoretical explanation of a possible underlying mechanism. We introduce a novel weight construction…

机器学习 · 计算机科学 2025-08-05 Federico Arangath Joseph , Kilian Konstantin Haefeli , Noah Liniger , Caglar Gulcehre

We present Unified PDE Solvers (UPS), a data- and compute-efficient approach to developing unified neural operators for diverse families of spatiotemporal PDEs from various domains, dimensions, and resolutions. UPS embeds different PDEs…

机器学习 · 计算机科学 2024-11-26 Junhong Shen , Tanya Marwah , Ameet Talwalkar

Neural operators excel as deterministic surrogates, but inevitably collapse to the conditional mean when applied to stochastic PDEs, discarding the variance and tail structure upon which uncertainty quantification depends. Recovering this…

机器学习 · 计算机科学 2026-05-18 Kai Hidajat

Traffic forecasting in cellular networks is a challenging spatiotemporal prediction problem due to strong temporal dependencies, spatial heterogeneity across cells, and the need for scalability to large network deployments. Traditional…

机器学习 · 计算机科学 2026-03-16 Zineddine Bettouche , Khalid Ali , Andreas Fischer , Andreas Kassler

Recent advancements in operator-type neural networks have shown promising results in approximating the solutions of spatiotemporal Partial Differential Equations (PDEs). However, these neural networks often entail considerable training…

机器学习 · 计算机科学 2025-05-08 Shuhao Cao , Francesco Brarda , Ruipeng Li , Yuanzhe Xi

We propose a three-tier machine learning framework based on the next-generation Equation-Free algorithm for learning the spatio-temporal dynamics of mass-constrained complex systems with hidden states, whose dynamics can in principle be…

This paper introduces the Kernel Neural Operator (KNO), a provably convergent operator-learning architecture that utilizes compositions of deep kernel-based integral operators for function-space approximation of operators (maps from…

机器学习 · 计算机科学 2026-05-06 Matthew Lowery , John Turnage , Zachary Morrow , John D. Jakeman , Akil Narayan , Shandian Zhe , Varun Shankar

Modelling complex multiphysics systems governed by nonlinear and strongly coupled partial differential equations (PDEs) is a cornerstone in computational science and engineering. However, it remains a formidable challenge for traditional…

机器学习 · 计算机科学 2025-02-28 Biao Yuan , He Wang , Yanjie Song , Ana Heitor , Xiaohui Chen

In this paper, we propose physics-informed neural operators (PINO) that combine training data and physics constraints to learn the solution operator of a given family of parametric Partial Differential Equations (PDE). PINO is the first…

With massive advancements in sensor technologies and Internet-of-things, we now have access to terabytes of historical data; however, there is a lack of clarity in how to best exploit the data to predict future events. One possible…

计算物理 · 物理学 2022-05-05 Tapas Tripura , Souvik Chakraborty

Partial Differential Equation (PDE) problems often exhibit strong local spatial structures, and effectively capturing these structures is critical for approximating their solutions. Recently, the Fourier Neural Operator (FNO) has emerged as…

机器学习 · 计算机科学 2025-06-05 Chaoyu Liu , Davide Murari , Lihao Liu , Yangming Li , Chris Budd , Carola-Bibiane Schönlieb

In scientific and engineering applications, solving partial differential equations (PDEs) across various parameters and domains normally relies on resource-intensive numerical methods. Neural operators based on deep learning offered a…

数值分析 · 数学 2024-06-21 Zhiwei Zhao , Changqing Liu , Yingguang Li , Zhibin Chen , Xu Liu

We introduce a novel Multimodal Neural Operator (MNO) architecture designed to learn solution operators for multi-parameter nonlinear boundary value problems (BVPs). Traditional neural operators primarily map either the PDE coefficients or…

计算工程、金融与科学 · 计算机科学 2025-07-17 Vamshi C. Madala , Nithin Govindarajan , Shivkumar Chandrasekaran

Scientific machine learning has enabled the extraction of physical insights and data-driven modeling of high-dimensional spatiotemporal data, yet achieving physically interpretable latent representations and computationally efficient…

机器学习 · 计算机科学 2026-05-04 Siva Viknesh , Amirhossein Arzani