English
Related papers

Related papers: Merging Memory and Space: A State Space Neural Ope…

200 papers

Neural operators (NOs) provide a new paradigm for efficiently solving partial differential equations (PDEs), but their training depends on costly high-fidelity data from numerical solvers, limiting applications in complex systems. We…

Computational Physics · Physics 2026-05-18 Wen You , Shaoqian Zhou , Xuhui Meng

Neural operators generalize classical neural networks to maps between infinite-dimensional spaces, e.g., function spaces. Prior works on neural operators proposed a series of novel methods to learn such maps and demonstrated unprecedented…

Machine Learning · Computer Science 2023-05-08 Md Ashiqur Rahman , Zachary E. Ross , Kamyar Azizzadenesheli

State-space models (SSMs) have recently attention as an efficient alternative to computationally expensive attention-based models for sequence modeling. They rely on linear recurrences to integrate information over time, enabling fast…

Machine Learning · Computer Science 2026-01-01 Mahdi Karami , Ali Behrouz , Peilin Zhong , Razvan Pascanu , Vahab Mirrokni

Neural operators have been validated as promising deep surrogate models for solving partial differential equations (PDEs). Despite the critical role of boundary conditions in PDEs, however, only a limited number of neural operators robustly…

Numerical Analysis · Mathematics 2023-12-13 Ziyuan Liu , Yuhang Wu , Daniel Zhengyu Huang , Hong Zhang , Xu Qian , Songhe Song

Neural operators have emerged as a promising paradigm for learning solution operators of partial differential equa- tions (PDEs) directly from data. Existing methods, such as those based on Fourier or graph techniques, make strong as-…

Machine Learning · Computer Science 2025-11-14 Noam Koren , Ralf J. J. Mackenbach , Ruud J. G. van Sloun , Kira Radinsky , Daniel Freedman

Stochastic differential equations (SDEs) and stochastic partial differential equations (SPDEs) are fundamental for modeling stochastic dynamics across the natural sciences and modern machine learning. Learning their solution operators with…

Machine Learning · Computer Science 2026-01-30 Dai Shi , Lequan Lin , Andi Han , Luke Thompson , José Miguel Hernández-Lobato , Zhiyong Wang , Junbin Gao

Neural operators have emerged as powerful surrogates for partial differential equation (PDE) solvers, yet they are typically trained as monolithic models for individual PDEs, require energy-intensive GPU hardware, and must be retrained from…

Machine Learning · Computer Science 2026-04-14 Samrendra Roy , Souvik Chakraborty , Rizwan-uddin , Syed Bahauddin Alam

State-space models (SSMs) are a highly expressive model class for learning patterns in time series data and for system identification. Deterministic versions of SSMs (e.g. LSTMs) proved extremely successful in modeling complex time series…

The modeling and simulation of infinite-dimensional Hamiltonian systems are central problems in mathematical physics and engineering, however they pose significant computational and structural challenges for standard data-driven…

Dynamical Systems · Mathematics 2026-05-18 Yeang Makara , Yusuke Tanaka , Takashi Matsubara , Takaharu Yaguchi

Learning PDE dynamics from limited data with unknown physics is challenging. Existing neural PDE solvers either require large datasets or rely on known physics (e.g., PDE residuals or handcrafted stencils), leading to limited applicability.…

Machine Learning · Computer Science 2026-05-25 Han Wan , Rui Zhang , Hao Sun

Neural operator learning directly constructs the mapping relationship from the equation parameter space to the solution space, enabling efficient direct inference in practical applications without the need for repeated solution of partial…

Machine Learning · Computer Science 2026-04-28 Heng Wu , Junjie Wang , Benzhuo Lu

Neural operators have emerged as powerful tools for learning solution operators of partial differential equations (PDEs). However, standard spectral methods based on Fourier transforms struggle with problems involving discontinuous…

Computational Physics · Physics 2026-05-20 Giorgio M. Cavallazzi , Miguel Pérez Cuadrado , Alfredo Pinelli

Developing neural operators that accurately predict the behavior of systems governed by partial differential equations (PDEs) across unseen parameter regimes is crucial for robust generalization in scientific and engineering applications.…

Machine Learning · Computer Science 2026-04-21 Eva van Tegelen , Taniya Kapoor , George A. K. van Voorn , Peter van Heijster , Ioannis N. Athanasiadis

One of the open problems in scientific computing is the long-time integration of nonlinear stochastic partial differential equations (SPDEs). We address this problem by taking advantage of recent advances in scientific machine learning and…

Machine Learning · Computer Science 2019-09-04 Dongkun Zhang , Ling Guo , George Em Karniadakis

The neural operator has emerged as a powerful tool in learning mappings between function spaces in PDEs. However, when faced with real-world physical data, which are often highly non-uniformly distributed, it is challenging to use…

Machine Learning · Computer Science 2023-06-01 Songming Liu , Zhongkai Hao , Chengyang Ying , Hang Su , Ze Cheng , Jun Zhu

Neural operators have emerged as a powerful tool for solving partial differential equations (PDEs) and other complex scientific computing tasks. However, the performance of single operator block is often limited, thus often requiring…

Numerical Analysis · Mathematics 2025-07-18 Yichen Wang , Wenlian Lu

State-space models (SSMs) are a class of networks for sequence learning that benefit from fixed state size and linear complexity with respect to sequence length, contrasting the quadratic scaling of typical attention mechanisms. Inspired…

Machine Learning · Computer Science 2025-10-02 Jared Boyer , T. Konstantin Rusch , Daniela Rus

Solving partial differential equations (PDEs) efficiently and accurately remains a cornerstone challenge in science and engineering, especially for problems involving complex geometries and limited labeled data. We introduce a Physics- and…

Machine Learning · Computer Science 2025-08-14 Subhankar Sarkar , Souvik Chakraborty

By learning the mappings between infinite function spaces using carefully designed neural networks, the operator learning methodology has exhibited significantly more efficiency than traditional methods in solving complex problems such as…

Numerical Analysis · Mathematics 2023-03-06 Ziyuan Liu , Haifeng Wang , Hong Zhang , Kaijuna Bao , Xu Qian , Songhe Song

This work introduces the Wavelet-Laplace Neural Operator (WLNO), a novel neural operator that fuses Haar wavelet multi-scale spatial decomposition with the Laplace-domain pole-residue formulation of the Laplace Neural Operator (LNO). While…

Machine Learning · Computer Science 2026-05-26 Muhammad Abid , Arth Sojitra , Omer San