English
Related papers

Related papers: Stable spectral neural operator for learning stiff…

200 papers

Spatio-temporal process models are often used for modeling dynamic physical and biological phenomena that evolve across space and time. These phenomena may exhibit environmental heterogeneity and complex interactions that are difficult to…

Methodology · Statistics 2026-01-06 Pratik Nag , Andrew Zammit-Mangion , Sumeetpal Singh , Noel Cressie

Neural operator models for solving partial differential equations (PDEs) often rely on global mixing mechanisms-such as spectral convolutions or attention-which tend to oversmooth sharp local dynamics and introduce high computational cost.…

Machine Learning · Computer Science 2025-10-01 Chun-Wun Cheng , Bin Dong , Carola-Bibiane Schönlieb , Angelica I Aviles-Rivero

Neural differential equations offer a powerful framework for modeling continuous-time dynamics, but forecasting stiff biophysical systems remains unreliable. Standard Neural ODEs and physics informed variants often require orders of…

Machine Learning · Computer Science 2025-11-18 Kamalpreet Singh Kainth , Prathamesh Dinesh Joshi , Raj Abhijit Dandekar , Rajat Dandekar , Sreedat Panat

Deep operator network (DeepONet) has shown significant promise as surrogate models for systems governed by partial differential equations (PDEs), enabling accurate mappings between infinite-dimensional function spaces. However, when applied…

Machine Learning · Computer Science 2025-10-29 Sharmila Karumuri , Lori Graham-Brady , Somdatta Goswami

Multiscale stochastic dynamical systems have been widely adopted to a variety of scientific and engineering problems due to their capability of depicting complex phenomena in many real world applications. This work is devoted to…

Machine Learning · Statistics 2024-01-02 Lingyu Feng , Ting Gao , Min Dai , Jinqiao Duan

Many successful methods to learn dynamical systems from data have recently been introduced. However, ensuring that the inferred dynamics preserve known constraints, such as conservation laws or restrictions on the allowed system states,…

Machine Learning · Computer Science 2024-02-16 Alistair White , Niki Kilbertus , Maximilian Gelbrecht , Niklas Boers

Neural operators have emerged as powerful deep learning frameworks for approximating solution operators of parameterized partial differential equations (PDE). However, current methods predominantly rely on multilayer perceptrons (MLPs) for…

Fluid Dynamics · Physics 2026-02-03 Biao Chen , Jing Wang , Hairun Xie , Qineng Wang , Shuai Zhang , Yifan Xia , Jifa Zhang

Recent advances in the theory of Neural Operators (NOs) have enabled fast and accurate computation of the solutions to complex systems described by partial differential equations (PDEs). Despite their great success, current NO-based…

Machine Learning · Computer Science 2024-03-18 Ashutosh Singh , Ricardo Augusto Borsoi , Deniz Erdogmus , Tales Imbiriba

Recent advances in scientific machine learning (SciML) have enabled neural operators (NOs) to serve as powerful surrogates for modeling the dynamic evolution of physical systems governed by partial differential equations (PDEs). While…

Machine Learning · Computer Science 2026-02-18 Siying Ma , Mehrdad M. Zadeh , Mauricio Soroco , Wuyang Chen , Jiguo Cao , Vijay Ganesh

Neural Ordinary Differential Equations (ODE) are a promising approach to learn dynamic models from time-series data in science and engineering applications. This work aims at learning Neural ODE for stiff systems, which are usually raised…

Numerical Analysis · Mathematics 2021-10-04 Suyong Kim , Weiqi Ji , Sili Deng , Yingbo Ma , Christopher Rackauckas

Neural operators, which aim to approximate mappings between infinite-dimensional function spaces, have been widely applied in the simulation and prediction of physical systems. However, the limited representational capacity of network…

Machine Learning · Computer Science 2025-06-03 Jin Song , Kenji Kawaguchi , Zhenya Yan

By learning the mappings between infinite function spaces using carefully designed neural networks, the operator learning methodology has exhibited significantly more efficiency than traditional methods in solving complex problems such as…

Numerical Analysis · Mathematics 2023-03-06 Ziyuan Liu , Haifeng Wang , Hong Zhang , Kaijuna Bao , Xu Qian , Songhe Song

Stochastic Partial Differential Equations (SPDEs) driven by random noise play a central role in modeling physical processes with rough spatio-temporal dynamics, such as turbulence flows, superconductors, and quantum dynamics. Although…

Machine Learning · Computer Science 2026-05-18 Yuantu Zhu , Zheyan Li , Dai Shi , Luke Thompson , Oliver Nash , Jose Miguel Lara Rangel , Siran Li , Bingguang Chen , Rongchan Zhu , Qi Meng , Hao Ni

Modeling high-frequency information is a critical challenge in scientific machine learning. For instance, fully turbulent flow simulations of the Navier-Stokes equations at Reynolds numbers 3500 and above can generate high-frequency signals…

Machine Learning · Computer Science 2026-01-13 Marimuthu Kalimuthu , David Holzmüller , Mathias Niepert

Fourier Neural Operators (FNOs) have emerged as promising surrogates for partial differential equation solvers. In this work, we extensively tested FNOs on a variety of systems with non-linear and non-stationary properties, using a wide…

Computational Engineering, Finance, and Science · Computer Science 2025-11-13 Rad Haghi , Bipin Gaikwad , Abani Patra

Spectral neural operators, particularly Fourier Neural Operators (FNO), are a powerful framework for learning solution operators of partial differential equations (PDEs) due to their efficient global mixing in the frequency domain. However,…

Machine Learning · Computer Science 2026-02-06 Chun-Wun Cheng , Carola-Bibiane Schönlieb , Angelica I. Aviles-Rivero

Learning dynamics governed by differential equations is crucial for predicting and controlling the systems in science and engineering. Neural Ordinary Differential Equation (NODE), a deep learning model integrated with differential…

Machine Learning · Computer Science 2021-11-09 Shiqi Gong , Qi Meng , Yue Wang , Lijun Wu , Wei Chen , Zhi-Ming Ma , Tie-Yan Liu

Operator learning has emerged as a promising paradigm for developing efficient surrogate models to solve partial differential equations (PDEs). However, existing approaches often overlook the domain knowledge inherent in the underlying PDEs…

Machine Learning · Computer Science 2025-10-20 Ziqian Li , Kang Liu , Yongcun Song , Hangrui Yue , Enrique Zuazua

Partial differential equations (PDEs) play a crucial role in studying a vast number of problems in science and engineering. Numerically solving nonlinear and/or high-dimensional PDEs is often a challenging task. Inspired by the traditional…

Numerical Analysis · Mathematics 2022-01-11 Yihao Hu , Tong Zhao , Shixin Xu , Zhiliang Xu , Lizhen Lin

For partial differential equations on domains of arbitrary shapes, existing works of neural operators attempt to learn a mapping from geometries to solutions. It often requires a large dataset of geometry-solution pairs in order to obtain a…

Machine Learning · Computer Science 2024-05-29 Ze Cheng , Zhongkai Hao , Xiaoqiang Wang , Jianing Huang , Youjia Wu , Xudan Liu , Yiru Zhao , Songming Liu , Hang Su