English
Related papers

Related papers: Stable spectral neural operator for learning stiff…

200 papers

Numerical simulation of non-linear partial differential equations plays a crucial role in modeling physical science and engineering phenomena, such as weather, climate, and aerodynamics. Recent Machine Learning (ML) models trained on…

Machine Learning · Computer Science 2023-02-17 Zhiqing Sun , Yiming Yang , Shinjae Yoo

Neural operators, which can act as implicit solution operators of hidden governing equations, have recently become popular tools for learning the responses of complex real-world physical systems. Nevertheless, most neural operator…

Materials Science · Physics 2024-01-12 Siavash Jafarzadeh , Stewart Silling , Ning Liu , Zhongqiang Zhang , Yue Yu

Stiff systems of ordinary differential equations (ODEs) are pervasive in many science and engineering fields, yet standard neural ODE approaches struggle to learn them. This limitation is the main barrier to the widespread adoption of…

Numerical Analysis · Mathematics 2024-10-10 Colby Fronk , Linda Petzold

Solving high-frequency oscillatory partial differential equations (PDEs) is a critical challenge in scientific computing, with applications in fluid mechanics, quantum mechanics, and electromagnetic wave propagation. Traditional…

Machine Learning · Computer Science 2025-08-04 Xiong Xiong , Zhuo Zhang , Rongchun Hu , Chen Gao , Zichen Deng

We present a numerical framework for deep neural network (DNN) modeling of unknown time-dependent partial differential equations (PDE) using their trajectory data. Unlike the recent work of [Wu and Xiu, J. Comput. Phys. 2020], where the…

Machine Learning · Computer Science 2021-11-24 Zhen Chen , Victor Churchill , Kailiang Wu , Dongbin Xiu

Irregular sampling intervals and missing values in real-world time series data present challenges for conventional methods that assume consistent intervals and complete data. Neural Ordinary Differential Equations (Neural ODEs) offer an…

Machine Learning · Computer Science 2025-01-28 YongKyung Oh , Dong-Young Lim , Sungil Kim

The purpose of the current work is the development of a so-called physics-encoded Fourier neural operator (PeFNO) for surrogate modeling of the quasi-static equilibrium stress field in solids. Rather than accounting for constraints from…

Computational Engineering, Finance, and Science · Computer Science 2025-02-06 Mohammad S. Khorrami , Pawan Goyal , Jaber R. Mianroodi , Bob Svendsen , Peter Benner , Dierk Raabe

Multiscale problems are ubiquitous in physics. Numerical simulations of such problems by solving partial differential equations (PDEs) at high resolution are computationally too expensive for many-query scenarios, such as uncertainty…

Computational Physics · Physics 2026-02-03 Hamidreza Eivazi , Jendrik-Alexander Tröger , Stefan Wittek , Stefan Hartmann , Andreas Rausch

The predictive accuracy of operator learning frameworks depends on the quality and quantity of available training data (input-output function pairs), often requiring substantial amounts of high-fidelity data, which can be challenging to…

Machine Learning · Computer Science 2025-10-29 Sumanta Roy , Bahador Bahmani , Ioannis G. Kevrekidis , Michael D. Shields

Inspired by the ubiquitous use of differential equations to model continuous dynamics across diverse scientific and engineering domains, we propose a novel and intuitive approach to continuous sequence modeling. Our method interprets…

Machine Learning · Computer Science 2025-02-03 Macheng Shen , Chen Cheng

Neural operators have emerged as powerful data-driven surrogates for learning solution operators of parametric partial differential equations (PDEs). However, widely used Fourier Neural Operators (FNOs) rely on global Fourier…

Solving parametric partial differential equations (PDEs) and associated PDE-based, inverse problems is a central task in engineering and physics, yet existing neural operator methods struggle with high-dimensional, discontinuous inputs and…

Machine Learning · Computer Science 2025-07-03 Yaohua Zang , Phaedon-Stelios Koutsourelakis

Neural operators for time-dependent PDEs face a structural tension: spectral architectures (FNO and descendants) inherit exponential rollout-error growth from their one-step Lipschitz constant, while hierarchical U-Net operators trade…

Machine Learning · Computer Science 2026-05-12 Enrique Hernández Noguera , Md Meftahul Ferdaus , Elias Ioup , Mahdi Abdelguerfi , Julian Simeonov

We introduce the Sumudu Neural Operator (SNO), a neural operator rooted in the properties of the Sumudu Transform. We leverage the relationship between the polynomial expansions of transform pairs to decompose the input space as…

Machine Learning · Computer Science 2025-11-18 Ben Zelenskiy , Saibilila Abudukelimu , George Flint , Kevin Zhu , Sunishchal Dev

Neural operators have emerged as fast surrogate solvers for parametric partial differential equations (PDEs). However, purely data-driven models often require extensive training data and can generalize poorly, especially in small-data…

Machine Learning · Computer Science 2026-02-16 Heechang Kim , Qianying Cao , Hyomin Shin , Seungchul Lee , George Em Karniadakis , Minseok Choi

Neural operators have emerged as powerful tools for learning solution operators of partial differential equations. However, in time-dependent problems, standard training strategies such as teacher forcing introduce a mismatch between…

Machine Learning · Computer Science 2025-05-28 Zaijun Ye , Chen-Song Zhang , Wansheng Wang

It is critical yet challenging for deep learning models to properly characterize uncertainty that is pervasive in real-world environments. Although a lot of efforts have been made, such as heteroscedastic neural networks (HNNs), little work…

Machine Learning · Computer Science 2021-03-30 Peng Cui , Zhijie Deng , Wenbo Hu , Jun Zhu

Neural operator learning directly constructs the mapping relationship from the equation parameter space to the solution space, enabling efficient direct inference in practical applications without the need for repeated solution of partial…

Machine Learning · Computer Science 2026-04-28 Heng Wu , Junjie Wang , Benzhuo Lu

Parametric differential equations of the form du/dt = f(u, x, t, p) are fundamental in science and engineering. While deep learning frameworks such as the Fourier Neural Operator (FNO) can efficiently approximate solutions, they struggle…

Machine Learning · Computer Science 2025-06-03 Abdolmehdi Behroozi , Chaopeng Shen and , Daniel Kifer

Large-scale multimodal contrastive learning has recently achieved impressive success in learning rich and transferable representations, yet it remains fundamentally limited by the uniform treatment of feature dimensions and the neglect of…

Machine Learning · Computer Science 2026-02-11 Jinjin Guo , Yexin Li , Zhichao Huang , Jun Fang , Zhiyuan Liu , Chao Liu , Pengzhang Liu , Qixia Jiang
‹ Prev 1 3 4 5 6 7 10 Next ›