English
Related papers

Related papers: Pretraining Codomain Attention Neural Operators fo…

200 papers

A new data-driven method for operator learning of stochastic differential equations(SDE) is proposed in this paper. The central goal is to solve forward and inverse stochastic problems more effectively using limited data. Deep operator…

Machine Learning · Statistics 2022-04-08 Jiahao Zhang , Shiqi Zhang , Guang Lin

Data-driven machine learning approaches are being increasingly used to solve partial differential equations (PDEs). They have shown particularly striking successes when training an operator, which takes as input a PDE in some family, and…

Machine Learning · Computer Science 2023-12-04 Tanya Marwah , Ashwini Pokle , J. Zico Kolter , Zachary C. Lipton , Jianfeng Lu , Andrej Risteski

Neural ordinary differential equations (NODEs) presented a new paradigm to construct (continuous-time) neural networks. While showing several good characteristics in terms of the number of parameters and the flexibility in constructing…

Machine Learning · Computer Science 2021-06-01 Sheo Yon Jhin , Minju Jo , Taeyong Kong , Jinsung Jeon , Noseong Park

Neural operators are a type of deep architecture that learns to solve (i.e. learns the nonlinear solution operator of) partial differential equations (PDEs). The current state of the art for these models does not provide explicit…

Machine Learning · Computer Science 2022-08-03 Emilia Magnani , Nicholas Krämer , Runa Eschenhagen , Lorenzo Rosasco , Philipp Hennig

Existing work in scientific machine learning (SciML) has shown that data-driven learning of solution operators can provide a fast approximate alternative to classical numerical partial differential equation (PDE) solvers. Of these, Neural…

Machine Learning · Computer Science 2024-06-13 S. Chandra Mouli , Danielle C. Maddix , Shima Alizadeh , Gaurav Gupta , Andrew Stuart , Michael W. Mahoney , Yuyang Wang

Neural operators have become increasingly popular in solving \textit{partial differential equations} (PDEs) due to their superior capability to capture intricate mappings between function spaces over complex domains. However, the…

Machine Learning · Computer Science 2026-03-02 Jianing Huang , Kaixuan Zhang , Youjia Wu , Ze Cheng

Learning underlying dynamics from data is important and challenging in many real-world scenarios. Incorporating differential equations (DEs) to design continuous networks has drawn much attention recently, however, most prior works make…

Machine Learning · Computer Science 2023-02-03 Yesom Park , Jaemoo Choi , Changyeon Yoon , Chang hoon Song , Myungjoo Kang

Recent advances in scientific machine learning (SciML) have enabled neural operators (NOs) to serve as powerful surrogates for modeling the dynamic evolution of physical systems governed by partial differential equations (PDEs). While…

Machine Learning · Computer Science 2026-02-18 Siying Ma , Mehrdad M. Zadeh , Mauricio Soroco , Wuyang Chen , Jiguo Cao , Vijay Ganesh

The neural operator has emerged as a powerful tool in learning mappings between function spaces in PDEs. However, when faced with real-world physical data, which are often highly non-uniformly distributed, it is challenging to use…

Machine Learning · Computer Science 2023-06-01 Songming Liu , Zhongkai Hao , Chengyang Ying , Hang Su , Ze Cheng , Jun Zhu

Many important problems in science and engineering require solving the so-called parametric partial differential equations (PDEs), i.e., PDEs with different physical parameters, boundary conditions, shapes of computational domains, etc.…

Numerical Analysis · Mathematics 2024-02-06 Zhanhong Ye , Xiang Huang , Hongsheng Liu , Bin Dong

Numerous physics theories are rooted in partial differential equations (PDEs). However, the increasingly intricate physics equations, especially those that lack analytic solutions or closed forms, have impeded the further development of…

Machine Learning · Computer Science 2023-03-21 Wei Xiong , Muyuan Ma , Xiaomeng Huang , Ziyang Zhang , Pei Sun , Yang Tian

Modeling nonlinear spatiotemporal dynamical systems has primarily relied on partial differential equations (PDEs). However, the explicit formulation of PDEs for many underexplored processes, such as climate systems, biochemical reaction and…

Machine Learning · Computer Science 2023-05-23 Chengping Rao , Hao Sun , Yang Liu

Recently deep learning surrogates and neural operators have shown promise in solving partial differential equations (PDEs). However, they often require a large amount of training data and are limited to bounded domains. In this work, we…

Machine Learning · Computer Science 2023-08-25 Zhiwei Fang , Sifan Wang , Paris Perdikaris

Single-operator learning involves training a deep neural network to learn a specific operator, whereas recent work in multi-operator learning uses an operator embedding structure to train a single neural network on data from multiple…

Machine Learning · Computer Science 2025-06-16 Jingmin Sun , Zecheng Zhang , Hayden Schaeffer

Stochastic differential equations (SDEs) and stochastic partial differential equations (SPDEs) are fundamental for modeling stochastic dynamics across the natural sciences and modern machine learning. Learning their solution operators with…

Machine Learning · Computer Science 2026-01-30 Dai Shi , Lequan Lin , Andi Han , Luke Thompson , José Miguel Hernández-Lobato , Zhiyong Wang , Junbin Gao

Neural operators have emerged as powerful deep learning frameworks for approximating solution operators of parameterized partial differential equations (PDE). However, current methods predominantly rely on multilayer perceptrons (MLPs) for…

Fluid Dynamics · Physics 2026-02-03 Biao Chen , Jing Wang , Hairun Xie , Qineng Wang , Shuai Zhang , Yifan Xia , Jifa Zhang

This work proposes an autoencoder neural network as a non-linear generalization of projection-based methods for solving Partial Differential Equations (PDEs). The proposed deep learning architecture presented is capable of generating the…

Computational Physics · Physics 2020-06-25 Jaime Lopez Garcia , Angel Rivero Jimenez

The predictive accuracy of operator learning frameworks depends on the quality and quantity of available training data (input-output function pairs), often requiring substantial amounts of high-fidelity data, which can be challenging to…

Machine Learning · Computer Science 2025-10-29 Sumanta Roy , Bahador Bahmani , Ioannis G. Kevrekidis , Michael D. Shields

Neural operators have emerged as a powerful tool for learning the mapping between infinite-dimensional parameter and solution spaces of partial differential equations (PDEs). In this work, we focus on multiscale PDEs that have important…

Machine Learning · Computer Science 2024-06-11 Xinliang Liu , Bo Xu , Shuhao Cao , Lei Zhang

The finite element method (FEM) is a well-established numerical method for solving partial differential equations (PDEs). However, its mesh-based nature gives rise to substantial computational costs, especially for complex multiscale…

Computational Engineering, Finance, and Science · Computer Science 2025-06-24 Weihang Ouyang , Yeonjong Shin , Si-Wei Liu , Lu Lu