English
Related papers

Related papers: A Mathematical Guide to Operator Learning

200 papers

In scientific and engineering applications, solving partial differential equations (PDEs) across various parameters and domains normally relies on resource-intensive numerical methods. Neural operators based on deep learning offered a…

Numerical Analysis · Mathematics 2024-06-21 Zhiwei Zhao , Changqing Liu , Yingguang Li , Zhibin Chen , Xu Liu

Nonlinear PDE solvers require fine space-time discretizations and local linearizations, leading to high memory cost and slow runtimes. Neural operators such as FNOs and DeepONets offer fast single-shot inference by learning…

Machine Learning · Computer Science 2025-10-23 Yifei Sun

Learned image reconstruction has become a pillar in computational imaging and inverse problems. Among the most successful approaches are learned iterative networks, which are formulated by unrolling classical iterative optimisation…

Image and Video Processing · Electrical Eng. & Systems 2025-12-10 Andreas Hauptmann , Ozan Öktem

The predictive accuracy of operator learning frameworks depends on the quality and quantity of available training data (input-output function pairs), often requiring substantial amounts of high-fidelity data, which can be challenging to…

Machine Learning · Computer Science 2025-10-29 Sumanta Roy , Bahador Bahmani , Ioannis G. Kevrekidis , Michael D. Shields

In this paper, we propose a systematic approach for accelerating finite element-type methods by machine learning for the numerical solution of partial differential equations (PDEs). The main idea is to use a neural network to learn the…

Numerical Analysis · Mathematics 2024-10-11 Shukai Du , Samuel N. Stechmann

Although there is a substantial body of literature on control and optimization problems for parabolic and hyperbolic systems, the specific problem of controlling and optimizing the coefficients of the associated operators within such…

Optimization and Control · Mathematics 2026-05-21 Alain Bensoussan , Minh-Binh Tran , Bangjie Wang

Neural operators have emerged as a powerful tool for solving partial differential equations (PDEs) and other complex scientific computing tasks. However, the performance of single operator block is often limited, thus often requiring…

Numerical Analysis · Mathematics 2025-07-18 Yichen Wang , Wenlian Lu

We propose a new neural network based method for solving inverse problems for partial differential equations (PDEs) by formulating the PDE inverse problem as a bilevel optimization problem. At the upper level, we minimize the data loss with…

Machine Learning · Computer Science 2026-01-08 Ray Zirui Zhang , Christopher E. Miles , Xiaohui Xie , John S. Lowengrub

This paper presents a mathematics-informed approach to neural operator design, building upon the theoretical framework established in our prior work. By integrating rigorous mathematical analysis with practical design strategies, we aim to…

Numerical Analysis · Mathematics 2024-12-31 Vu-Anh Le , Mehmet Dik

Operator learning provides methods to approximate mappings between infinite-dimensional function spaces. Deep operator networks (DeepONets) are a notable architecture in this field. Recently, an extension of DeepONet based on model…

Machine Learning · Computer Science 2024-03-28 Hamidreza Eivazi , Stefan Wittek , Andreas Rausch

We construct the first rigorously justified probabilistic algorithm for recovering the solution operator of a hyperbolic partial differential equation (PDE) in two variables from input-output training pairs. The primary challenge of…

Numerical Analysis · Mathematics 2026-02-03 Christopher Wang , Alex Townsend

Physics-informed deep operator networks (DeepONets) have emerged as a promising approach toward numerically approximating the solution of partial differential equations (PDEs). In this work, we aim to develop further understanding of what…

Machine Learning · Computer Science 2024-11-28 Emily Williams , Amanda Howard , Brek Meuris , Panos Stinis

Partial differential equations (PDEs) govern nearly every physical process in science and engineering, yet solving them at scale remains prohibitively expensive. Generative AI has transformed language, vision, and protein science, but…

Machine Learning · Computer Science 2026-04-10 Yilong Dai , Shengyu Chen , Xiaowei Jia , Runlong Yu

We introduce a method that combines neural operators, physics-informed machine learning, and standard numerical methods for solving PDEs. The proposed approach extends each of the aforementioned methods and unifies them within a single…

Computational Engineering, Finance, and Science · Computer Science 2025-12-02 Shahed Rezaei , Reza Najian Asl , Kianoosh Taghikhani , Ahmad Moeineddin , Michael Kaliske , Markus Apel

Neural operators, as an efficient surrogate model for learning the solutions of PDEs, have received extensive attention in the field of scientific machine learning. Among them, attention-based neural operators have become one of the…

Machine Learning · Computer Science 2024-12-30 Zipeng Xiao , Zhongkai Hao , Bokai Lin , Zhijie Deng , Hang Su

Stochastic partial differential equations (SPDEs) are the mathematical tool of choice for modelling spatiotemporal PDE-dynamics under the influence of randomness. Based on the notion of mild solution of an SPDE, we introduce a novel neural…

Machine Learning · Computer Science 2022-09-27 Cristopher Salvi , Maud Lemercier , Andris Gerasimovics

Solving partial differential equations (PDEs) by neural networks as well as Kolmogorov-Arnold Networks (KANs), including physics-informed neural networks (PINNs), physics-informed KANs (PIKANs), and neural operators, are known to exhibit…

Classical neural ODEs trained with explicit methods are intrinsically limited by stability, crippling their efficiency and robustness for stiff learning problems that are common in graph learning and scientific machine learning. We present…

Machine Learning · Computer Science 2024-12-17 Hong Zhang , Ying Liu , Romit Maulik

Discovering hidden partial differential equations (PDEs) and operators from data is an important topic at the frontier between machine learning and numerical analysis. This doctoral thesis introduces theoretical results and deep learning…

Numerical Analysis · Mathematics 2022-10-31 Nicolas Boullé

Engineering design problems often involve solving parametric Partial Differential Equations (PDEs) under variable PDE parameters and domain geometry. Recently, neural operators have shown promise in learning PDE operators and quickly…

Machine Learning · Computer Science 2024-11-14 Weiheng Zhong , Hadi Meidani