English
Related papers

Related papers: Pretraining Codomain Attention Neural Operators fo…

200 papers

This focused review explores a range of neural operator architectures for approximating solutions to parametric partial differential equations (PDEs), emphasizing high-level concepts and practical implementation strategies. The study covers…

Computational Engineering, Finance, and Science · Computer Science 2025-03-10 Prashant K. Jha

Neural Operators (NOs) are a leading method for surrogate modeling of partial differential equations. Unlike traditional neural networks, which approximate individual functions, NOs learn the mappings between function spaces. While NOs have…

Astrophysics of Galaxies · Physics 2025-08-01 Keith Poletti , Stella S. R. Offner , Rachel A. Ward

Neural operators have emerged as promising frameworks for learning mappings governed by partial differential equations (PDEs), serving as data-driven alternatives to traditional numerical methods. While methods such as the Fourier neural…

Machine Learning · Computer Science 2025-04-21 Minsu Koh , Beom-Chul Park , Heejo Kong , Seong-Whan Lee

The operator learning has received significant attention in recent years, with the aim of learning a mapping between function spaces. Prior works have proposed deep neural networks (DNNs) for learning such a mapping, enabling the learning…

Machine Learning · Statistics 2024-02-15 Yusuke Tanaka , Takaharu Yaguchi , Tomoharu Iwata , Naonori Ueda

Neural operators learn to map initial conditions to the terminal solution of partial differential equations (PDEs), providing a surrogate for the full operator mapping. This enables rapid prediction across different input configurations.…

Machine Learning · Computer Science 2026-05-14 Runlong Xie , An Luo

This article explores operator learning models that can deduce solutions to partial differential equations (PDEs) on arbitrary domains without requiring retraining. We introduce two innovative models rooted in boundary integral equations…

Mathematical Physics · Physics 2024-06-05 Bin Meng , Yutong Lu , Ying Jiang

Although there is a substantial body of literature on control and optimization problems for parabolic and hyperbolic systems, the specific problem of controlling and optimizing the coefficients of the associated operators within such…

Optimization and Control · Mathematics 2026-05-21 Alain Bensoussan , Minh-Binh Tran , Bangjie Wang

Unsupervised learning with functional data is an emerging paradigm of machine learning research with applications to computer vision, climate modeling and physical systems. A natural way of modeling functional data is by learning operators…

Machine Learning · Computer Science 2023-02-22 Jacob H. Seidman , Georgios Kissas , George J. Pappas , Paris Perdikaris

Recent advancements in operator-type neural networks have shown promising results in approximating the solutions of spatiotemporal Partial Differential Equations (PDEs). However, these neural networks often entail considerable training…

Machine Learning · Computer Science 2025-05-08 Shuhao Cao , Francesco Brarda , Ruipeng Li , Yuanzhe Xi

Neural operators, as an efficient surrogate model for learning the solutions of PDEs, have received extensive attention in the field of scientific machine learning. Among them, attention-based neural operators have become one of the…

Machine Learning · Computer Science 2024-12-30 Zipeng Xiao , Zhongkai Hao , Bokai Lin , Zhijie Deng , Hang Su

Model reduction for fluid flow simulation continues to be of great interest across a number of scientific and engineering fields. In a previous work [arXiv:2104.13962], we explored the use of Neural Ordinary Differential Equations (NODE) as…

Machine Learning · Computer Science 2021-07-07 Sourav Dutta , Peter Rivera-Casillas , Orie M. Cecil , Matthew W. Farthing , Emma Perracchione , Mario Putti

Neural operators extend data-driven models to map between infinite-dimensional functional spaces. While these operators perform effectively in either the time or frequency domain, their performance may be limited when applied to…

Machine Learning · Computer Science 2024-06-06 Karn Tiwari , N M Anoop Krishnan , A P Prathosh

Neural operator (NO) architectures learn nonlinear maps between infinite-dimensional function spaces and are widely used to accelerate simulation and enable data-driven model discovery. While universality results ensure expressivity, they…

Optimization and Control · Mathematics 2026-03-02 Takashi Furuya , Anastasis Kratsios

Learning and solving governing equations of a physical system, represented by partial differential equations (PDEs), from data is a central challenge in a variety of areas of science and engineering. Traditional numerical methods for…

Machine Learning · Computer Science 2024-06-10 Anran Jiao , Haiyang He , Rishikesh Ranade , Jay Pathak , Lu Lu

We propose the *State Space Neural Operator* (SS-NO), a compact architecture for learning solution operators of time-dependent partial differential equations (PDEs). Our formulation extends structured state space models (SSMs) to joint…

Machine Learning · Computer Science 2026-03-09 Nodens Koren , Samuel Lanthaler

Accurately simulating systems governed by PDEs, such as voltage fields in cardiac electrophysiology (EP) modelling, remains a significant modelling challenge. Traditional numerical solvers are computationally expensive and sensitive to…

Machine Learning · Computer Science 2026-04-22 Hannah Lydon , Milad Kazemi , Martin Bishop , Nicola Paoletti

Accurately learning solution operators for time-dependent partial differential equations (PDEs) from sparse and irregular data remains a challenging task. Recurrent DeepONet extensions inherit the discrete-time limitations of…

Computational Engineering, Finance, and Science · Computer Science 2025-07-04 Diab W. Abueidda , Mbebo Nonna , Panos Pantidis , Mostafa E. Mobasher

Solving partial differential equations (PDEs) on shapes underpins many shape analysis and engineering tasks; yet, prevailing PDE solvers operate on polygonal/triangle meshes while modern 3D assets increasingly live as neural…

Machine Learning · Computer Science 2026-05-29 Lilian Welschinger , Yilin Liu , Zican Wang , Niloy Mitra

Neural operators are a popular technique in scientific machine learning to learn a mathematical model of the behavior of unknown physical systems from data. Neural operators are especially useful to learn solution operators associated with…

Numerical Analysis · Mathematics 2022-08-05 Nicolas Boullé , Seick Kim , Tianyi Shi , Alex Townsend

Despite the promise of scientific machine learning (SciML) in combining data-driven techniques with mechanistic modeling, existing approaches for incorporating hard constraints in neural differential equations (NDEs) face significant…

Machine Learning · Computer Science 2025-05-28 Avik Pal , Alan Edelman , Christopher Rackauckas