English
Related papers

Related papers: Principled Approaches for Extending Neural Archite…

200 papers

The classical development of neural networks has primarily focused on learning mappings between finite dimensional Euclidean spaces or finite sets. We propose a generalization of neural networks to learn operators, termed neural operators,…

This focused review explores a range of neural operator architectures for approximating solutions to parametric partial differential equations (PDEs), emphasizing high-level concepts and practical implementation strategies. The study covers…

Computational Engineering, Finance, and Science · Computer Science 2025-03-10 Prashant K. Jha

An important application of neural networks to scientific computing has been the learning of non-linear operators. In this framework, a neural network is trained to fit a non-linear map between two infinite dimensional spaces, for example,…

Machine Learning · Computer Science 2026-02-03 Shao-Ting Chiu , Aditya Nambiar , Ali Syed , Jonathan W. Siegel , Ulisses Braga-Neto

Operator learning refers to the application of ideas from machine learning to approximate (typically nonlinear) operators mapping between Banach spaces of functions. Such operators often arise from physical models expressed in terms of…

Machine Learning · Computer Science 2024-02-27 Nikola B. Kovachki , Samuel Lanthaler , Andrew M. Stuart

Neural operators have emerged as transformative tools for learning mappings between infinite-dimensional function spaces, offering useful applications in solving complex partial differential equations (PDEs). This paper presents a rigorous…

Numerical Analysis · Mathematics 2026-01-23 Vu-Anh Le , Mehmet Dik

A large class of inverse problems for PDEs are only well-defined as mappings from operators to functions. Existing operator learning frameworks map functions to functions and need to be modified to learn inverse maps from data. We propose a…

Machine Learning · Computer Science 2023-06-06 Roberto Molinaro , Yunan Yang , Björn Engquist , Siddhartha Mishra

The classical development of neural networks has been primarily for mappings between a finite-dimensional Euclidean space and a set of classes, or between two finite-dimensional Euclidean spaces. The purpose of this work is to generalize…

Although very successfully used in conventional machine learning, convolution based neural network architectures -- believed to be inconsistent in function space -- have been largely ignored in the context of learning solution operators of…

PDEs arise ubiquitously in science and engineering, where solutions depend on parameters (physical properties, boundary conditions, geometry). Traditional numerical methods require re-solving the PDE for each parameter, making parameter…

Machine Learning · Statistics 2026-02-02 Zhuo Zhang , Xiong Xiong , Sen Zhang , Yuan Zhao , Xi Yang

Deep neural networks, despite their success in numerous applications, often function without established theoretical foundations. In this paper, we bridge this gap by drawing parallels between deep learning and classical numerical analysis.…

Machine Learning · Computer Science 2023-10-04 Emanuele Zappala , Daniel Levine , Sizhuang He , Syed Rizvi , Sacha Levy , David van Dijk

Neural Operators offer a powerful, data-driven tool for solving parametric PDEs as they can represent maps between infinite-dimensional function spaces. In this work, we employ physics-informed Neural Operators in the context of…

Machine Learning · Statistics 2023-03-08 Sebastian Kaltenbach , Paris Perdikaris , Phaedon-Stelios Koutsourelakis

Operator learning aims to discover properties of an underlying dynamical system or partial differential equation (PDE) from data. Here, we present a step-by-step guide to operator learning. We explain the types of problems and PDEs amenable…

Numerical Analysis · Mathematics 2025-04-30 Nicolas Boullé , Alex Townsend

Operator learning has emerged as a powerful tool in scientific computing for approximating mappings between infinite-dimensional function spaces. A primary application of operator learning is the development of surrogate models for the…

Machine Learning · Statistics 2025-04-07 Unique Subedi , Ambuj Tewari

Neural operators have emerged as powerful surrogates for the solution of partial differential equations (PDEs), yet their ability to handle general, highly variable boundary conditions (BCs) remains limited. Existing approaches often fail…

Machine Learning · Computer Science 2026-05-14 Sepehr Mousavi , Siddhartha Mishra , Laura De Lorenzis

The order/dimension of models derived on the basis of data is commonly restricted by the number of observations, or in the context of monitored systems, sensing nodes. This is particularly true for structural systems (e.g., civil or…

Machine Learning · Computer Science 2022-12-01 Zhilu Lai , Wei Liu , Xudong Jian , Kiran Bacsa , Limin Sun , Eleni Chatzi

While many problems in machine learning focus on learning mappings between finite-dimensional spaces, scientific applications require approximating mappings between function spaces, i.e., operators. We study the problem of learning…

Machine Learning · Computer Science 2025-10-30 Adrien Weihs , Jingmin Sun , Zecheng Zhang , Hayden Schaeffer

Scientific discovery and engineering design are currently limited by the time and cost of physical experiments, selected mostly through trial-and-error and intuition that require deep domain expertise. Numerical simulations present an…

Machine Learning · Computer Science 2024-01-08 Kamyar Azizzadenesheli , Nikola Kovachki , Zongyi Li , Miguel Liu-Schiaffini , Jean Kossaifi , Anima Anandkumar

Partial differential equations (PDEs) govern a wide variety of dynamical processes in science and engineering, yet obtaining their numerical solutions often requires high-resolution discretizations and repeated evaluations of complex…

Machine Learning · Computer Science 2026-01-26 Valentin Duruisseaux , Jean Kossaifi , Anima Anandkumar

Thanks to their universal approximation properties and new efficient training strategies, Deep Neural Networks are becoming a valuable tool for the approximation of mathematical operators. In the present work, we introduce Mesh-Informed…

Numerical Analysis · Mathematics 2023-05-08 Nicola Rares Franco , Andrea Manzoni , Paolo Zunino

Neural Operators (NOs) are machine learning models designed to solve partial differential equations (PDEs) by learning to map between function spaces. Neural Operators such as the Deep Operator Network (DeepONet) and the Fourier Neural…

Machine Learning · Computer Science 2025-04-30 W. Diab , M. Al-Kobaisi
‹ Prev 1 2 3 10 Next ›