English
Related papers

Related papers: Dimension reduction for derivative-informed operat…

200 papers

We present a framework for recovering/approximating unknown time-dependent partial differential equation (PDE) using its solution data. Instead of identifying the terms in the underlying PDE, we seek to approximate the evolution operator of…

Numerical Analysis · Mathematics 2020-05-05 Kailiang Wu , Dongbin Xiu

Neural operators are efficient surrogate models for solving partial differential equations (PDEs), but their key components face challenges: (1) in order to improve accuracy, attention mechanisms suffer from computational inefficiency on…

Machine Learning · Computer Science 2025-04-23 Zherui Yang , Zhengyang Xue , Ligang Liu

We propose a novel data-lean operator learning algorithm, the Reduced Basis Neural Operator (ReBaNO), to solve a group of PDEs with multiple distinct inputs. Inspired by the Reduced Basis Method and the recently introduced Generative…

Machine Learning · Computer Science 2025-09-12 Haolan Zheng , Yanlai Chen , Jiequn Han , Yue Yu

While it is widely known that neural networks are universal approximators of continuous functions, a less known and perhaps more powerful result is that a neural network with a single hidden layer can approximate accurately any nonlinear…

Machine Learning · Computer Science 2021-11-03 Lu Lu , Pengzhan Jin , George Em Karniadakis

Deep neural operators can learn nonlinear mappings between infinite-dimensional function spaces via deep neural networks. As promising surrogate solvers of partial differential equations (PDEs) for real-time prediction, deep neural…

Machine Learning · Computer Science 2023-05-17 Min Zhu , Handi Zhang , Anran Jiao , George Em Karniadakis , Lu Lu

In this paper, we investigate the applications of operator learning, specifically DeepONet, for solving nonlinear partial differential equations (PDEs). Unlike conventional function learning methods that require training separate neural…

Machine Learning · Computer Science 2025-09-30 Yahong Yang

Operator regression provides a powerful means of constructing discretization-invariant emulators for partial-differential equations (PDEs) describing physical systems. Neural operators specifically employ deep neural networks to approximate…

Machine Learning · Computer Science 2023-04-18 Katiana Kontolati , Somdatta Goswami , George Em Karniadakis , Michael D. Shields

We propose a finite-dimensional control-based method to approximate solution operators for evolutional partial differential equations (PDEs), particularly in high-dimensions. By employing a general reduced-order model, such as a deep neural…

Numerical Analysis · Mathematics 2024-01-22 Nathan Gaby , Xiaojing Ye

Solving parametric Partial Differential Equations (PDEs) for a broad range of parameters is a critical challenge in scientific computing. To this end, neural operators, which \textcolor{black}{predicts the PDE solution with variable PDE…

Numerical Analysis · Mathematics 2024-11-14 Weiheng Zhong , Hadi Meidani

We propose a scalable framework for the learning of high-dimensional parametric maps via adaptively constructed residual network (ResNet) maps between reduced bases of the inputs and outputs. When just few training data are available, it is…

Shape optimization under uncertainty (OUU) is computationally intensive for classical PDE-based methods due to the high cost of repeated sampling-based risk evaluation across many uncertainty realizations and varying geometries, while…

Optimization and Control · Mathematics 2026-03-04 Xindi Gong , Dingcheng Luo , Thomas O'Leary-Roseberry , Ruanui Nicholson , Omar Ghattas

For partial differential equations on domains of arbitrary shapes, existing works of neural operators attempt to learn a mapping from geometries to solutions. It often requires a large dataset of geometry-solution pairs in order to obtain a…

Machine Learning · Computer Science 2024-05-29 Ze Cheng , Zhongkai Hao , Xiaoqiang Wang , Jianing Huang , Youjia Wu , Xudan Liu , Yiru Zhao , Songming Liu , Hang Su

Accurate approximation of scalar-valued functions from sample points is a key task in computational science. Recently, machine learning with Deep Neural Networks (DNNs) has emerged as a promising tool for scientific computing, with…

Machine Learning · Computer Science 2021-03-08 Ben Adcock , Simone Brugiapaglia , Nick Dexter , Sebastian Moraga

This paper studies the learning of linear operators between infinite-dimensional Hilbert spaces. The training data comprises pairs of random input vectors in a Hilbert space and their noisy images under an unknown self-adjoint linear…

Statistics Theory · Mathematics 2023-05-12 Maarten V. de Hoop , Nikola B. Kovachki , Nicholas H. Nelsen , Andrew M. Stuart

Many physical processes in science and engineering are naturally represented by operators between infinite-dimensional function spaces. The problem of operator learning, in this context, seeks to extract these physical processes from…

Machine Learning · Computer Science 2024-01-22 Hao Liu , Biraj Dahal , Rongjie Lai , Wenjing Liao

Neural operators (NOs) are a class of deep learning models designed to simultaneously solve infinitely many related problems by casting them into an infinite-dimensional space, whereon these NOs operate. A significant gap remains between…

Machine Learning · Computer Science 2025-08-22 Anastasis Kratsios , Ariel Neufeld , Philipp Schmocker

Recent years have witnessed the promise of coupling machine learning methods and physical domain-specific insights for solving scientific problems based on partial differential equations (PDEs). However, being data-intensive, these methods…

Machine Learning · Computer Science 2025-06-03 Wuyang Chen , Jialin Song , Pu Ren , Shashank Subramanian , Dmitriy Morozov , Michael W. Mahoney

Deep neural networks have emerged as powerful tools for learning operators defined over infinite-dimensional function spaces. However, existing theories frequently encounter difficulties related to dimensionality and limited…

Machine Learning · Computer Science 2026-05-12 Jianfei Li , Shuo Huang , Han Feng , Ding-Xuan Zhou , Gitta Kutyniok

Neural operators are a type of deep architecture that learns to solve (i.e. learns the nonlinear solution operator of) partial differential equations (PDEs). The current state of the art for these models does not provide explicit…

Machine Learning · Computer Science 2022-08-03 Emilia Magnani , Nicholas Krämer , Runa Eschenhagen , Lorenzo Rosasco , Philipp Hennig

Neural operators have emerged as powerful surrogates for the solution of partial differential equations (PDEs), yet their ability to handle general, highly variable boundary conditions (BCs) remains limited. Existing approaches often fail…

Machine Learning · Computer Science 2026-05-14 Sepehr Mousavi , Siddhartha Mishra , Laura De Lorenzis