English
Related papers

Related papers: On universal approximation and error bounds for Fo…

200 papers

Neural operators learn mappings between function spaces, which is practical for learning solution operators of PDEs and other scientific modeling applications. Among them, the Fourier neural operator (FNO) is a popular architecture that…

Machine Learning · Computer Science 2024-06-11 Miguel Liu-Schiaffini , Julius Berner , Boris Bonev , Thorsten Kurth , Kamyar Azizzadenesheli , Anima Anandkumar

In this paper, we propose physics-informed neural operators (PINO) that combine training data and physics constraints to learn the solution operator of a given family of parametric Partial Differential Equations (PDE). PINO is the first…

We introduce the Laplace neural operator (LNO), which leverages the Laplace transform to decompose the input space. Unlike the Fourier Neural Operator (FNO), LNO can handle non-periodic signals, account for transient responses, and exhibit…

Machine Learning · Computer Science 2023-05-31 Qianying Cao , Somdatta Goswami , George Em Karniadakis

High-fidelity direct numerical simulation of turbulent flows for most real-world applications remains an outstanding computational challenge. Several machine learning approaches have recently been proposed to alleviate the computational…

The computational efficiency of many neural operators, widely used for learning solutions of PDEs, relies on the fast Fourier transform (FFT) for performing spectral computations. As the FFT is limited to equispaced (rectangular) grids,…

Neural operators are a new type of models that can map between function spaces, allowing trained models to emulate the solution operators of partial differential equations (PDEs). This paper proposes a multigrid Fourier neural operator…

Numerical Analysis · Mathematics 2025-05-22 Zi-Hao Guo , Hou-Biao Li

The success of Neural networks in providing miraculous results when applied to a wide variety of tasks is astonishing. Insight in the working can be obtained by studying the universal approximation property of neural networks. It is proved…

Machine Learning · Computer Science 2021-11-17 R Subhash Chandra Bose , Kakarla Yaswanth

Parametric differential equations of the form du/dt = f(u, x, t, p) are fundamental in science and engineering. While deep learning frameworks such as the Fourier Neural Operator (FNO) can efficiently approximate solutions, they struggle…

Machine Learning · Computer Science 2025-06-03 Abdolmehdi Behroozi , Chaopeng Shen and , Daniel Kifer

Vision transformers have delivered tremendous success in representation learning. This is primarily due to effective token mixing through self attention. However, this scales quadratically with the number of pixels, which becomes infeasible…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 John Guibas , Morteza Mardani , Zongyi Li , Andrew Tao , Anima Anandkumar , Bryan Catanzaro

We introduce an abstract neural flow framework for neural networks and neural operators. The framework contains two continuous-depth models, namely neural flows with composition and separation structures, and covers both finite-dimensional…

Machine Learning · Computer Science 2026-05-27 Shuang Chen , Juncai He , Xue-Cheng Tai

We generalize the framework of Fredholm Neural Networks, to learn non-expansive integral operators arising in Fredholm Integral Equations (FIEs) of the second kind in arbitrary dimensions. We first present the proposed Fredholm Integral…

Numerical Analysis · Mathematics 2026-04-06 Kyriakos C. Georgiou , Constantinos Siettos , Athanasios N. Yannacopoulos

A large class of inverse problems for PDEs are only well-defined as mappings from operators to functions. Existing operator learning frameworks map functions to functions and need to be modified to learn inverse maps from data. We propose a…

Machine Learning · Computer Science 2023-06-06 Roberto Molinaro , Yunan Yang , Björn Engquist , Siddhartha Mishra

Neural operators aim to approximate the solution operator of a system of differential equations purely from data. They have shown immense success in modeling complex dynamical systems across various domains. However, the occurrence of…

Machine Learning · Computer Science 2025-04-01 Christopher Bülte , Philipp Scholl , Gitta Kutyniok

Neural ordinary differential equations (NODEs) is an invertible neural network architecture promising for its free-form Jacobian and the availability of a tractable Jacobian determinant estimator. Recently, the representation power of NODEs…

Machine Learning · Computer Science 2020-12-07 Takeshi Teshima , Koichi Tojo , Masahiro Ikeda , Isao Ishikawa , Kenta Oono

Neural operators can learn nonlinear mappings between function spaces and offer a new simulation paradigm for real-time prediction of complex dynamics for realistic diverse applications as well as for system identification in science and…

Computational Physics · Physics 2022-03-23 Lu Lu , Xuhui Meng , Shengze Cai , Zhiping Mao , Somdatta Goswami , Zhongqiang Zhang , George Em Karniadakis

While it is widely known that neural networks are universal approximators of continuous functions, a less known and perhaps more powerful result is that a neural network with a single hidden layer can approximate accurately any nonlinear…

Machine Learning · Computer Science 2021-11-03 Lu Lu , Pengzhan Jin , George Em Karniadakis

We propose a deep neural-operator framework for a general class of probability models. Under global Lipschitz conditions on the operator over the entire Euclidean space-and for a broad class of probabilistic models-we establish a universal…

Machine Learning · Computer Science 2025-11-11 Erhan Bayraktar , Qi Feng , Zecheng Zhang , Zhaoyu Zhang

Neural operators (NOs) are a class of deep learning models designed to simultaneously solve infinitely many related problems by casting them into an infinite-dimensional space, whereon these NOs operate. A significant gap remains between…

Machine Learning · Computer Science 2025-08-22 Anastasis Kratsios , Ariel Neufeld , Philipp Schmocker

Reliable digital twins of lithium-ion batteries must achieve high physical fidelity with sub-millisecond speed. In this work, we benchmark three operator-learning surrogates for the Single Particle Model (SPM): Deep Operator Networks…

Machine Learning · Computer Science 2025-08-12 Amir Ali Panahi , Daniel Luder , Billy Wu , Gregory Offer , Dirk Uwe Sauer , Weihan Li

Fourier Neural Operators (FNO) have emerged as promising solutions for efficiently solving partial differential equations (PDEs) by learning infinite-dimensional function mappings through frequency domain transformations. However, the…

Machine Learning · Computer Science 2025-05-22 Tianyu Chen , Haoyi Zhou , Ying Li , Hao Wang , Zhenzhe Zhang , Tianchen Zhu , Shanghang Zhang , Jianxin Li