English
Related papers

Related papers: Universal Approximation of Nonlinear Operators and…

200 papers

Operator learning is the approximation of operators between infinite dimensional Banach spaces using machine learning approaches. While most progress in this area has been driven by variants of deep neural networks such as the Deep Operator…

Machine Learning · Computer Science 2025-09-11 Chunyang Liao , Deanna Needell , Hayden Schaeffer

In this paper we study derivations in subalgebras of $L_{0}^{wo}(\nu ;% \mathcal{L}(X)) $, the algebra of all weak operator measurable funtions $f:S\to \mathcal{L}(X) $, where $% \mathcal{L}(X) $ is the Banach algebra of all bounded linear…

Operator Algebras · Mathematics 2008-11-07 A. F. Ber , B. de Pagter , F. A. Sukochev

In this paper, we propose a DeepONet structure with causality to represent the causal linear operators between Banach spaces of time-dependent signals. The theorem of universal approximations to nonlinear operators proposed in…

Numerical Analysis · Mathematics 2022-09-20 Lizuo Liu , Kamaljyoti Nath , Wei Cai

Motivated by the rapidly growing field of mathematics for operator approximation with neural networks, we present a novel universal operator approximation theorem for a broad class of encoder-decoder architectures. In this study, we focus…

Functional Analysis · Mathematics 2025-04-01 Janek Gödeke , Pascal Fernsel

We present a general kernel-based framework for learning operators between Banach spaces along with a priori error analysis and comprehensive numerical comparisons with popular neural net (NN) approaches such as Deep Operator Net (DeepONet)…

Machine Learning · Statistics 2023-10-10 Pau Batlle , Matthieu Darcy , Bamdad Hosseini , Houman Owhadi

Deep neural networks (DNNs) have achieved remarkable success in numerous domains, and their application to PDE-related problems has been rapidly advancing. This paper provides an estimate for the generalization error of learning Lipschitz…

Machine Learning · Computer Science 2023-10-04 Ke Chen , Chunmei Wang , Haizhao Yang

We study the universal approximation properties of transformers and neural integral operators for operators in Banach spaces. In particular, we show that the transformer architecture is a universal approximator of integral operators between…

Machine Learning · Computer Science 2026-04-28 Emanuele Zappala , Maryam Bagherian

We study universal approximation of continuous functionals on compact subsets of products of Hilbert spaces. We prove that any such functional can be uniformly approximated by models that first take finitely many continuous linear…

Machine Learning · Computer Science 2026-02-04 Andrey Krylov , Maksim Penkin

In this paper, we investigate the applications of operator learning, specifically DeepONet, for solving nonlinear partial differential equations (PDEs). Unlike conventional function learning methods that require training separate neural…

Machine Learning · Computer Science 2025-09-30 Yahong Yang

The classical development of neural networks has primarily focused on learning mappings between finite dimensional Euclidean spaces or finite sets. We propose a generalization of neural networks to learn operators, termed neural operators,…

We propose derivative-informed neural operators (DINOs), a general family of neural networks to approximate operators as infinite-dimensional mappings from input function spaces to output function spaces or quantities of interest. After…

Numerical Analysis · Mathematics 2023-10-18 Thomas O'Leary-Roseberry , Peng Chen , Umberto Villa , Omar Ghattas

We present an algorithm for learning operators between Banach spaces, based on the use of Leray-Schauder mappings to learn a finite-dimensional approximation of compact subspaces. We show that the resulting method is a universal…

Machine Learning · Computer Science 2026-03-03 Emanuele Zappala

In this paper, we introduce semi-autonomous neural ordinary differential equations (SA-NODEs), a variation of the vanilla NODEs, employing fewer parameters. We investigate the universal approximation properties of SA-NODEs for dynamical…

Numerical Analysis · Mathematics 2026-01-13 Ziqian Li , Kang Liu , Lorenzo Liverani , Enrique Zuazua

We study the derivative-informed learning of nonlinear operators between infinite-dimensional separable Hilbert spaces by neural networks. Such operators can arise from the solution of partial differential equations (PDEs), and are used in…

Numerical Analysis · Mathematics 2025-04-14 Dingcheng Luo , Thomas O'Leary-Roseberry , Peng Chen , Omar Ghattas

Recently, versions of neural networks with infinite-dimensional affine operators inside the computational units (``neural operator'' networks) have been applied to learn solutions to differential equations. To enable practical computations,…

Functional Analysis · Mathematics 2026-02-03 Vinícius Luz Oliveira , Vladimir G. Pestov

This paper discusses various theorems on the approximation capabilities of neural networks (NNs), which are known as universal approximation theorems (UATs). The paper gives a systematic overview of UATs starting from the preliminary…

Machine Learning · Computer Science 2024-07-19 Midhun T Augustine

As an emerging paradigm in scientific machine learning, neural operators aim to learn operators, via neural networks, that map between infinite-dimensional function spaces. Several neural operators have been recently developed. However, all…

Machine Learning · Computer Science 2022-02-15 Pengzhan Jin , Shuai Meng , Lu Lu

Optimal Transport (OT) problems are a cornerstone of many applications, but solving them is computationally expensive. To address this problem, we propose UNOT (Universal Neural Optimal Transport), a novel framework capable of accurately…

Machine Learning · Computer Science 2026-02-11 Jonathan Geuter , Gregor Kornhardt , Ingimar Tomasson , Vaios Laschos

Unbounded order convergence has lately been systematically studied as a generalization of almost everywhere convergence to the abstract setting of vector and Banach lattices. This paper presents a duality theory for unbounded order…

Functional Analysis · Mathematics 2017-05-18 Niushan Gao , Denny H. Leung , Foivos Xanthos

Operator regression provides a powerful means of constructing discretization-invariant emulators for partial-differential equations (PDEs) describing physical systems. Neural operators specifically employ deep neural networks to approximate…

Machine Learning · Computer Science 2023-04-18 Katiana Kontolati , Somdatta Goswami , George Em Karniadakis , Michael D. Shields