English
Related papers

Related papers: New universal operator approximation theorem for e…

200 papers

While it is widely known that neural networks are universal approximators of continuous functions, a less known and perhaps more powerful result is that a neural network with a single hidden layer can approximate accurately any nonlinear…

Machine Learning · Computer Science 2021-11-03 Lu Lu , Pengzhan Jin , George Em Karniadakis

Deep Operator Networks (DeepONets) provide a branch-trunk neural architecture for approximating nonlinear operators acting between function spaces. In the classical operator approximation framework, the input is a function $u\in C(K_1)$…

Machine Learning · Computer Science 2026-03-13 Vugar Ismailov

Operator learning has been highly successful for continuous mappings between infinite-dimensional spaces, such as PDE solution operators. However, many operators of interest-including differential operators-are discontinuous or set-valued,…

Machine Learning · Computer Science 2026-05-13 Takashi Furuya , Yury Korolev , Takaharu Yaguchi

Recently, versions of neural networks with infinite-dimensional affine operators inside the computational units (``neural operator'' networks) have been applied to learn solutions to differential equations. To enable practical computations,…

Functional Analysis · Mathematics 2026-02-03 Vinícius Luz Oliveira , Vladimir G. Pestov

While many problems in machine learning focus on learning mappings between finite-dimensional spaces, scientific applications require approximating mappings between function spaces, i.e., operators. We study the problem of learning…

Machine Learning · Computer Science 2025-10-30 Adrien Weihs , Jingmin Sun , Zecheng Zhang , Hayden Schaeffer

The universal approximation theorem asserts that a single hidden layer neural network approximates continuous functions with any desired precision on compact sets. As an existential result, the universal approximation theorem supports the…

Machine Learning · Computer Science 2023-09-15 Wington L. Vital , Guilherme Vieira , Marcos Eduardo Valle

The study of universal approximation of arbitrary functions $f: \mathcal{X} \to \mathcal{Y}$ by neural networks has a rich and thorough history dating back to Kolmogorov (1957). In the case of learning finite dimensional maps, many authors…

Machine Learning · Computer Science 2019-10-04 William H. Guss , Ruslan Salakhutdinov

The universal approximation theorem states that a neural network with one hidden layer can approximate continuous functions on compact sets with any desired precision. This theorem supports using neural networks for various applications,…

Machine Learning · Computer Science 2024-08-13 Marcos Eduardo Valle , Wington L. Vital , Guilherme Vieira

Operator learning based on neural operators has emerged as a promising paradigm for the data-driven approximation of operators, mapping between infinite-dimensional Banach spaces. Despite significant empirical progress, our theoretical…

Machine Learning · Computer Science 2024-07-04 Samuel Lanthaler

The relationship between the operator approximation property and the strong operator approximation property has deep significance in the theory of operator algebras. The original definitions of Effros and Ruan, unlike the classical…

Functional Analysis · Mathematics 2007-05-23 Corran Webster

We describe generalizations of the universal approximation theorem for neural networks to maps invariant or equivariant with respect to linear representations of groups. Our goal is to establish network-like computational models that are…

Neural and Evolutionary Computing · Computer Science 2018-04-30 Dmitry Yarotsky

The universal approximation theorem, in one of its most general versions, says that if we consider only continuous activation functions $\sigma$, then a standard feedforward neural network with one hidden layer is able to approximate any…

Machine Learning · Computer Science 2020-02-18 Kai Fong Ernest Chong

Deep neural operators (DNOs) have been utilized to approximate nonlinear mappings between function spaces. However, DNOs face the challenge of increased dimensionality and computational cost associated with unaligned observation data. In…

Machine Learning · Computer Science 2023-08-21 Bo Chen , Chenyu Wang , Weipeng Li , Haiyang Fu

The standard Universal Approximation Theorem for operator neural networks (NNs) holds for arbitrary width and bounded depth. Here, we prove that operator NNs of bounded width and arbitrary depth are universal approximators for continuous…

Machine Learning · Computer Science 2021-09-24 Annan Yu , Chloé Becquey , Diana Halikias , Matthew Esmaili Mallory , Alex Townsend

We obtain a new universal approximation theorem for continuous (possibly nonlinear) operators on arbitrary Banach spaces using the Leray-Schauder mapping. Moreover, we introduce and study a method for operator learning in Banach spaces…

Numerical Analysis · Mathematics 2026-03-17 Emanuele Zappala

We introduce an abstract neural flow framework for neural networks and neural operators. The framework contains two continuous-depth models, namely neural flows with composition and separation structures, and covers both finite-dimensional…

Machine Learning · Computer Science 2026-05-27 Shuang Chen , Juncai He , Xue-Cheng Tai

Neural operator architectures approximate operators between infinite-dimensional Banach spaces of functions. They are gaining increased attention in computational science and engineering, due to their potential both to accelerate…

Numerical Analysis · Mathematics 2024-06-18 Samuel Lanthaler , Zongyi Li , Andrew M. Stuart

Although very successfully used in conventional machine learning, convolution based neural network architectures -- believed to be inconsistent in function space -- have been largely ignored in the context of learning solution operators of…

We study a specific family of symmetric norms on the algebra $\mathcal B(\mathcal H)$ of operators on a separable infinite-dimensional Hilbert space. With respect to each symmetric norm in this family the identity operator fails to attain…

Functional Analysis · Mathematics 2020-09-24 Satish K. Pandey

This paper introduces the Kernel Neural Operator (KNO), a provably convergent operator-learning architecture that utilizes compositions of deep kernel-based integral operators for function-space approximation of operators (maps from…

Machine Learning · Computer Science 2026-05-06 Matthew Lowery , John Turnage , Zachary Morrow , John D. Jakeman , Akil Narayan , Shandian Zhe , Varun Shankar
‹ Prev 1 2 3 10 Next ›