English
Related papers

Related papers: Approximation by Neural Network operators in $L^p$…

200 papers

Operators such as Carleson operator are known to be bounded on $L^p$ for all $1<p<\infty$, but not from $L^1$ to weak-$L^1$ and from $H^p$ to $L^p$ for each $0<p\leq 1$, the object of this article is to give a estimate for all $0<p<\infty$.…

Classical Analysis and ODEs · Mathematics 2021-08-16 Shunchao Long

We obtain a new universal approximation theorem for continuous (possibly nonlinear) operators on arbitrary Banach spaces using the Leray-Schauder mapping. Moreover, we introduce and study a method for operator learning in Banach spaces…

Numerical Analysis · Mathematics 2026-03-17 Emanuele Zappala

This paper offers a newly created integral approach for operators employing the orthogonal modified Laguerre polynomials and P\u{a}lt\u{a}nea basis. These operators approximate the functions over the interval $[0,\infty)$. Further, the…

Functional Analysis · Mathematics 2024-05-14 Kapil Kumar , Naokant Deo , Durvesh Kumar Verma

In this paper, we prove that a shallow neural network with a monotone sigmoid, ReLU, ELU, Softplus, or LeakyReLU activation function can arbitrarily well approximate any L^p(p>=2) integrable functions defined on R*[0,1]^n. We also prove…

Machine Learning · Computer Science 2021-10-12 Ming-Xi Wang , Yang Qu

The aim of this paper is twofold. First, we show that a certain concatenation of a proximity operator with an affine operator is again a proximity operator on a suitable Hilbert space. Second, we use our findings to establish so-called…

We study the approximation and statistical complexity of learning collections of operators in a shared multi-task setting, with a focus on the Multiple Neural Operators (MNO) architecture. For broad classes of Lipschitz multiple operator…

Machine Learning · Computer Science 2026-05-22 Adrien Weihs , Hayden Schaeffer

Approximation properties of the sampling-type quasi-projection operators $Q_j(f,\varphi, \widetilde{\varphi})$ for functions $f$ from anisotropic Besov spaces are studied. Error estimates in $L_p$-norm are obtained for a large class of…

Classical Analysis and ODEs · Mathematics 2020-01-27 Yurii Kolomoitsev , Maria Skopina

We introduce an abstract neural flow framework for neural networks and neural operators. The framework contains two continuous-depth models, namely neural flows with composition and separation structures, and covers both finite-dimensional…

Machine Learning · Computer Science 2026-05-27 Shuang Chen , Juncai He , Xue-Cheng Tai

We prove several universal approximation results at minimal or near-minimal width for approximation of $L^p(\mathbb{R}^{d_x}, \mathbb{R}^{d_y})$ and $C^0(\mathbb{R}^{d_x}, \mathbb{R}^{d_y})$ on compact sets. Our approach uses a unified…

Neural and Evolutionary Computing · Computer Science 2025-12-29 Dennis Rochau , Robin Chan , Hanno Gottschalk

The Universal Approximation Theorem posits that neural networks can theoretically possess unlimited approximation capacity with a suitable activation function and a freely chosen or trained set of parameters. However, a more practical…

Machine Learning · Computer Science 2024-09-26 Li Liu , Tengchao Yu , Heng Yong

We consider neural network approximation spaces that classify functions according to the rate at which they can be approximated (with error measured in $L^p$) by ReLU neural networks with an increasing number of coefficients, subject to…

Functional Analysis · Mathematics 2021-10-29 Philipp Grohs , Felix Voigtlaender

One of the most influential results in neural network theory is the universal approximation theorem [1, 2, 3] which states that continuous functions can be approximated to within arbitrary accuracy by single-hidden-layer feedforward neural…

Machine Learning · Computer Science 2021-12-16 Clemens Hutter , Recep Gül , Helmut Bölcskei

Recently, the authors of \cite{SYZ22} developed a neural network with width $36d(2d + 1)$ and depth $11$, which utilizes a special activation function called the elementary universal activation function, to achieve the super approximation…

Machine Learning · Computer Science 2025-06-17 Ayan Maiti , Michelle Michelle , Haizhao Yang

Learning operators between infinitely dimensional spaces is an important learning task arising in wide applications in machine learning, imaging science, mathematical modeling and simulations, etc. This paper studies the nonparametric…

Machine Learning · Statistics 2022-01-04 Hao Liu , Haizhao Yang , Minshuo Chen , Tuo Zhao , Wenjing Liao

Universal approximation theory offers a foundational framework to verify neural network expressiveness, enabling principled utilization in real-world applications. However, most existing theoretical constructions are established by…

Machine Learning · Computer Science 2026-01-27 ZeYu Li , ShiJun Zhang , TieYong Zeng , FengLei Fan

We consider solving a probably infinite dimensional operator equation, where the operator is not modeled by physical laws but is specified indirectly via training pairs of the input-output relation of the operator. Neural operators have…

Numerical Analysis · Mathematics 2026-05-06 Otmar Scherzer , Thi Lan Nhi Vu , Jikai Yan

For any $p\in[1,\infty]$, we prove that the set of simple functions taking at most $k$ different values is proximinal in $L^p$ for all $k\geq 1$. We introduce the class of uniformly approximable subsets of $L^p$, which is larger than the…

Classical Analysis and ODEs · Mathematics 2022-09-07 Guillaume Grelier , Jaime San Martín

This paper investigates the $L^p$ boundedness of wave operators for the Laplace operator with finite rank perturbations \begin{equation*} H=-\Delta+\sum\limits_{i=1}^N\langle\cdot\,, \varphi_i\rangle \varphi_i \qquad \mbox{on}\,\,\, \R^d.…

Analysis of PDEs · Mathematics 2025-08-08 Han Cheng , Shanlin Huang , Avy Soffer , Zhao Wu

Measure-preserving neural networks are well-developed invertible models, however, their approximation capabilities remain unexplored. This paper rigorously analyses the approximation capabilities of existing measure-preserving neural…

Machine Learning · Computer Science 2022-01-06 Aiqing Zhu , Pengzhan Jin , Yifa Tang

In this paper, we develop a multivariate framework for approximation by max-min neural network operators. Building on the recent advances in approximation theory by neural network operators, particularly, the univariate max-min operators,…

Machine Learning · Computer Science 2026-01-14 Abhishek Yadav , Uaday Singh , Feng Dai