Related papers: Approximation by Neural Network operators in $L^p$…
We study approximation by arbitrary linear combinations of $n$ translates of a single function of periodic functions. We construct some methods of this approximation for functions in a class induced by the convolution with a given function,…
This paper studies the universal approximation property of deep neural networks for representing probability distributions. Given a target distribution $\pi$ and a source distribution $p_z$ both defined on $\mathbb{R}^d$, we prove under…
We explore the approximation capabilities of Transformer networks for H\"older and Sobolev functions, and apply these results to address nonparametric regression estimation with dependent observations. First, we establish novel upper bounds…
We examine the necessary and sufficient complexity of neural networks to approximate functions from different smoothness spaces under the restriction of encodable network weights. Based on an entropy argument, we start by proving lower…
We demonstrate that a very deep ResNet with stacked modules with one neuron per hidden layer and ReLU activation functions can uniformly approximate any Lebesgue integrable function in $d$ dimensions, i.e. $\ell_1(\mathbb{R}^d)$. Because of…
In this paper, we study the persistence approximation property for quantitative $K$-theory of filtered $L^p$ operator algebras. Moreover, we define quantitative assembly maps for $L^p$ operator algebras when $p\in [1,\infty)$. Finally, in…
The universal approximation property (UAP) of neural networks is fundamental for deep learning, and it is well known that wide neural networks are universal approximators of continuous functions within both the $L^p$ norm and the…
We prove a theorem, which generalises C. Franchetti's estimate for the norm of a projection onto a rich subspace of $L^p([0, 1])$ and the authors' related estimate for compact operators on $L^p([0, 1])$, $1 \le p < \infty$.
This article concerns the expressive power of depth in neural nets with ReLU activations and bounded width. We are particularly interested in the following questions: what is the minimal width $w_{\text{min}}(d)$ so that ReLU nets of width…
We consider a class of operator-induced norms, acting as finite-dimensional surrogates to the L2 norm, and study their approximation properties over Hilbert subspaces of L2 . The class includes, as a special case, the usual empirical norm…
Here we research the univariate quantitative approximation of real and complex valued continuous functions on a compact interval or all the real line by quasi-interpolation, Baskakov type and quadrature type neural network operators. We…
The purpose of this article is to develop a technique to estimate certain bounds for entropy numbers of diagonal operator on spaces of p-summable sequences for finite p greater than 1. The approximation method we develop in this direction…
Approximation properties of multivariate quasi-projection operators are studied in the paper. Wide classes of such operators are considered, including the sampling and the Kantorovich-Kotelnikov type operators generated by different…
We prove sharp uniform $L^p$-bounds for low-lying eigenfunctions of non-self-adjoint semiclassical pseudodifferential operators $P$ on $\mathbb{R}^{n}$ whose principal symbols are doubly-characteristic at the origin of $\mathbb{R}^{2n}$.…
We investigate properties of neural networks that use both ReLU and $x^2$ as activation functions and build upon previous results to show that both analytic functions and functions in Sobolev spaces can be approximated by such networks of…
The classical Universal Approximation Theorem holds for neural networks of arbitrary width and bounded depth. Here we consider the natural `dual' scenario for networks of bounded width and arbitrary depth. Precisely, let $n$ be the number…
In this work, we address the question whether a sufficiently deep quantum neural network can approximate a target function as accurate as possible. We start with simple but typical physical situations that the target functions are physical…
The classical development of neural networks has primarily focused on learning mappings between finite dimensional Euclidean spaces or finite sets. We propose a generalization of neural networks to learn operators, termed neural operators,…
We consider positive, integral-preserving linear operators acting on $L^1$ space, known as stochastic operators or Markov operators. We show that, on finite-dimensional spaces, any stochastic operator can be approximated by a sequence of…
In this note we prove that if a sublinear operator T satisfies a certain weighted estimate in the $L^{p}(w)$ space for all $w\in A_{p}$, $1<p<+\infty$, then the operator norm of T on $L^{p}(w)$ is a continuous function of the weight $w$,…