Related papers: Schauder Bases for $C[0, 1]$ Using ReLU, Softplus …

In this article M\"untz spaces $M_{\Lambda ,C}$ of continuous functions supplied with the absolute maximum norm are considered. An approximation of functions in M\"untz spaces $M_{\Lambda ,C}$ of continuous functions by Fourier series is…

We construct a Schauder basis for $L_1$ consisting of non-negative functions and investigate unconditionally basic and quasibasic sequences of non-negative functions in $L_p$, $1\le p < \infty$.

This paper establishes the (nearly) optimal approximation error characterization of deep rectified linear unit (ReLU) networks for smooth functions in terms of both width and depth simultaneously. To that end, we first prove that…

In this paper, we prove that a shallow neural network with a monotone sigmoid, ReLU, ELU, Softplus, or LeakyReLU activation function can arbitrarily well approximate any L^p(p>=2) integrable functions defined on R*[0,1]^n. We also prove…

The seminal work of Daubechies, DeVore, Foucart, Hanin, and Petrova introduced in 2022 a sequence of univariate piece-wise linear functions, which resemble the classical Fourier basis and which, at the same time, can be easily reproduced by…

We establish in this work approximation results of deep neural networks for smooth functions measured in Sobolev norms, motivated by recent development of numerical solvers for partial differential equations using deep neural networks. {Our…

In this paper, we describe an algorithm for approximating functions of the form $f(x)=\int_{a}^{b} x^{\mu} \sigma(\mu) \, d \mu$ over $[0,1]$, where $\sigma(\mu)$ is some signed Radon measure, or, more generally, of the form $f(x) =…

In this paper, we have extended the well-established universal approximator theory to neural networks that use the unbounded ReLU activation function and a nonlinear softmax output layer. We have proved that a sufficiently large neural…

Well-known activation functions like ReLU or Leaky ReLU are non-differentiable at the origin. Over the years, many smooth approximations of ReLU have been proposed using various smoothing techniques. We propose new smooth approximations of…

Recently, Daubechies, DeVore, Foucart, Hanin, and Petrova introduced a system of piece-wise linear functions, which can be easily reproduced by artificial neural networks with the ReLU activation function and which form a Riesz basis of…

In this paper it is shown that $C_\beta$-smooth functions can be approximated by deep neural networks with ReLU activation function and with parameters $\{0,\pm \frac{1}{2}, \pm 1, 2\}$. The $l_0$ and $l_1$ parameter norms of considered…

We analyze the approximation by radial basis functions of a hypersingular integral equation on an open surface. In order to accommodate the homogeneous essential boundary condition along the surface boundary, scaled radial basis functions…

We prove that in every separable Banach space $X$ with a Schauder basis and a $C^k$-smooth norm it is possible to approximate, uniformly on bounded sets, every equivalent norm with a $C^k$-smooth one in a way that the approximation is…

We consider a basis of square integrable functions on a rectangle, contained in $R^2$, constructed with Legendre polynomials, suitable, for instance, for the analogical description of images on the plane or in other fields of application of…

We prove that $L_2(\mathbb{R})$ contains a Schauder basis of non-negative functions. Similarly, $L_p(\mathbb{R})$ contains a Schauder basic sequence of non-negative functions such that $L_p(\mathbb{R})$ embeds into the closed span of the…

We introduce and study a generalization $s_{(\mu|\lambda)}$ of the Schur functions called the almost symmetric Schur functions. These functions simultaneously generalize the finite variable key polynomials and the infinite variable Schur…

The approximation properties of infinitely wide shallow neural networks heavily depend on the choice of the activation function. To understand this influence, we study embeddings between Barron spaces with different activation functions.…

This article concerns the expressive power of depth in neural nets with ReLU activations and bounded width. We are particularly interested in the following questions: what is the minimal width $w_{\text{min}}(d)$ so that ReLU nets of width…

We study the problem of approximating compactly-supported integrable functions while implementing their support set using feedforward neural networks. Our first main result transcribes this "structured" approximation problem into a…

Deep neural networks with rectified linear units (ReLU) are getting more and more popular due to their universal representation power and successful applications. Some theoretical progress regarding the approximation power of deep ReLU…