Related papers: Schauder Bases for $C[0, 1]$ Using ReLU, Softplus …
We consider the trigonometric-like system of piecewise linear functions introduced recently by Daubechies, DeVore, Foucart, Hanin, and Petrova. We provide an alternative proof that this system forms a Riesz basis of $L_2([0,1])$ based on…
In studying the expressiveness of neural networks, an important question is whether there are functions which can only be approximated by sufficiently deep networks, assuming their size is bounded. However, for constant depths, existing…
Consider the eigenfunctions $u$ for a ree rectangular membrane wo that $-\Delta u=\lambda u$ on $\mathcal R(c,d)=(0,d)\times(0,d)$. In this note we show that if if $u>0$ on $\partial \mathcal R(c,d)) then $u\equiv C$ for some positive…
Certain classes of multiparameter persistence modules may be encoded as signed barcodes, represented as points in a polyhedral subset of Euclidean space, we refer to as signed persistence diagrams. These signed persistence diagrams exist in…
We study Lipschitz-free spaces over compact and uniformly discrete metric spaces enjoying certain high regularity properties - having group structure with left-invariant metric. Using methods of harmonic analysis we show that, given a…
In this article we study high-dimensional approximation capacities of shallow and deep artificial neural networks (ANNs) with the rectified linear unit (ReLU) activation. In particular, it is a key contribution of this work to reveal that…
Dirac modules over the quaternion skew field are investigated on a compact domain relative to the supremum norm and Hardy's norm with the parameter $1<p<\infty $ as well. An existence of Schauder bases in them is proved. Procedures for…
We study approximation and statistical learning properties of deep ReLU networks under structural assumptions that mitigate the curse of dimensionality. We prove minimax-optimal uniform approximation rates for $s$-H\"older smooth functions…
An approach to construct explicit integral representations for two-layer ReLU networks is presented, which provides relatively simple representations for any multivariate polynomial. Quantitative bounds are provided for a particular,…
Rearrangement-invariance in function spaces can be viewed as a kind of generalization of 1-symmetry for Schauder bases. We define subrearrangement-invariance in function spaces as an analogous generalization of 1-subsymmetry. It is then…
We prove various theorems on approximation using polynomials with integer coefficients in the Bernstein basis of any given order. In the extreme, we draw the coefficients from $\{ \pm 1\}$ only. A basic case of our results states that for…
We prove that every nonnegative continuous real-valued function on a given compact metric space is the uniform limit of some increasing sequence of nonnegative simple functions being linear combinations of indicators of open sets; here the…
The celebrated universal approximation theorems for neural networks roughly state that any reasonable function can be arbitrarily well-approximated by a network whose parameters are appropriately chosen real numbers. This paper examines the…
A basic problem of interest in connection with the study of Schauder frames in Banach spaces is that of characterizing those Schauder frames which can essentially be regarded as Schauder bases. In this paper, we give a solution to this…
The double Schur functions form a distinguished basis of the ring \Lambda(x||a) which is a multiparameter generalization of the ring of symmetric functions \Lambda(x). The canonical comultiplication on \Lambda(x) is extended to…
Basis functions which are invariant under the operations of a rotational point group $G$ are able to describe any 3-D object which exhibits the rotational point group symmetry. However, in order to characterize the spatial statistics of an…
In this paper, we firstly give a matrix approach to the bases of a separable Hilbert space and then correct a mistake appearing in both review and the English translation of the Olevskii's paper. After this, we show that even a diagonal…
This paper considers the following question: how well can depth-two ReLU networks with randomly initialized bottom-level weights represent smooth functions? We give near-matching upper- and lower-bounds for $L_2$-approximation in terms of…
We introduce two new bases of QSym, the flipped extended Schur functions and the backward extended Schur functions, as well as their duals in NSym, the flipped shin functions and the backward shin functions. These bases are the images of…
We examine regularity and basis properties of the family of rescaled $p$-cosine functions. We find sharp estimates for their Fourier coefficients. We then determine two thresholds, $p_0<2$ and $p_1>2$, such that this family is a Schauder…