English
Related papers

Related papers: Schauder Bases for $C[0, 1]$ Using ReLU, Softplus …

200 papers

We consider the trigonometric-like system of piecewise linear functions introduced recently by Daubechies, DeVore, Foucart, Hanin, and Petrova. We provide an alternative proof that this system forms a Riesz basis of $L_2([0,1])$ based on…

Information Theory · Computer Science 2023-03-02 Cornelia Schneider , Jan Vybíral

In studying the expressiveness of neural networks, an important question is whether there are functions which can only be approximated by sufficiently deep networks, assuming their size is bounded. However, for constant depths, existing…

Machine Learning · Computer Science 2020-12-29 Gal Vardi , Ohad Shamir

Consider the eigenfunctions $u$ for a ree rectangular membrane wo that $-\Delta u=\lambda u$ on $\mathcal R(c,d)=(0,d)\times(0,d)$. In this note we show that if if $u>0$ on $\partial \mathcal R(c,d)) then $u\equiv C$ for some positive…

Spectral Theory · Mathematics 2013-02-01 Thomas Hoffmann-Ostenhof

Certain classes of multiparameter persistence modules may be encoded as signed barcodes, represented as points in a polyhedral subset of Euclidean space, we refer to as signed persistence diagrams. These signed persistence diagrams exist in…

Algebraic Topology · Mathematics 2025-10-14 Peter Bubenik , Zachariah Ross

We study Lipschitz-free spaces over compact and uniformly discrete metric spaces enjoying certain high regularity properties - having group structure with left-invariant metric. Using methods of harmonic analysis we show that, given a…

Functional Analysis · Mathematics 2022-03-14 Michal Doucha , Pedro Levit Kaufmann

In this article we study high-dimensional approximation capacities of shallow and deep artificial neural networks (ANNs) with the rectified linear unit (ReLU) activation. In particular, it is a key contribution of this work to reveal that…

Numerical Analysis · Mathematics 2023-01-23 Lukas Gonon , Robin Graeber , Arnulf Jentzen

Dirac modules over the quaternion skew field are investigated on a compact domain relative to the supremum norm and Hardy's norm with the parameter $1<p<\infty $ as well. An existence of Schauder bases in them is proved. Procedures for…

Functional Analysis · Mathematics 2018-12-18 Sergey V. Ludkovsky

We study approximation and statistical learning properties of deep ReLU networks under structural assumptions that mitigate the curse of dimensionality. We prove minimax-optimal uniform approximation rates for $s$-H\"older smooth functions…

Statistics Theory · Mathematics 2026-02-06 Thomas Nagler , Sophie Langer

An approach to construct explicit integral representations for two-layer ReLU networks is presented, which provides relatively simple representations for any multivariate polynomial. Quantitative bounds are provided for a particular,…

Machine Learning · Statistics 2026-05-13 Anthony Lee

Rearrangement-invariance in function spaces can be viewed as a kind of generalization of 1-symmetry for Schauder bases. We define subrearrangement-invariance in function spaces as an analogous generalization of 1-subsymmetry. It is then…

Functional Analysis · Mathematics 2021-01-06 Ben Wallis

We prove various theorems on approximation using polynomials with integer coefficients in the Bernstein basis of any given order. In the extreme, we draw the coefficients from $\{ \pm 1\}$ only. A basic case of our results states that for…

Information Theory · Computer Science 2022-12-08 C. Sinan Güntürk , Weilin Li

We prove that every nonnegative continuous real-valued function on a given compact metric space is the uniform limit of some increasing sequence of nonnegative simple functions being linear combinations of indicators of open sets; here the…

General Mathematics · Mathematics 2020-10-21 Yu-Lin Chou

The celebrated universal approximation theorems for neural networks roughly state that any reasonable function can be arbitrarily well-approximated by a network whose parameters are appropriately chosen real numbers. This paper examines the…

Machine Learning · Computer Science 2023-03-17 C. Sinan Güntürk , Weilin Li

A basic problem of interest in connection with the study of Schauder frames in Banach spaces is that of characterizing those Schauder frames which can essentially be regarded as Schauder bases. In this paper, we give a solution to this…

Functional Analysis · Mathematics 2010-02-23 Rui Liu , Bentuo Zheng

The double Schur functions form a distinguished basis of the ring \Lambda(x||a) which is a multiparameter generalization of the ring of symmetric functions \Lambda(x). The canonical comultiplication on \Lambda(x) is extended to…

Combinatorics · Mathematics 2010-10-26 A. I. Molev

Basis functions which are invariant under the operations of a rotational point group $G$ are able to describe any 3-D object which exhibits the rotational point group symmetry. However, in order to characterize the spatial statistics of an…

Group Theory · Mathematics 2021-03-09 Nan Xu , Peter C. Doerschuk

In this paper, we firstly give a matrix approach to the bases of a separable Hilbert space and then correct a mistake appearing in both review and the English translation of the Olevskii's paper. After this, we show that even a diagonal…

Functional Analysis · Mathematics 2012-03-19 Yang Cao , Geng Tian , Bingzhe Hou

This paper considers the following question: how well can depth-two ReLU networks with randomly initialized bottom-level weights represent smooth functions? We give near-matching upper- and lower-bounds for $L_2$-approximation in terms of…

Machine Learning · Computer Science 2021-09-09 Daniel Hsu , Clayton Sanford , Rocco A. Servedio , Emmanouil-Vasileios Vlatakis-Gkaragkounis

We introduce two new bases of QSym, the flipped extended Schur functions and the backward extended Schur functions, as well as their duals in NSym, the flipped shin functions and the backward shin functions. These bases are the images of…

Combinatorics · Mathematics 2024-09-09 Spencer Daugherty

We examine regularity and basis properties of the family of rescaled $p$-cosine functions. We find sharp estimates for their Fourier coefficients. We then determine two thresholds, $p_0<2$ and $p_1>2$, such that this family is a Schauder…

Classical Analysis and ODEs · Mathematics 2015-11-05 Lyonell Boulton , Houry Melkonian