English
Related papers

Related papers: Approximation by Neural Network Sampling Operators…

200 papers

We study approximation and statistical learning properties of deep ReLU networks under structural assumptions that mitigate the curse of dimensionality. We prove minimax-optimal uniform approximation rates for $s$-H\"older smooth functions…

Statistics Theory · Mathematics 2026-02-06 Thomas Nagler , Sophie Langer

In this paper, we introduce a Stancu-type generalization of multivariate neural network operators by incorporating two parameters that perturb the sampling nodes. The proposed operators extend the existing neural network operator by…

Numerical Analysis · Mathematics 2026-03-18 Sachin Saini

The Mixed Lebesgue space is a suitable tool for modelling and measuring signals living in time-space domains. And sampling in such spaces plays an important role for processing high-dimensional time-varying signals. In this paper, we first…

Information Theory · Computer Science 2019-04-02 Yingchun Jiang , Wenchang Sun

While it is well-known that neural networks enjoy excellent approximation capabilities, it remains a big challenge to compute such approximations from point samples. Based on tools from Information-based complexity, recent work by Grohs and…

Machine Learning · Computer Science 2023-12-22 Ahmed Abdeljawad , Philipp Grohs

We propose a novel technique for faster deep neural network training which systematically applies sample-based approximation to the constituent tensor operations, i.e., matrix multiplications and convolutions. We introduce new sampling…

Machine Learning · Computer Science 2021-10-27 Menachem Adelman , Kfir Y. Levy , Ido Hakimi , Mark Silberstein

In this paper, we establish a comprehensive characterization of the generalized Lipschitz classes through the study of the rate of convergence of a family of semi-discrete sampling operators, of Durrmeyer type, in $L^p$-setting. To achieve…

Functional Analysis · Mathematics 2025-11-14 Danilo Costarelli , Michele Piconi , Gianluca Vinti

Operator learning is a recent development in the simulation of Partial Differential Equations (PDEs) by means of neural networks. The idea behind this approach is to learn the behavior of an operator, such that the resulting neural network…

Numerical Analysis · Mathematics 2025-01-15 Ahmed Abdeljawad , Thomas Dittrich

We generalize the classical universal approximation theorem for neural networks to the case of complex-valued neural networks. Precisely, we consider feedforward networks with a complex activation function $\sigma : \mathbb{C} \to…

Functional Analysis · Mathematics 2022-12-13 Felix Voigtlaender

In this paper, we study approximation properties of single hidden layer neural networks with weights varying on finitely many directions and thresholds from an open interval. We obtain a necessary and at the same time sufficient measure…

Machine Learning · Computer Science 2023-04-05 Vugar Ismailov , Ekrem Savas

We study the approximation by tensor networks (TNs) of functions from classical smoothness classes. The considered approximation tool combines a tensorization of functions in $L^p([0,1))$, which allows to identify a univariate function with…

Functional Analysis · Mathematics 2024-06-26 Mazen Ali , Anthony Nouy

We develop a quantitative approximation theory for shallow neural networks using tools from time-frequency analysis. Working in weighted modulation spaces $M^{p,q}_m(\mathbf{R}^{d})$, we prove dimension-independent approximation rates in…

Numerical Analysis · Mathematics 2026-04-14 Ahmed Abdeljawad , Elena Cordero

Let $\Omega\subset \mathbb{R}^d$ be a bounded domain. We consider the problem of how efficiently shallow neural networks with the ReLU$^k$ activation function can approximate functions from Sobolev spaces $W^s(L_p(\Omega))$ with error…

Machine Learning · Statistics 2025-10-17 Tong Mao , Jonathan W. Siegel , Jinchao Xu

Present work contains a method to obtain Jackson and Stechkin type inequalities of approximation by integral functions of finite degree (IFFD) in some variable exponent Lebesgue space of real functions defined on $\boldsymbol{R}:=\left(…

Functional Analysis · Mathematics 2022-08-30 Ramazan Akgün

We study the approximation and statistical complexity of learning collections of operators in a shared multi-task setting, with a focus on the Multiple Neural Operators (MNO) architecture. For broad classes of Lipschitz multiple operator…

Machine Learning · Computer Science 2026-05-22 Adrien Weihs , Hayden Schaeffer

This is paper for the smooth function approximation by neural networks (NN). Mathematical or physical functions can be replaced by NN models through regression. In this study, we get NNs that generate highly accurate and highly smooth…

Neural and Evolutionary Computing · Computer Science 2023-01-03 I. K. Hong

This paper establishes an approximation theorem for randomized neural networks (RaNNs) whose hidden-layer parameters are uniformly sampled from a prescribed bounded domain. Our analysis shows that, for RaNNs of the form $\mathop{\sum}_i W_i…

Numerical Analysis · Mathematics 2026-04-13 Ran Bi , Weibing Deng

Given sparse collections of measurable sets $\mathcal S_k$, $k=1,2,\ldots ,N$, in a general measure space $(X,\mathfrak M,\mu)$, let $ \Lambda_{\mathcal S_k}$ be the sparse operator, corresponding to $\mathcal S_k$. We show that the maximal…

Classical Analysis and ODEs · Mathematics 2021-01-26 Grigori A. Karagulyan , Michael T. Lacey

Approximation properties of the sampling-type quasi-projection operators $Q_j(f,\varphi, \widetilde{\varphi})$ for functions $f$ from anisotropic Besov spaces are studied. Error estimates in $L_p$-norm are obtained for a large class of…

Classical Analysis and ODEs · Mathematics 2020-01-27 Yurii Kolomoitsev , Maria Skopina

We consider structured optimisation problems defined in terms of the sum of a smooth and convex function, and a proper, l.s.c., convex (typically non-smooth) one in reflexive variable exponent Lebesgue spaces $L_{p(\cdot)}(\Omega)$. Due to…

Optimization and Control · Mathematics 2022-11-10 Marta Lazzaretti , Luca Calatroni , Claudio Estatico

We study the approximation rates of a class of deep neural network approximations of operators which arise as data-to-solution maps $\mathcal{S}$ of linear elliptic partial differential equations (PDEs), and act between pairs $X,Y$ of…

Numerical Analysis · Mathematics 2025-12-22 Carlo Marcati , Christoph Schwab