English
Related papers

Related papers: Simultaneous approximation by neural network opera…

200 papers

Neural operators have emerged as transformative tools for learning mappings between infinite-dimensional function spaces, offering useful applications in solving complex partial differential equations (PDEs). This paper presents a rigorous…

Numerical Analysis · Mathematics 2026-01-23 Vu-Anh Le , Mehmet Dik

Rational and neural network based approximations are efficient tools in modern approximation. These approaches are able to produce accurate approximations to nonsmooth and non-Lipschitz functions, including multivariate domain functions. In…

Optimization and Control · Mathematics 2023-09-08 Vinesha Peiris , Reinier Diaz Millan , Nadezda Sukhorukova , Julien Ugon

Operator convex functions defined on the positive half-line play a prominent role in the theory of quantum information, where they are used to define quantum $f$-divergences. Such functions admit integral representations in terms of…

Optimization and Control · Mathematics 2023-05-23 Oisín Faust , Hamza Fawzi

Multiplication layers are a key component in various influential neural network modules, including self-attention and hypernetwork layers. In this paper, we investigate the approximation capabilities of deep neural networks with…

Machine Learning · Computer Science 2023-01-12 Ido Ben-Shaul , Tomer Galanti , Shai Dekel

We consider positive, integral-preserving linear operators acting on $L^1$ space, known as stochastic operators or Markov operators. We show that, on finite-dimensional spaces, any stochastic operator can be approximated by a sequence of…

Functional Analysis · Mathematics 2019-06-13 Shirin Moein , Rajesh Pereira , Sarah Plosker

In this paper we are concerned with the approximation of functions by single hidden layer neural networks with ReLU activation functions on the unit circle. In particular, we are interested in the case when the number of data-points exceeds…

Analysis of PDEs · Mathematics 2021-04-02 Benny Avelin , Vesa Julin

We investigate properties of neural networks that use both ReLU and $x^2$ as activation functions and build upon previous results to show that both analytic functions and functions in Sobolev spaces can be approximated by such networks of…

Machine Learning · Computer Science 2023-01-31 Vincent P. H. Goverse , Jad Hamdan , Jared Tanner

This work explores the neural network approximation capabilities for functions within the spectral Barron space $\mathscr{B}^s$, where $s$ is the smoothness index. We demonstrate that for functions in $\mathscr{B}^{1/2}$, a shallow neural…

Numerical Analysis · Mathematics 2025-07-10 Yulei Liao , Pingbing Ming , Hao Yu

We investigate the concept of Best Approximation for Feedforward Neural Networks (FNN) and explore their convergence properties through the lens of Random Projection (RPNNs). RPNNs have predetermined and fixed, once and for all, internal…

Machine Learning · Computer Science 2024-02-20 Gianluca Fabiani

We show that suitably regular functions can be approximated in the $\mathcal{C}^1$-norm both with rational functions and rational neural networks, including approximation rates with respect to width and depth of the network, and degree of…

Machine Learning · Computer Science 2025-08-28 Erion Morina , Martin Holler

The classical development of neural networks has primarily focused on learning mappings between finite dimensional Euclidean spaces or finite sets. We propose a generalization of neural networks to learn operators, termed neural operators,…

This paper deals with the approximations of Durrmeyer type generalization of Szasz-Mirakjan operators. We establish the direct results, quantitative Voronovskaya type theorem, Gruss type theorem, A-statistical convergence, rate of…

Functional Analysis · Mathematics 2019-12-02 Rishikesh Yadav , Ramakanta Meher , Vishnu Narayan Mishra

We prove two universal approximation theorems for a range of dropout neural networks. These are feed-forward neural networks in which each edge is given a random $\{0,1\}$-valued filter, that have two modes of operation: in the first each…

Machine Learning · Computer Science 2020-12-21 Oxana A. Manita , Mark A. Peletier , Jacobus W. Portegies , Jaron Sanders , Albert Senen-Cerda

This paper addresses the problem of nearly optimal Vapnik--Chervonenkis dimension (VC-dimension) and pseudo-dimension estimations of the derivative functions of deep neural networks (DNNs). Two important applications of these estimations…

Machine Learning · Computer Science 2023-05-16 Yahong Yang , Haizhao Yang , Yang Xiang

The present article deals with the local approximation results by means of Lipschitz maximal function, Ditzian-Totik modulus of smoothness and Lipschitz type space having two parameters for the summation-integral type operators defined by…

Functional Analysis · Mathematics 2019-12-11 Rishikesh Yadav , Ramakanta Meher , Vishnu Narayan Mishra

In this paper I consider the applications of several kinds of approximations of real functions to the problem of verified computation (reliable computing) of the range of implicitly defined real function $x_{n+1} = G(x_{1}, ..., x_{n}),$…

Numerical Analysis · Mathematics 2025-10-20 Nikolaj M. Glazunov

Observable operator models (OOMs) offer a powerful framework for modelling stochastic processes, surpassing the traditional hidden Markov models (HMMs) in generality and efficiency. However, using OOMs to model infinite-dimensional…

Probability · Mathematics 2024-04-19 Wojciech Anyszka

We investigate the classes of functions whose minimization diagrams can be approximated efficiently in \Re^d. We present a general framework and a data-structure that can be used to approximate the minimization diagram of such functions.…

Computational Geometry · Computer Science 2013-04-03 Sariel Har-Peled , Nirman Kumar

Deep learning (DL) is transforming industry as decision-making processes are being automated by deep neural networks (DNNs) trained on real-world data. Driven partly by rapidly-expanding literature on DNN approximation theory showing they…

Machine Learning · Computer Science 2021-02-17 Ben Adcock , Nick Dexter

This paper extends the proof of density of neural networks in the space of continuous (or even measurable) functions on Euclidean spaces to functions on compact sets of probability measures. By doing so the work parallels a more then a…

Machine Learning · Computer Science 2019-06-04 Tomas Pevny , Vojtech Kovarik