English
Related papers

Related papers: Univariate error function based neural network app…

200 papers

Convolutional neural networks (CNNs) have been shown to achieve optimal approximation and estimation error rates (in minimax sense) in several function classes. However, previous analyzed optimal CNNs are unrealistically wide and difficult…

Machine Learning · Statistics 2023-08-15 Kenta Oono , Taiji Suzuki

In this work, we examine the approximation capabilities of deep neural networks utilizing the Rectified Quadratic Unit (ReQU) activation function, defined as \(\max(0,x)^2\), for approximating H\"older-regular functions with respect to the…

Machine Learning · Computer Science 2024-11-12 Ahmed Abdeljawad

This paper studies the approximation capacity of neural networks with an arbitrary activation function and with norm constraint on the weights. Upper and lower bounds on the approximation error of these networks are computed for smooth…

Numerical Analysis · Mathematics 2025-12-24 Francesco Paolo Maiale , Anastasiia Trofimova , Arturo De Marinis

The universal approximation theorem is generalised to uniform convergence on the (noncompact) input space $\mathbb{R}^n$. All continuous functions that vanish at infinity can be uniformly approximated by neural networks with one hidden…

Machine Learning · Computer Science 2024-03-05 Teun D. H. van Nuland

Operator convex functions defined on the positive half-line play a prominent role in the theory of quantum information, where they are used to define quantum $f$-divergences. Such functions admit integral representations in terms of…

Optimization and Control · Mathematics 2023-05-23 Oisín Faust , Hamza Fawzi

We generalize the classical universal approximation theorem for neural networks to the case of complex-valued neural networks. Precisely, we consider feedforward networks with a complex activation function $\sigma : \mathbb{C} \to…

Functional Analysis · Mathematics 2022-12-13 Felix Voigtlaender

As demonstrated in many areas of real-life applications, neural networks have the capability of dealing with high dimensional data. In the fields of optimal control and dynamical systems, the same capability was studied and verified in many…

Machine Learning · Computer Science 2020-12-04 Wei Kang , Qi Gong

We study the approximation of measurable functions on the hypercube by functions arising from affine neural networks. Our main achievement is an approximation of any measurable function $f \colon W_n \to [-1,1]$ up to a prescribed precision…

Machine Learning · Computer Science 2019-01-30 Andreas Thom

We derive an approximation error bound that holds simultaneously for a function and all its derivatives up to any prescribed order. The bounds apply to elementary functions, including multivariate polynomials, the exponential function, and…

Machine Learning · Computer Science 2025-12-29 Konstantin Yakovlev , Nikita Puchkin

Rational best approximations (in a Chebyshev sense) to real functions are characterized by an equioscillating approximation error. Similar results do not hold true for rational best approximations to complex functions in general. In the…

Numerical Analysis · Mathematics 2023-12-22 Tobias Jawecki , Pranav Singh

The purpose of this paper is to study the approximation of vector valued mappings defined on a subset of a normed space. We investigate Korovkin-type conditions under which a given sequence of linear operators becomes a so-called…

Functional Analysis · Mathematics 2007-05-23 Lorenzo D'Ambrosio

This paper explores the asymptotic behavior of univariate neural network operators, with an emphasis on both classical and fractional differentiation over infinite domains. The analysis leverages symmetrized and perturbed hyperbolic tangent…

General Mathematics · Mathematics 2025-02-12 Rômulo Damasclin Chaves dos Santos

Classical neural network approximation results take the form: for every function $f$ and every error tolerance $\epsilon > 0$, one constructs a neural network whose architecture and weights depend on $\epsilon$. This paper introduces a…

Neural and Evolutionary Computing · Computer Science 2025-11-20 Clemens Hutter , Valentin Abadie , Helmut Bölcskei

This paper is in continuation of our work in \cite{PNM}, wherein we introduced generalized Baskakov Kantorovich operators $K_n^a(f;x)$ and established some approximation properties e.g. local approximation, weighted approximation,…

Classical Analysis and ODEs · Mathematics 2015-05-25 Meenu Goyal , P. N. Agrawal

We study the approximation of functions which are invariant with respect to certain permutations of the input indices using flow maps of dynamical systems. Such invariant functions includes the much studied translation-invariant ones…

Machine Learning · Computer Science 2022-08-19 Qianxiao Li , Ting Lin , Zuowei Shen

We consider in this paper the optimal approximations of convex univariate functions with feed-forward Relu neural networks. We are interested in the following question: what is the minimal approximation error given the number of…

Machine Learning · Computer Science 2019-09-11 Bo Liu , Yi Liang

This paper quantitatively characterizes the approximation power of deep feed-forward neural networks (FNNs) in terms of the number of neurons. It is shown by construction that ReLU FNNs with width $\mathcal{O}\big(\max\{d\lfloor…

Numerical Analysis · Mathematics 2021-01-15 Zuowei Shen , Haizhao Yang , Shijun Zhang

Recently there has been much interest in understanding why deep neural networks are preferred to shallow networks. We show that, for a large class of piecewise smooth functions, the number of neurons needed by a shallow network to…

Machine Learning · Computer Science 2017-03-07 Shiyu Liang , R. Srikant

We derive quantitative error bounds for deep neural networks (DNNs) approximating option prices on a $d$-dimensional risky asset as functions of the underlying model parameters, payoff parameters and initial conditions. We cover a general…

Mathematical Finance · Quantitative Finance 2023-09-27 Francesca Biagini , Lukas Gonon , Niklas Walter

We propose a novel class of neural network-like parametrized functions, i.e., general transformation neural networks (GTNNs), for high-dimensional approximation. Conventional deep neural networks sometimes perform less accurately on…

Numerical Analysis · Mathematics 2026-02-25 Xiaoyang Wang , Yiqi Gu