English
Related papers

Related papers: Universal Approximation Theorem and error bounds f…

200 papers

The universality of a quantum neural network refers to its ability to approximate arbitrary functions and is a theoretical guarantee for its effectiveness. A non-universal neural network could fail in completing the machine learning task.…

Quantum Physics · Physics 2023-06-27 Xiaokai Hou , Guanyu Zhou , Qingyu Li , Shan Jin , Xiaoting Wang

Universal approximation theorems provide a mathematical explanation for the expressive power of neural networks. They assert that, under mild conditions on the activation function, feedforward neural networks are dense in broad function…

Machine Learning · Computer Science 2026-05-21 Soumendu Sundar Mukherjee , Himasish Talukdar

The celebrated universal approximation theorems for neural networks roughly state that any reasonable function can be arbitrarily well-approximated by a network whose parameters are appropriately chosen real numbers. This paper examines the…

Machine Learning · Computer Science 2023-03-17 C. Sinan Güntürk , Weilin Li

The universal approximation theorem states that a neural network with one hidden layer can approximate continuous functions on compact sets with any desired precision. This theorem supports using neural networks for various applications,…

Machine Learning · Computer Science 2024-08-13 Marcos Eduardo Valle , Wington L. Vital , Guilherme Vieira

Is there any theoretical guarantee for the approximation ability of neural networks? The answer to this question is the "Universal Approximation Theorem for Neural Networks". This theorem states that a neural network is dense in a certain…

Machine Learning · Computer Science 2021-02-23 Takato Nishijima

The universal approximation theorem asserts that a single hidden layer neural network approximates continuous functions with any desired precision on compact sets. As an existential result, the universal approximation theorem supports the…

Machine Learning · Computer Science 2023-09-15 Wington L. Vital , Guilherme Vieira , Marcos Eduardo Valle

The universal approximation theorem is generalised to uniform convergence on the (noncompact) input space $\mathbb{R}^n$. All continuous functions that vanish at infinity can be uniformly approximated by neural networks with one hidden…

Machine Learning · Computer Science 2024-03-05 Teun D. H. van Nuland

We provide here a universal approximation theorem with precise quantitative error bounds for noisy quantum neural networks. We focus on applications to Quantitative Finance, where target functions are often given as expectations. We further…

Quantum Physics · Physics 2026-05-20 Lukas Gonon , Antoine Jacquier , Marcel Mordarski

This paper discusses various theorems on the approximation capabilities of neural networks (NNs), which are known as universal approximation theorems (UATs). The paper gives a systematic overview of UATs starting from the preliminary…

Machine Learning · Computer Science 2024-07-19 Midhun T Augustine

Neural networks (NNs) are known for their high predictive accuracy in complex learning problems. Beside practical advantages, NNs also indicate favourable theoretical properties such as universal approximation (UA) theorems. Binarized…

Machine Learning · Computer Science 2021-02-05 Mikail Yayla , Mario Günzel , Burim Ramosaj , Jian-Jia Chen

Universality of neural networks describes the ability to approximate arbitrary function, and is a key ingredient to keep the method effective. The established models for universal quantum neural networks(QNN), however, require the…

Quantum Physics · Physics 2021-10-22 Xiaokai Hou , Guanyu Zhou , Qingyu Li , Shan Jin , Xiaoting Wang

The classical universal approximation (UA) theorem for neural networks establishes mild conditions under which a feedforward neural network can approximate a continuous function $f$ with arbitrary accuracy. A recent result shows that neural…

Machine Learning · Computer Science 2026-01-28 Geonho Hwang , Wonyeol Lee , Yeachan Park , Sejun Park , Feras Saad

The universal approximation theorem, in one of its most general versions, says that if we consider only continuous activation functions $\sigma$, then a standard feedforward neural network with one hidden layer is able to approximate any…

Machine Learning · Computer Science 2020-02-18 Kai Fong Ernest Chong

We generalize the classical universal approximation theorem for neural networks to the case of complex-valued neural networks. Precisely, we consider feedforward networks with a complex activation function $\sigma : \mathbb{C} \to…

Functional Analysis · Mathematics 2022-12-13 Felix Voigtlaender

Quantum neural networks (QNNs) are an analog of classical neural networks in the world of quantum computing, which are represented by a unitary matrix with trainable parameters. Inspired by the universal approximation property of classical…

Quantum Physics · Physics 2025-11-27 Ariel Neufeld , Philipp Schmocker , Viet Khoa Tran

Many practical problems need the output of a machine learning model to satisfy a set of constraints, $K$. Nevertheless, there is no known guarantee that classical neural network architectures can exactly encode constraints while…

Machine Learning · Computer Science 2022-02-10 Anastasis Kratsios , Behnoosh Zamanlooy , Tianlin Liu , Ivan Dokmanić

In this paper, we explain the universal approximation capabilities of deep residual neural networks through geometric nonlinear control. Inspired by recent work establishing links between residual networks and control systems, we provide a…

Machine Learning · Computer Science 2024-02-12 Paulo Tabuada , Bahman Gharesifard

We prove two universal approximation theorems for a range of dropout neural networks. These are feed-forward neural networks in which each edge is given a random $\{0,1\}$-valued filter, that have two modes of operation: in the first each…

Machine Learning · Computer Science 2020-12-21 Oxana A. Manita , Mark A. Peletier , Jacobus W. Portegies , Jaron Sanders , Albert Senen-Cerda

Quantum reservoir computing uses the dynamics of quantum systems to process temporal data, making it particularly well-suited for machine learning with noisy intermediate-scale quantum devices. Recent developments have introduced…

Quantum Physics · Physics 2026-02-25 Lukas Gonon , Rodrigo Martínez-Peña , Juan-Pablo Ortega

Universal approximation theorem suggests that a shallow neural network can approximate any function. The input to neurons at each layer is a weighted sum of previous layer neurons and then an activation is applied. These activation…

Machine Learning · Computer Science 2020-10-30 Bhaavan Goel
‹ Prev 1 2 3 10 Next ›