English

Universal Approximation Theorem for Neural Networks

Machine Learning 2021-02-23 v1 Artificial Intelligence

Abstract

Is there any theoretical guarantee for the approximation ability of neural networks? The answer to this question is the "Universal Approximation Theorem for Neural Networks". This theorem states that a neural network is dense in a certain function space under an appropriate setting. This paper is a comprehensive explanation of the universal approximation theorem for feedforward neural networks, its approximation rate problem (the relation between the number of intermediate units and the approximation error), and Barron space in Japanese.

Keywords

Cite

@article{arxiv.2102.10993,
  title  = {Universal Approximation Theorem for Neural Networks},
  author = {Takato Nishijima},
  journal= {arXiv preprint arXiv:2102.10993},
  year   = {2021}
}

Comments

118 pages, in Japanese

R2 v1 2026-06-23T23:23:56.944Z