A Stochastic Gradient Descent Theorem and the Back-Propagation Algorithm
Optimization and Control
2021-04-02 v1
Abstract
We establish a convergence theorem for a certain type of stochastic gradient descent, which leads to a convergent variant of the back-propagation algorithm
Cite
@article{arxiv.2104.00539,
title = {A Stochastic Gradient Descent Theorem and the Back-Propagation Algorithm},
author = {Hao Wu},
journal= {arXiv preprint arXiv:2104.00539},
year = {2021}
}
Comments
15 pages, 1 figure