A Fully Rigorous Proof of the Derivation of Xavier and He's Initialization for Deep ReLU Networks
Machine Learning
2021-01-29 v1
Abstract
A fully rigorous proof of the derivation of Xavier/He's initialization for ReLU nets is given.
Keywords
Cite
@article{arxiv.2101.12017,
title = {A Fully Rigorous Proof of the Derivation of Xavier and He's Initialization for Deep ReLU Networks},
author = {Quynh Nguyen},
journal= {arXiv preprint arXiv:2101.12017},
year = {2021}
}