Learning by a nerual net in a noisy environment - The pseudo-inverse solution revisited
Disordered Systems and Neural Networks
2009-11-07 v1 q-bio
Abstract
A recurrent neural net is described that learns a set of patterns in the presence of noise. The learning rule is of Hebbian type, and, if noise would be absent during the learning process, the resulting final values of the weights would correspond to the pseudo-inverse solution of the fixed point equation in question. For a non-vanishing noise parameter, an explicit expression for the expectation value of the weights is obtained. This result turns out to be unequal to the pseudo-inverse solution. Furthermore, the stability properties of the system are discussed.
Keywords
Cite
@article{arxiv.cond-mat/0205550,
title = {Learning by a nerual net in a noisy environment - The pseudo-inverse solution revisited},
author = {W A van Leeuwen and B Wemmenhove},
journal= {arXiv preprint arXiv:cond-mat/0205550},
year = {2009}
}
Comments
16 pages, 3 figures