Noisy regression and classification with continuous multilayer networks
无序系统与神经网络
2009-10-31 v1 统计力学
摘要
We investigate zero temperature Gibbs learning for two classes of unrealizable rules which play an important role in practical applications of multilayer neural networks with differentiable activation functions: classification problems and noisy regression problems. Considering one step of replica symmetry breaking, we surprisingly find that for sufficiently large training sets the stable state is replica symmetric even though the target rule is unrealizable. Further, the classification problem is shown to be formally equivalent to the noisy regression problem.
引用
@article{arxiv.cond-mat/9907340,
title = {Noisy regression and classification with continuous multilayer networks},
author = {Martin Ahr and Michael Biehl and Robert Urbanczik},
journal= {arXiv preprint arXiv:cond-mat/9907340},
year = {2009}
}
备注
7 pages, including 2 figures