This paper aims to explore the separation of the two forward passes in the Forward-Forward algorithm from a biological perspective in the context of sleep. We show the size of the gap between the sleep and awake phase influences the learning capabilities of the algorithm and highlight the importance of negative data in diminishing the devastating effects of sleep deprivation.
Cite
@article{arxiv.2310.18647,
title = {Sleep Deprivation in the Forward-Forward Algorithm},
author = {Mircea-Tudor Lică and David Dinucu-Jianu},
journal= {arXiv preprint arXiv:2310.18647},
year = {2023}
}
Comments
5 pages, 2 figures, published in ICLR 2023 TinyPapers