Tailored ensembles of neural networks optimize sensitivity to stimulus statistics
Disordered Systems and Neural Networks
2020-02-12 v1 Neurons and Cognition
Abstract
The dynamic range of stimulus processing in living organisms is much larger than a single neural network can explain. For a generic, tunable spiking network we derive that while the dynamic range is maximal at criticality, the interval of discriminable intensities is very similar for any network tuning due to coalescence. Compensating coalescence enables adaptation of discriminable intervals. Thus, we can tailor an ensemble of networks optimized to the distribution of stimulus intensities, e.g., extending the dynamic range arbitrarily. We discuss potential applications in machine learning.
Keywords
Cite
@article{arxiv.1905.10401,
title = {Tailored ensembles of neural networks optimize sensitivity to stimulus statistics},
author = {Johannes Zierenberg and Jens Wilting and Viola Priesemann and Anna Levina},
journal= {arXiv preprint arXiv:1905.10401},
year = {2020}
}
Comments
6 pages plus supplemental material