English

Does a larger neural network mean greater information transmission efficiency?

Neurons and Cognition 2023-07-26 v4 Quantitative Methods

Abstract

Realistic modeling of brain involves large number of neurons. The important question is how this size affects transmission efficiency? Here, these issue is studied in terms of Shannon's Theory. Mutual Information between input and output signals for simple class of networks with an increasing number of neurons is analyzed theoretically and numerically. Levy-Baxter neural model is applied. It turned out, that for these networks the Mutual Information converges, with increasing size, asymptotically very slowly to saturation level. This suggests that from certain level, the increase of neurons number does not imply significant increase in transmission efficiency, contributes rather to reliability.

Keywords

Cite

@article{arxiv.2210.08377,
  title  = {Does a larger neural network mean greater information transmission efficiency?},
  author = {Bartosz Paprocki and Agnieszka Pregowska and Janusz Szczepanski},
  journal= {arXiv preprint arXiv:2210.08377},
  year   = {2023}
}

Comments

14 pages, 4 figures, research paper

R2 v1 2026-06-28T03:43:37.736Z