English

Chaos-guided Input Structuring for Improved Learning in Recurrent Neural Networks

Neurons and Cognition 2018-02-20 v3 Neural and Evolutionary Computing Biological Physics

Abstract

Anatomical studies demonstrate that brain reformats input information to generate reliable responses for performing computations. However, it remains unclear how neural circuits encode complex spatio-temporal patterns. We show that neural dynamics are strongly influenced by the phase alignment between the input and the spontaneous chaotic activity. Input structuring along the dominant chaotic projections causes the chaotic trajectories to become stable channels (or attractors), hence, improving the computational capability of a recurrent network. Using mean field analysis, we derive the impact of input structuring on the overall stability of attractors formed. Our results indicate that input alignment determines the extent of intrinsic noise suppression and hence, alters the attractor state stability, thereby controlling the network's inference ability.

Keywords

Cite

@article{arxiv.1712.09206,
  title  = {Chaos-guided Input Structuring for Improved Learning in Recurrent Neural Networks},
  author = {Priyadarshini Panda and Kaushik Roy},
  journal= {arXiv preprint arXiv:1712.09206},
  year   = {2018}
}

Comments

11 pages with 5 figures including supplementary material

R2 v1 2026-06-22T23:29:09.171Z