English

Neuromorphic Overparameterisation and Few-Shot Learning in Multilayer Physical Neural Networks

Mesoscale and Nanoscale Physics 2024-09-24 v5

Abstract

Physical neuromorphic computing, exploiting the complex dynamics of physical systems, has seen rapid advancements in sophistication and performance. Physical reservoir computing, a subset of neuromorphic computing, faces limitations due to its reliance on single systems. This constrains output dimensionality and dynamic range, limiting performance to a narrow range of tasks. Here, we engineer a suite of nanomagnetic array physical reservoirs and interconnect them in parallel and series to create a multilayer neural network architecture. The output of one reservoir is recorded, scaled and virtually fed as input to the next reservoir. This networked approach increases output dimensionality, internal dynamics and computational performance. We demonstrate that a physical neuromorphic system can achieve an overparameterised state, facilitating meta-learning on small training sets and yielding strong performance across a wide range of tasks. Our approach's efficacy is further demonstrated through few-shot learning, where the system rapidly adapts to new tasks.

Keywords

Cite

@article{arxiv.2211.06373,
  title  = {Neuromorphic Overparameterisation and Few-Shot Learning in Multilayer Physical Neural Networks},
  author = {Kilian D. Stenning and Jack C. Gartside and Luca Manneschi and Christopher T. S. Cheung and Tony Chen and Alex Vanstone and Jake Love and Holly H. Holder and Francesco Caravelli and Hidekazu Kurebayashi and Karin Everschor-Sitte and Eleni Vasilaki and Will R. Branford},
  journal= {arXiv preprint arXiv:2211.06373},
  year   = {2024}
}
R2 v1 2026-06-28T05:41:51.061Z