English

Recursive Dynamics in Fast-Weights Homeostatic Reentry Networks: Toward Reflective Intelligence

Machine Learning 2025-11-11 v1 Artificial Intelligence Neural and Evolutionary Computing

Abstract

This study introduces the Fast-Weights Homeostatic Reentry Layer (FH-RL), a neural mechanism that integrates fast-weight associative memory, homeostatic regularization, and learned reentrant feedback to approximate self-referential computation in neural networks. Unlike standard transformer architectures that operate in a purely feedforward manner during inference, FH-RL enables internal recurrence without external looping, allowing prior latent states to be dynamically re-entered into the ongoing computation stream. We conduct controlled experiments sweeping the reentry gain γ\gamma and evaluate emergent internal dynamics using three novel metrics: the Information Reentry Ratio (IRR), Eigen-Spectrum Recursion Index (ESRI), and Representational Drift Periodicity (RDP). Results show that reentry quantity increases proportionally with~γ\gamma, while the learned feedback matrix WrW_r remains bounded and becomes more structured at moderate gains. Critically, a stable reflective band emerges around γ0.100.20\gamma \approx 0.10-0.20, where internal feedback is maximally expressive yet spectrally stable: IRR rises smoothly, ESRI remains near zero, and RDP exhibits consistent low-frequency cycles. These findings provide quantitative evidence that reflective, thought-like internal processing can arise from a principled balance between feedback amplification and homeostatic regulation, linking modern fast-weight architectures to theories of cortical reentry and recursive cognition.

Keywords

Cite

@article{arxiv.2511.06798,
  title  = {Recursive Dynamics in Fast-Weights Homeostatic Reentry Networks: Toward Reflective Intelligence},
  author = {B. G. Chae},
  journal= {arXiv preprint arXiv:2511.06798},
  year   = {2025}
}

Comments

17 pages, 6 figures

R2 v1 2026-07-01T07:29:05.836Z