English

A Neuroscience-Inspired Dual-Process Model of Compositional Generalization

Artificial Intelligence 2025-10-29 v3 Neural and Evolutionary Computing

Abstract

Deep learning models struggle with systematic compositional generalization, a hallmark of human cognition. We propose \textsc{Mirage}, a neuro-inspired dual-process model that offers a processing account for this ability. It combines a fast, intuitive ``System~1'' (a meta-trained Transformer) with a deliberate, rule-based ``System~2'' (a Schema Engine), mirroring the brain's neocortical and hippocampal--prefrontal circuits. Trained to perform general, single-step decomposition on a stream of random grammars, Mirage achieves >>99\% accuracy on all splits of the SCAN benchmark in a task-agnostic setting. Ablations confirm that the model's systematic behavior emerges from the architectural interplay of its two systems, particularly its use of explicit, prioritized schemas and iterative refinement. In line with recent progress on recursive/recurrent Transformer approaches, Mirage preserves an iterative neural update while externalizing declarative control into an interpretable schema module. Our work provides a concrete computational model for interpreting how compositional reasoning can arise from a modular cognitive architecture.

Keywords

Cite

@article{arxiv.2507.18868,
  title  = {A Neuroscience-Inspired Dual-Process Model of Compositional Generalization},
  author = {Alex Noviello and Claas Beger and Jacob Groner and Kevin Ellis and Weinan Sun},
  journal= {arXiv preprint arXiv:2507.18868},
  year   = {2025}
}
R2 v1 2026-07-01T04:18:02.760Z