English

Vector Quantization in the Brain: Grid-like Codes in World Models

Machine Learning 2025-10-21 v1 Artificial Intelligence

Abstract

We propose Grid-like Code Quantization (GCQ), a brain-inspired method for compressing observation-action sequences into discrete representations using grid-like patterns in attractor dynamics. Unlike conventional vector quantization approaches that operate on static inputs, GCQ performs spatiotemporal compression through an action-conditioned codebook, where codewords are derived from continuous attractor neural networks and dynamically selected based on actions. This enables GCQ to jointly compress space and time, serving as a unified world model. The resulting representation supports long-horizon prediction, goal-directed planning, and inverse modeling. Experiments across diverse tasks demonstrate GCQ's effectiveness in compact encoding and downstream performance. Our work offers both a computational tool for efficient sequence modeling and a theoretical perspective on the formation of grid-like codes in neural systems.

Keywords

Cite

@article{arxiv.2510.16039,
  title  = {Vector Quantization in the Brain: Grid-like Codes in World Models},
  author = {Xiangyuan Peng and Xingsi Dong and Si Wu},
  journal= {arXiv preprint arXiv:2510.16039},
  year   = {2025}
}
R2 v1 2026-07-01T06:44:02.039Z