English

Decoding Predictive Inference in Visual Language Processing via Spatiotemporal Neural Coherence

Neurons and Cognition 2025-12-25 v1 Computation and Language

Abstract

Human language processing relies on the brain's capacity for predictive inference. We present a machine learning framework for decoding neural (EEG) responses to dynamic visual language stimuli in Deaf signers. Using coherence between neural signals and optical flow-derived motion features, we construct spatiotemporal representations of predictive neural dynamics. Through entropy-based feature selection, we identify frequency-specific neural signatures that differentiate interpretable linguistic input from linguistically disrupted (time-reversed) stimuli. Our results reveal distributed left-hemispheric and frontal low-frequency coherence as key features in language comprehension, with experience-dependent neural signatures correlating with age. This work demonstrates a novel multimodal approach for probing experience-driven generative models of perception in the brain.

Keywords

Cite

@article{arxiv.2512.20929,
  title  = {Decoding Predictive Inference in Visual Language Processing via Spatiotemporal Neural Coherence},
  author = {Sean C. Borneman and Julia Krebs and Ronnie B. Wilbur and Evie A. Malaia},
  journal= {arXiv preprint arXiv:2512.20929},
  year   = {2025}
}

Comments

39th Conference on Neural Information Processing Systems (NeurIPS 2025) Workshop: Foundation Models for the Brain and Body

R2 v1 2026-07-01T08:39:32.345Z