Human language processing relies on the brain's capacity for predictive inference. We present a machine learning framework for decoding neural (EEG) responses to dynamic visual language stimuli in Deaf signers. Using coherence between neural signals and optical flow-derived motion features, we construct spatiotemporal representations of predictive neural dynamics. Through entropy-based feature selection, we identify frequency-specific neural signatures that differentiate interpretable linguistic input from linguistically disrupted (time-reversed) stimuli. Our results reveal distributed left-hemispheric and frontal low-frequency coherence as key features in language comprehension, with experience-dependent neural signatures correlating with age. This work demonstrates a novel multimodal approach for probing experience-driven generative models of perception in the brain.
@article{arxiv.2512.20929,
title = {Decoding Predictive Inference in Visual Language Processing via Spatiotemporal Neural Coherence},
author = {Sean C. Borneman and Julia Krebs and Ronnie B. Wilbur and Evie A. Malaia},
journal= {arXiv preprint arXiv:2512.20929},
year = {2025}
}
Comments
39th Conference on Neural Information Processing Systems (NeurIPS 2025) Workshop: Foundation Models for the Brain and Body