English

Can Peanuts Fall in Love with Distributional Semantics?

Computation and Language 2023-05-23 v2

Abstract

Context changes expectations about upcoming words - following a story involving an anthropomorphic peanut, comprehenders expect the sentence the peanut was in love more than the peanut was salted, as indexed by N400 amplitude (Nieuwland & van Berkum, 2006). This updating of expectations has been explained using Situation Models - mental representations of a described event. However, recent work showing that N400 amplitude is predictable from distributional information alone raises the question whether situation models are necessary for these contextual effects. We model the results of Nieuwland and van Berkum (2006) using six computational language models and three sets of word vectors, none of which have explicit situation models or semantic grounding. We find that a subset of these can fully model the effect found by Nieuwland and van Berkum (2006). Thus, at least some processing effects normally explained through situation models may not in fact require explicit situation models.

Keywords

Cite

@article{arxiv.2301.08731,
  title  = {Can Peanuts Fall in Love with Distributional Semantics?},
  author = {James A. Michaelov and Seana Coulson and Benjamin K. Bergen},
  journal= {arXiv preprint arXiv:2301.08731},
  year   = {2023}
}

Comments

Accepted at CogSci 2023

R2 v1 2026-06-28T08:16:32.968Z