English

Scale-Dependent Semantic Dynamics Revealed by Allan Deviation

Computation and Language 2026-01-30 v1 Data Analysis, Statistics and Probability

Abstract

While language progresses through a sequence of semantic states, the underlying dynamics of this progression remain elusive. Here, we treat the semantic progression of written text as a stochastic trajectory in a high-dimensional state space. We utilize Allan deviation, a tool from precision metrology, to analyze the stability of meaning by treating ordered sentence embeddings as a displacement signal. Our analysis reveals two distinct dynamical regimes: short-time power-law scaling, which differentiates creative literature from technical texts, and a long-time crossover to a stability-limited noise floor. We find that while large language models successfully mimic the local scaling statistics of human text, they exhibit a systematic reduction in their stability horizon. These results establish semantic coherence as a measurable physical property, offering a framework to differentiate the nuanced dynamics of human cognition from the patterns generated by algorithmic models.

Keywords

Cite

@article{arxiv.2601.21678,
  title  = {Scale-Dependent Semantic Dynamics Revealed by Allan Deviation},
  author = {Debayan Dasgupta},
  journal= {arXiv preprint arXiv:2601.21678},
  year   = {2026}
}
R2 v1 2026-07-01T09:25:39.770Z