English

Mixing, Ergodic, and Nonergodic Processes with Rapidly Growing Information between Blocks

Information Theory 2020-03-11 v2 Computation and Language math.IT

Abstract

We construct mixing processes over an infinite alphabet and ergodic processes over a finite alphabet for which Shannon mutual information between adjacent blocks of length nn grows as nβn^\beta, where β(0,1)\beta\in(0,1). The processes are a modification of nonergodic Santa Fe processes, which were introduced in the context of natural language modeling. The rates of mutual information for the latter processes are alike and also established in this paper. As an auxiliary result, it is shown that infinite direct products of mixing processes are also mixing.

Cite

@article{arxiv.1103.3952,
  title  = {Mixing, Ergodic, and Nonergodic Processes with Rapidly Growing Information between Blocks},
  author = {Łukasz Dębowski},
  journal= {arXiv preprint arXiv:1103.3952},
  year   = {2020}
}

Comments

21 pages

R2 v1 2026-06-21T17:42:12.201Z