English

Reduction and classification of higher-order Markov chains

Statistics Theory 2026-04-23 v2 Probability Statistics Theory

Abstract

We study the class structure of finite-alphabet Markov chains with arbitrary memory length. To capture the structural constraints induced by prohibited transitions, we introduce the skeleton of a higher-order transition kernel, defined as a reduced set of contexts encoding all essential zero-probability patterns. To each skeleton we associate a binary transition matrix. We show that the communicating class structure of this matrix completely determines the recurrent classes of the original higher-order Markov chain, along with their periods. As a consequence, simple criteria for essential irreducibility and periodicity follow directly from the skeleton, without constructing the full first-order representation on the enlarged state space. From a practical perspective, this approach can yield significant computational gains. An example illustrates how the skeleton may have substantially smaller order than the original chain.

Keywords

Cite

@article{arxiv.2601.06674,
  title  = {Reduction and classification of higher-order Markov chains},
  author = {Christophe Gallesco and Caio Teodore Genovese Huss Oliveira and Daniel Yasumasa Takahashi},
  journal= {arXiv preprint arXiv:2601.06674},
  year   = {2026}
}

Comments

9 pages, 5 figures

R2 v1 2026-07-01T08:59:09.968Z