Reduction and classification of higher-order Markov chains
Abstract
We study the class structure of finite-alphabet Markov chains with arbitrary memory length. To capture the structural constraints induced by prohibited transitions, we introduce the skeleton of a higher-order transition kernel, defined as a reduced set of contexts encoding all essential zero-probability patterns. To each skeleton we associate a binary transition matrix. We show that the communicating class structure of this matrix completely determines the recurrent classes of the original higher-order Markov chain, along with their periods. As a consequence, simple criteria for essential irreducibility and periodicity follow directly from the skeleton, without constructing the full first-order representation on the enlarged state space. From a practical perspective, this approach can yield significant computational gains. An example illustrates how the skeleton may have substantially smaller order than the original chain.
Keywords
Cite
@article{arxiv.2601.06674,
title = {Reduction and classification of higher-order Markov chains},
author = {Christophe Gallesco and Caio Teodore Genovese Huss Oliveira and Daniel Yasumasa Takahashi},
journal= {arXiv preprint arXiv:2601.06674},
year = {2026}
}
Comments
9 pages, 5 figures