The space of positive transition measures on a Markov chain

Information geometry of Markov chains has been studied using the dually flat structure of the space of transition probabilities. Although applications of this structure have been investigated, few attempts have examined its statistical meaning. In this paper, we construct a foundation for investigating the statistical meaning based on Amari's theory of positive measures. For the space of discrete distributions, Amari has introduced the space of positive measures by removing the constraint condition and investigated the extended space by finding the Bregman and $F$-divergence suitably. According to this, we introduce an extension of the space of transition probabilities equipped with suitable $F$-divergence for a given Markov chain. We regard it as the space of positive transition measures on a Markov chain, and study its dually flat structure. This provides new insight into the geometry of Markov chains and may lead to the development of the theory of Markov embeddings.