English

A simple proof of Kaijser's unique ergodicity result for hidden Markov $\alpha$-chains

Probability 2007-05-23 v1

Abstract

According to a 1975 result of T. Kaijser, if some nonvanishing product of hidden Markov model (HMM) stepping matrices is subrectangular, and the underlying chain is aperiodic, the corresponding α\alpha-chain has a unique invariant limiting measure λ\lambda. Here the α\alpha-chain {αn}={(αni)}\{\alpha_n\}=\{(\alpha_{ni})\} is given by αni=P(Xn=iYn,Yn1,...),\alpha_{ni}=P(X_n=i| Y_n,Y_{n-1},...), where {(Xn,Yn)}\{(X_n,Y_n)\} is a finite state HMM with unobserved Markov chain component {Xn}\{X_n\} and observed output component {Yn}\{Y_n\}. This defines {αn}\{\alpha_n\} as a stochastic process taking values in the probability simplex. It is not hard to see that {αn}\{\alpha_n\} is itself a Markov chain. The stepping matrices M(y)=(M(y)ij)M(y)=(M(y)_{ij}) give the probability that (Xn,Yn)=(j,y)(X_n,Y_n)=(j,y), conditional on Xn1=iX_{n-1}=i. A matrix is said to be subrectangular if the locations of its nonzero entries forms a cartesian product of a set of row indices and a set of column indices. Kaijser's result is based on an application of the Furstenberg--Kesten theory to the random matrix products M(Y1)M(Y2)...M(Yn)M(Y_1)M(Y_2)... M(Y_n). In this paper we prove a slightly stronger form of Kaijser's theorem with a simpler argument, exploiting the theory of e chains.

Keywords

Cite

@article{arxiv.math/0702248,
  title  = {A simple proof of Kaijser's unique ergodicity result for hidden Markov $\alpha$-chains},
  author = {Fred Kochman and Jim Reeds},
  journal= {arXiv preprint arXiv:math/0702248},
  year   = {2007}
}

Comments

Published at http://dx.doi.org/10.1214/105051606000000367 in the Annals of Applied Probability (http://www.imstat.org/aap/) by the Institute of Mathematical Statistics (http://www.imstat.org)