English

Geometric Learning of Hidden Markov Models via a Method of Moments Algorithm

Machine Learning 2023-02-16 v1 Differential Geometry Statistics Theory Computation Statistics Theory

Abstract

We present a novel algorithm for learning the parameters of hidden Markov models (HMMs) in a geometric setting where the observations take values in Riemannian manifolds. In particular, we elevate a recent second-order method of moments algorithm that incorporates non-consecutive correlations to a more general setting where observations take place in a Riemannian symmetric space of non-positive curvature and the observation likelihoods are Riemannian Gaussians. The resulting algorithm decouples into a Riemannian Gaussian mixture model estimation algorithm followed by a sequence of convex optimization procedures. We demonstrate through examples that the learner can result in significantly improved speed and numerical accuracy compared to existing learners.

Keywords

Cite

@article{arxiv.2207.00818,
  title  = {Geometric Learning of Hidden Markov Models via a Method of Moments Algorithm},
  author = {Berlin Chen and Cyrus Mostajeran and Salem Said},
  journal= {arXiv preprint arXiv:2207.00818},
  year   = {2023}
}