English

Analysis of non-reversible Markov chains via similarity orbit

Probability 2020-08-21 v1

Abstract

In this paper, we develop an in-depth analysis of non-reversible Markov chains on denumerable state space from a similarity orbit perspective. In particular, we study the class of Markov chains whose transition kernel is in the similarity orbit of a normal transition kernel, such as the one of birth-death chains or reversible Markov chains. We start by identifying a set of sufficient conditions for a Markov chain to belong to the similarity orbit of a birth-death one. As by-products, we obtain a spectral representation in terms of non-self-adjoint resolutions of identity in the sense of Dunford [21] and offer a detailed analysis on the convergence rate, separation cutoff and L2{\rm{L}}^2-cutoff of this class of non-reversible Markov chains. We also look into the problem of estimating the integral functionals from discrete observations for this class. In the last part of this paper, we investigate a particular similarity orbit of reversible Markov kernels, that we call the pure birth orbit, and analyze various possibly non-reversible variants of classical birth-death processes in this orbit.

Keywords

Cite

@article{arxiv.1912.10715,
  title  = {Analysis of non-reversible Markov chains via similarity orbit},
  author = {Michael C. H. Choi and Pierre Patie},
  journal= {arXiv preprint arXiv:1912.10715},
  year   = {2020}
}

Comments

29 pages. To appear in Combin. Probab. Comput