English

A Hoeffding inequality for Markov chains

Probability 2019-04-02 v2

Abstract

We prove deviation bounds for the random variable i=1nfi(Yi)\sum_{i=1}^{n} f_i(Y_i) in which {Yi}i=1\{Y_i\}_{i=1}^{\infty} is a Markov chain with stationary distribution and state space [N][N], and fi:[N][ai,ai]f_i: [N] \rightarrow [-a_i, a_i]. Our bound improves upon previously known bounds in that the dependence is on a12++an2\sqrt{a_1^2+\cdots+a_n^2} rather than maxi{ai}n.\max_{i}\{a_i\}\sqrt{n}. We also prove deviation bounds for certain types of sums of vector--valued random variables obtained from a Markov chain in a similar manner. One application includes bounding the expected value of the Schatten \infty-norm of a random matrix whose entries are obtained from a Markov chain.

Keywords

Cite

@article{arxiv.1806.11519,
  title  = {A Hoeffding inequality for Markov chains},
  author = {Shravas Rao},
  journal= {arXiv preprint arXiv:1806.11519},
  year   = {2019}
}

Comments

11 pages

R2 v1 2026-06-23T02:46:19.087Z