Perturbed Markov Chains and Information Networks
Abstract
The paper is devoted to studies of perturbed Markov chains commonly used for description of information networks. In such models, the matrix of transition probabilities for the corresponding Markov chain is usually regularised by adding a special damping matrix multiplied by a small damping (perturbation) parameter . We give effective upper bounds for the rate of approximation for stationary distributions of unperturbed Markov chains by stationary distributions of perturbed Markov chains with regularised matrices of transition probabilities, asymptotic expansions for approximating stationary distributions with respect to damping parameter, as well as explicit upper bounds for the rate of convergence in ergodic theorems for -step transition probabilities in triangular array mode, where perturbation parameter and , simultaneously. The results of numerical experiments are also presented
Cite
@article{arxiv.1901.11483,
title = {Perturbed Markov Chains and Information Networks},
author = {Benard Abola and Pitos Seleka Biganda and Sergei Silvestrov and Dmitrii Silvestrov and Christopher Engström and John Magero Mango and Godwin Kakuba},
journal= {arXiv preprint arXiv:1901.11483},
year = {2019}
}
Comments
59 pages, 5 figures The updated version (60 pages, 5 figures) include: - additional references; - corrected typos; - additional informal comments in the introduction and all sections; - improved presentation of figures, in particular Figure 5; - added acknowledgements