English

Reward Algorithms for Semi-Markov Processes

Probability 2016-03-21 v1

Abstract

New algorithms for computing power moments of hitting times and accumulated rewards of hitting type for semi-Markov processes. The algorithms are based on special techniques of sequential phase space reduction and recurrence relations connecting moments of rewards. Applications are discussed as well as possible generalisations of presented results and results of experimental studies.

Keywords

Cite

@article{arxiv.1603.05693,
  title  = {Reward Algorithms for Semi-Markov Processes},
  author = {Dmitrii Silvestrov and Raimondo Manca},
  journal= {arXiv preprint arXiv:1603.05693},
  year   = {2016}
}

Comments

24 pages

R2 v1 2026-06-22T13:13:36.340Z