English

An Overview for Markov Decision Processes in Queues and Networks

Optimization and Control 2019-08-26 v2 Networking and Internet Architecture

Abstract

Markov decision processes (MDPs) in queues and networks have been an interesting topic in many practical areas since the 1960s. This paper provides a detailed overview on this topic and tracks the evolution of many basic results. Also, this paper summarizes several interesting directions in the future research. We hope that this overview can shed light to MDPs in queues and networks, and also to their extensive applications in various practical areas.

Keywords

Cite

@article{arxiv.1907.10243,
  title  = {An Overview for Markov Decision Processes in Queues and Networks},
  author = {Quan-Lin Li and Jing-Yu Ma and Rui-Na Fan and Li Xia},
  journal= {arXiv preprint arXiv:1907.10243},
  year   = {2019}
}

Comments

42 pages

R2 v1 2026-06-23T10:29:02.138Z