English

Delay-Aware Scheduling over mmWave/Sub-6 Dual Interfaces: A Reinforcement Learning Approach

Networking and Internet Architecture 2020-05-19 v1

Abstract

We consider a transmitter with mmWave/sub6 dual interfaces. Due to the intermittency of mmWave channel, the transmitter must schedule packets wisely across the interfaces to minimize the average delay by observing the system state. We usethe well-known dynamic programming methods and Q-learning to find the optimal scheduling policy and investigate the influenceof observing CSI on the optimal policy under different levels of knowledge of the environment. We find that only when the channel state transition model is not available, the instantaneousCSI can help in reducing system delay

Keywords

Cite

@article{arxiv.2005.08668,
  title  = {Delay-Aware Scheduling over mmWave/Sub-6 Dual Interfaces: A Reinforcement Learning Approach},
  author = {Ying Cao and Bo Sun and Danny H. K. Tsang},
  journal= {arXiv preprint arXiv:2005.08668},
  year   = {2020}
}

Comments

To be published in Workshop on 5G Long Term Evolution and Intelligent Communication, ICC 2020

R2 v1 2026-06-23T15:37:30.545Z