English

GreenDyGNN: Runtime-Adaptive Energy-Efficient Communication for Distributed GNN Training

Distributed, Parallel, and Cluster Computing 2026-04-28 v1

Abstract

Distributed GNN training is dominated by remote feature fetching, which can be very costly. Multi-hop neighborhood sampling crosses partition boundaries and triggers fine-grained RPCs whose fixed initiation cost and GPU-stall latency waste energy. Prior systems try to reduce this overhead with presampling and static caching, but cache policies cannot react to runtime network variation. We show that under time-varying congestion, static caching can increase energy by up to 45% because a fixed rebuild schedule is insufficient. We present GreenDyGNN, which formulates cache window management as a sequential decision problem. GreenDyGNN performs intra-epoch cache rebuilds and uses a Double-DQN agent, trained in a calibrated simulator with domain-randomized congestion, to adapt rebuild window size and per-owner cache allocation at each boundary. An asynchronous double-buffered pipeline makes adaptation effectively free. Under congestion, GreenDyGNN cuts total energy by up to 43% over Default DGL and 4-24% over the best static policy, while closely matching the optimum under clean conditions.

Keywords

Cite

@article{arxiv.2604.23139,
  title  = {GreenDyGNN: Runtime-Adaptive Energy-Efficient Communication for Distributed GNN Training},
  author = {Arefin Niam and Tevfik Kosar and M. S. Q. Zulkar Nine},
  journal= {arXiv preprint arXiv:2604.23139},
  year   = {2026}
}
R2 v1 2026-07-01T12:34:49.037Z