English

A Construction of Asymptotically Optimal Cascaded CDC Schemes via Combinatorial Designs

Information Theory 2023-09-11 v1 Combinatorics math.IT

Abstract

A coded distributed computing (CDC) system aims to reduce the communication load in the MapReduce framework. Such a system has KK nodes, NN input files, and QQ Reduce functions. Each input file is mapped by rr nodes and each Reduce function is computed by ss nodes. The objective is to achieve the maximum multicast gain. There are known CDC schemes that achieve optimal communication load. In some prominent known schemes, however, NN and QQ grow too fast in terms of KK, greatly reducing their gains in practical scenarios. To mitigate the situation, some asymptotically optimal cascaded CDC schemes with r=sr=s have been proposed by using symmetric designs. In this paper, we put forward new asymptotically optimal cascaded CDC schemes with r=sr=s by using 11-designs. Compared with earlier schemes from symmetric designs, ours have much smaller computation loads while keeping the other relevant parameters the same. We also obtain new asymptotically optimal cascaded CDC schemes with more flexible parameters compared with previously best-performing schemes.

Keywords

Cite

@article{arxiv.2309.04305,
  title  = {A Construction of Asymptotically Optimal Cascaded CDC Schemes via Combinatorial Designs},
  author = {Yingjie Cheng and Gaojun Luo and Xiwang Cao and Martianus Frederic Ezerman and San Ling},
  journal= {arXiv preprint arXiv:2309.04305},
  year   = {2023}
}