English

On the Optimal Recovery Threshold of Coded Matrix Multiplication

Information Theory 2018-05-17 v2 Distributed, Parallel, and Cluster Computing math.IT

Abstract

We provide novel coded computation strategies for distributed matrix-matrix products that outperform the recent "Polynomial code" constructions in recovery threshold, i.e., the required number of successful workers. When mm-th fraction of each matrix can be stored in each worker node, Polynomial codes require m2m^2 successful workers, while our MatDot codes only require 2m12m-1 successful workers, albeit at a higher communication cost from each worker to the fusion node. We also provide a systematic construction of MatDot codes. Further, we propose "PolyDot" coding that interpolates between Polynomial codes and MatDot codes to trade off communication cost and recovery threshold. Finally, we demonstrate a coding technique for multiplying nn matrices (n3n \geq 3) by applying MatDot and PolyDot coding ideas.

Keywords

Cite

@article{arxiv.1801.10292,
  title  = {On the Optimal Recovery Threshold of Coded Matrix Multiplication},
  author = {Sanghamitra Dutta and Mohammad Fahim and Farzin Haddadpour and Haewon Jeong and Viveck Cadambe and Pulkit Grover},
  journal= {arXiv preprint arXiv:1801.10292},
  year   = {2018}
}

Comments

Extended version of the paper that appeared at Allerton 2017 (October 2017), including full proofs and further results. Submitted to IEEE Transactions on Information Theory

R2 v1 2026-06-23T00:05:22.750Z