On the Optimal Recovery Threshold of Coded Matrix Multiplication
Abstract
We provide novel coded computation strategies for distributed matrix-matrix products that outperform the recent "Polynomial code" constructions in recovery threshold, i.e., the required number of successful workers. When -th fraction of each matrix can be stored in each worker node, Polynomial codes require successful workers, while our MatDot codes only require successful workers, albeit at a higher communication cost from each worker to the fusion node. We also provide a systematic construction of MatDot codes. Further, we propose "PolyDot" coding that interpolates between Polynomial codes and MatDot codes to trade off communication cost and recovery threshold. Finally, we demonstrate a coding technique for multiplying matrices () by applying MatDot and PolyDot coding ideas.
Cite
@article{arxiv.1801.10292,
title = {On the Optimal Recovery Threshold of Coded Matrix Multiplication},
author = {Sanghamitra Dutta and Mohammad Fahim and Farzin Haddadpour and Haewon Jeong and Viveck Cadambe and Pulkit Grover},
journal= {arXiv preprint arXiv:1801.10292},
year = {2018}
}
Comments
Extended version of the paper that appeared at Allerton 2017 (October 2017), including full proofs and further results. Submitted to IEEE Transactions on Information Theory