Storage Codes with Flexible Number of Nodes
Abstract
This paper presents flexible storage codes, a class of error-correcting codes that can recover information from a flexible number of storage nodes. As a result, one can make a better use of the available storage nodes in the presence of unpredictable node failures and reduce the data access latency. Let us assume a storage system encodes information symbols over a finite field into nodes, each of size symbols. The code is parameterized by a set of tuples , satisfying and , such that the information symbols can be reconstructed from any nodes, each node accessing symbols. In other words, the code allows a flexible number of nodes for decoding to accommodate the variance in the data access time of the nodes. Code constructions are presented for different storage scenarios, including LRC (locally recoverable) codes, PMDS (partial MDS) codes, and MSR (minimum storage regenerating) codes. We analyze the latency of accessing information and perform simulations on Amazon clusters to show the efficiency of presented codes.
Cite
@article{arxiv.2106.11336,
title = {Storage Codes with Flexible Number of Nodes},
author = {Weiqi Li and Zhiying Wang and Taiting Lu and Hamid Jafarkhani},
journal= {arXiv preprint arXiv:2106.11336},
year = {2021}
}