Repair rate lower bounds for distributed storage
Abstract
One of the primary objectives of a distributed storage system is to reliably store a large amount of source data for a long duration using a large number of unreliable storage nodes, each with capacity . The storage overhead is the fraction of system capacity available beyond , i.e., . Storage nodes fail randomly over time and are replaced with initially empty nodes, and thus data is erased from the system at an average rate , where is the average lifetime of a node before failure. To maintain recoverability of the source data, a repairer continually reads data over a network from nodes at some average rate , and generates and writes data to nodes based on the read data. The main result is that, for any repairer, if the source data is recoverable at each point in time then it must be the case that asymptotically as goes to infinity and beta goes to zero. This inequality provides a fundamental lower bound on the average rate that any repairer needs to read data from the system in order to maintain recoverability of the source data.
Keywords
Cite
@article{arxiv.2002.07904,
title = {Repair rate lower bounds for distributed storage},
author = {Michael Luby},
journal= {arXiv preprint arXiv:2002.07904},
year = {2020}
}
Comments
18 pages, 3 figures, submitted to IEEE Transactions on Information Theory