English

Repair rate lower bounds for distributed storage

Information Theory 2020-02-20 v1 Distributed, Parallel, and Cluster Computing math.IT

Abstract

One of the primary objectives of a distributed storage system is to reliably store a large amount dsizedsize of source data for a long duration using a large number NN of unreliable storage nodes, each with capacity nsizensize. The storage overhead β\beta is the fraction of system capacity available beyond dsizedsize, i.e., β=1dsizeNnsize\beta = 1- \frac{dsize}{N \cdot nsize}. Storage nodes fail randomly over time and are replaced with initially empty nodes, and thus data is erased from the system at an average rate erate=λNnsizeerate = \lambda \cdot N \cdot nsize, where 1/λ1/\lambda is the average lifetime of a node before failure. To maintain recoverability of the source data, a repairer continually reads data over a network from nodes at some average rate rraterrate, and generates and writes data to nodes based on the read data. The main result is that, for any repairer, if the source data is recoverable at each point in time then it must be the case that rrateerate2βrrate \ge \frac{erate}{2 \cdot \beta} asymptotically as NN goes to infinity and beta goes to zero. This inequality provides a fundamental lower bound on the average rate that any repairer needs to read data from the system in order to maintain recoverability of the source data.

Keywords

Cite

@article{arxiv.2002.07904,
  title  = {Repair rate lower bounds for distributed storage},
  author = {Michael Luby},
  journal= {arXiv preprint arXiv:2002.07904},
  year   = {2020}
}

Comments

18 pages, 3 figures, submitted to IEEE Transactions on Information Theory

R2 v1 2026-06-23T13:46:08.303Z