English

Capacity bounds for distributed storage

Information Theory 2018-04-13 v5 math.IT

Abstract

One of the primary objectives of a distributed storage system is to reliably store large amounts of source data for long durations using a large number NN of unreliable storage nodes, each with cc bits of storage capacity. Storage nodes fail randomly over time and are replaced with nodes of equal capacity initialized to zeroes, and thus bits are erased at some rate EE. To maintain recoverability of the source data, a repairer continually reads data over a network from nodes at a rate RR, and generates and writes data to nodes based on the read data. The distributed storage source data capacity is the maximum amount of source data that can be reliably stored for long periods of time. We prove the distributed storage source data capacity asymptotically approaches (1E2R)Nc\left(1-\frac{E}{2 \cdot R}\right) \cdot N \cdot c as NN and RR grow. This equation expresses a fundamental trade-off between network traffic and storage overhead to reliably store source data.

Keywords

Cite

@article{arxiv.1610.03541,
  title  = {Capacity bounds for distributed storage},
  author = {Michael Luby},
  journal= {arXiv preprint arXiv:1610.03541},
  year   = {2018}
}

Comments

19 pages, 2 figures, revised version submitted to IEEE Transactions on Information Theory in April, 2018, Figures revised

R2 v1 2026-06-22T16:18:14.837Z