English

Locality and Availability in Distributed Storage

Information Theory 2014-02-11 v1 math.IT

Abstract

This paper studies the problem of code symbol availability: a code symbol is said to have (r,t)(r, t)-availability if it can be reconstructed from tt disjoint groups of other symbols, each of size at most rr. For example, 33-replication supports (1,2)(1, 2)-availability as each symbol can be read from its t=2t= 2 other (disjoint) replicas, i.e., r=1r=1. However, the rate of replication must vanish like 1t+1\frac{1}{t+1} as the availability increases. This paper shows that it is possible to construct codes that can support a scaling number of parallel reads while keeping the rate to be an arbitrarily high constant. It further shows that this is possible with the minimum distance arbitrarily close to the Singleton bound. This paper also presents a bound demonstrating a trade-off between minimum distance, availability and locality. Our codes match the aforementioned bound and their construction relies on combinatorial objects called resolvable designs. From a practical standpoint, our codes seem useful for distributed storage applications involving hot data, i.e., the information which is frequently accessed by multiple processes in parallel.

Keywords

Cite

@article{arxiv.1402.2011,
  title  = {Locality and Availability in Distributed Storage},
  author = {Ankit Singh Rawat and Dimitris S. Papailiopoulos and Alexandros G. Dimakis and Sriram Vishwanath},
  journal= {arXiv preprint arXiv:1402.2011},
  year   = {2014}
}

Comments

Submitted to ISIT 2014

R2 v1 2026-06-22T03:04:28.317Z