English
Related papers

Related papers: Repair Pipelining for Erasure-Coded Storage: Algor…

200 papers

Erasure codes are an integral part of many distributed storage systems aimed at Big Data, since they provide high fault-tolerance for low overheads. However, traditional erasure codes are inefficient on reading stored data in degraded…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-06-27 Kyumars Sheykh Esmaili , Lluis Pamies-Juarez , Anwitaman Datta

In the context of distributed storage systems, locally repairable codes have become important. In this paper we focus on codes that allow for multi-erasure pattern decoding with low computational effort. Different optimality requirements,…

Information Theory · Computer Science 2025-04-16 Margreta Kuijper , Julia Lieb , Diego Napp

In distributed storage systems that employ erasure coding, the issue of minimizing the total {\it repair bandwidth} required to exactly regenerate a storage node after a failure arises. This repair bandwidth depends on the structure of the…

Information Theory · Computer Science 2011-06-10 Dimitris S. Papailiopoulos , Alexandros G. Dimakis

We present the construction of a family of erasure correcting codes for distributed storage that achieve low repair bandwidth and complexity at the expense of a lower fault tolerance. The construction is based on two classes of codes, where…

Information Theory · Computer Science 2018-09-03 Siddhartha Kumar , Alexandre Graell i Amat , Iryna Andriyanova , Fredrik Brännström , Eirik Rosnes

The reliability of erasure-coded distributed storage systems, as measured by the mean time to data loss (MTTDL), depends on the repair bandwidth of the code. Repair-efficient codes provide reliability values several orders of magnitude…

Information Theory · Computer Science 2017-08-04 Vaneet Aggarwal , Chao Tian , Vinay A. Vaishampayan , Yih-Farn R. Chen

A new class of exact-repair regenerating codes is constructed by stitching together shorter erasure correction codes, where the stitching pattern can be viewed as block designs. The proposed codes have the "help-by-transfer" property where…

Information Theory · Computer Science 2017-08-04 Chao Tian , Birenjith Sasidharan , Vaneet Aggarwal , Vinay A. Vaishampayan , P. Vijay Kumar

We address the problem of securing distributed storage systems against passive eavesdroppers that can observe a limited number of storage nodes. An important aspect of these systems is node failures over time, which demand a repair…

Information Theory · Computer Science 2016-11-18 Sameer Pawar , Salim El Rouayheb , Kannan Ramchandran

Distributed storage systems for large clusters typically use replication to provide reliability. Recently, erasure codes have been used to reduce the large storage overhead of three-replicated systems. Reed-Solomon codes are the standard…

To recover simultaneous multiple failures in erasure coded storage systems, Patrick Lee et al introduce concurrent repair based minimal storage regenerating codes to reduce repair traffic. The architecture of this approach is simpler and…

Information Theory · Computer Science 2016-04-25 Huayu Zhang , Hui Li , Hanxu Hou , K. W. Shum , ShuoYen Robert Li

Distributed storage systems provide large-scale reliable data storage services by spreading redundancy across a large group of storage nodes. In such a large system, node failures take place on a regular basis. When a storage node breaks…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-03-17 Yan Wang , Xunrui Yin , Dongsheng Wei , Xin Wang , Yucheng He

Peer-to-peer distributed storage systems provide reliable access to data through redundancy spread over nodes across the Internet. A key goal is to minimize the amount of bandwidth used to maintain that redundancy. Storing a file using an…

Information Theory · Computer Science 2007-07-13 Alexandros G. Dimakis , P. Brighten Godfrey , Martin J. Wainwright , Kannan Ramchandran

We study the capacity of heterogeneous distributed storage systems under repair dynamics. Examples of these systems include peer-to-peer storage clouds, wireless, and Internet caching systems. Nodes in a heterogeneous system can have…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-12-16 Toni Ernvall , Salim El Rouayheb , Camilla Hollanti , H. Vincent Poor

A new class of exact-repair regenerating codes is constructed by combining two layers of erasure correction codes together with combinatorial block designs, e.g., Steiner systems, balanced incomplete block designs and t-designs. The…

Information Theory · Computer Science 2013-02-20 Chao Tian , Vaneet Aggarwal , Vinay A. Vaishampayan

Distributed storage systems need to store data redundantly in order to provide some fault-tolerance and guarantee system reliability. Different coding techniques have been proposed to provide the required redundancy more efficiently than…

Information Theory · Computer Science 2016-11-15 Lluis Pamies-Juarez , Henk D. L. Hollmann , Frédérique Oggier

Erasure codes provide a storage efficient alternative to replication based redundancy in (networked) storage systems. They however entail high communication overhead for maintenance, when some of the encoded fragments are lost and need to…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-11-24 Frederique Oggier , Anwitaman Datta

A major issue of locally repairable codes is their robustness. If a local repair group is not able to perform the repair process, this will result in increasing the repair cost. Therefore, it is critical for a locally repairable code to…

Information Theory · Computer Science 2019-04-09 Ali Tebbi , Terence H. Chan , Chi Wan Sung

In distributed storage systems reliability is achieved through redundancy stored at different nodes in the network. Then a data collector can reconstruct source information even though some nodes fail. To maintain reliability, an autonomous…

Information Theory · Computer Science 2013-03-26 Majid Gerami , Ming Xiao , Mikael Skoglund , Kenneth W. Shum , Dengsheng Lin

Network transfer and disk read are the most time consuming operations in the repair process for node failures in erasure-code-based distributed storage systems. Recent developments on Reed-Solomon codes, the most widely used erasure codes…

Information Theory · Computer Science 2018-05-10 Hoang Dau , Iwan Duursma , Hien Chu

Erasure codes, such as Reed-Solomon (RS) codes, are being increasingly employed in data centers to combat the cost of reliably storing large amounts of data. Although these codes provide optimal storage efficiency, they require…

Networking and Internet Architecture · Computer Science 2013-09-03 K. V. Rashmi , Nihar B. Shah , Dikang Gu , Hairong Kuang , Dhruba Borthakur , Kannan Ramchandran

Erasure coding techniques are used to increase the reliability of distributed storage systems while minimizing storage overhead. Also of interest is minimization of the bandwidth required to repair the system following a node failure. In a…

Information Theory · Computer Science 2009-10-06 K. V. Rashmi , Nihar B. Shah , P. Vijay Kumar , Kannan Ramchandran