English
Related papers

Related papers: Repairing Multiple Failures with Coordinated and A…

200 papers

Partial MDS (PMDS) and sector-disk (SD) codes are classes of erasure correcting codes that combine locality with strong erasure correction capabilities. We construct PMDS and SD codes with local regeneration where each local code is a…

Information Theory · Computer Science 2021-06-14 Lukas Holzbaur , Sven Puchinger , Eitan Yaakobi , Antonia Wachter-Zeh

Data storage systems are more reliable than their individual components. In order to build highly reliable systems out of less reliable parts, systems introduce redundancy. In replicated systems, objects are simply copied several times with…

Information Theory · Computer Science 2013-08-13 John Cook , Robert Primmer , Ab de Kwant

Distributed storage systems suffer from significant repair traffic generated due to frequent storage node failures. This paper shows that properly designed low-density parity-check (LDPC) codes can substantially reduce the amount of…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-10-17 Hyegyeong Park , Dongwon Lee , Jaekyun Moon

Codes for storage systems aim to minimize the repair locality, which is the number of disks (or nodes) that participate in the repair of a single failed disk. Simultaneously, the code must sustain a high rate, operate on a small finite…

Information Theory · Computer Science 2016-09-29 Sreechakra Goparaju , Robert Calderbank

Fractional repetition (FR) codes is a family of codes for distributed storage systems that allow for uncoded exact repairs having the minimum repair bandwidth. However, in contrast to minimum bandwidth regenerating (MBR) codes, where a…

Information Theory · Computer Science 2015-01-22 Natalia Silberstein , Tuvi Etzion

This paper presents a flexible irregular model for heterogeneous cloud storage systems and investigates how the cost of repairing failed nodes can be minimized. The fractional repetition code, originally designed for minimizing repair…

Information Theory · Computer Science 2016-11-18 Quan Yu , Chi Wan Sung , Terence H. Chan

Protecting against link failures in communication networks is essential to increase robustness, accessibility, and reliability of data transmission. Recently, network coding has been proposed as a solution to provide agile and cost…

Information Theory · Computer Science 2016-11-17 Salah A. Aly , Ahmed E. Kamal

A new system model reflecting the clustered structure of distributed storage is suggested to investigate interplay between storage overhead and repair bandwidth as storage node failures occur. Large data centers with multiple racks/disks or…

Information Theory · Computer Science 2018-05-02 Jy-yong Sohn , Beongjun Choi , Sung Whan Yoon , Jaekyun Moon

We consider the probability of data loss, or equivalently, the reliability function for an erasure coded distributed data storage system under worst case conditions. Data loss in an erasure coded system depends on probability distributions…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-18 Antonio Campello , Vinay A. Vaishampayan

This paper presents a novel coding scheme for distributed storage systems containing nodes with adversarial errors. The key challenge in such systems is the propagation of erroneous data from a single corrupted node to the rest of the…

Information Theory · Computer Science 2012-07-17 Natalia Silberstein , Ankit Singh Rawat , Sriram Vishwanath

In this paper, we consider heterogeneous distributed storage systems (DSSs) having flexible reconstruction degree, where each node in the system has dynamic repair bandwidth and dynamic storage capacity. In particular, a data collector can…

Information Theory · Computer Science 2015-03-10 Krishna Gopal Benerjee , Manish K. Gupta

Recently, locally repairable codes (LRCs) with local erasure correction constraints that are unequal and disjoint have been proposed. In this work, we study the same topic and provide some improved and additional results.

Information Theory · Computer Science 2017-04-10 Geonu Kim , Jungwoo Lee

Cloud storage systems generally add redundancy in storing content files such that $K$ files are replicated or erasure coded and stored on $N > K$ nodes. In addition to providing reliability against failures, the redundant copies can be used…

In this paper we study codes for correcting deletable errors in binary words, where each bit is either retained, substituted, erased or deleted and the total number of errors is much smaller compared to the length of the codeword. We…

Information Theory · Computer Science 2021-03-02 Ghurumuruhan Ganesan

In distributed storage systems, erasure codes with locality $r$ is preferred because a coordinate can be recovered by accessing at most $r$ other coordinates which in turn greatly reduces the disk I/O complexity for small $r$. However, the…

Information Theory · Computer Science 2014-10-20 Anyu Wang , Zhifang Zhang

In large data centers, storage nodes are organized in racks, and the cross-rack transmission dominates the bandwidth cost. For the repair of single node failures, codes achieving the tradeoff between the storage redundancy and cross-rack…

Information Theory · Computer Science 2022-05-19 Liyang Zhou , Zhifang Zhang

Motivated by distributed storage applications, we investigate the degree to which capacity achieving encodings can be efficiently updated when a single information bit changes, and the degree to which such encodings can be efficiently…

Information Theory · Computer Science 2013-10-08 Arya Mazumdar , Venkat Chandar , Gregory W. Wornell

In distributed storage systems, both the repair bandwidth and locality are important repair cost metrics to evaluate the performance of a storage code. Recently, Guruswami and Wooters proposed an optimal linear repair scheme based on…

Information Theory · Computer Science 2019-06-26 Tingting Chen , Xiande Zhang

The optimal tradeoff between node storage and repair bandwidth is an important issue for distributed storage systems (DSSs). As for realistic DSSs with clusters, when repairing a failed node, it is more efficient to download more data from…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-08 Jingzhao Wang , Tinghan Wang , Yuan Luo

A key design goal of erasure-coded clusters is to reduce the repair time. The existing Erasure-coded data repair schemes are roughly classified into two categories: 1. Designing rapid data repair (e.g., PPR) in a homogeneous environment. 2.…

Networking and Internet Architecture · Computer Science 2021-04-12 Hai Zhou , Dan Feng , Yuchong Hu