English
Related papers

Related papers: CROSS-MBCR: Exact Minimum Bandwith Coordinated Reg…

200 papers

Given the scale of today's distributed storage systems, the failure of an individual node is a common phenomenon. Various metrics have been proposed to measure the efficacy of the repair of a failed node, such as the amount of data download…

Information Theory · Computer Science 2015-01-21 Gaurav Kumar Agarwal , Birenjith Sasidharan , P. Vijay Kumar

Using the idea of interference alignment, Suh and Ramchandran constructed a class of minimum-storage regenerating codes which can repair one systematic or one parity-check node with optimal repair bandwidth. With the same code structure, we…

Information Theory · Computer Science 2013-05-15 Junyu Chen , Kenneth W. Shum

Distributed storage systems suffer from significant repair traffic generated due to frequent storage node failures. This paper shows that properly designed low-density parity-check (LDPC) codes can substantially reduce the amount of…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-10-17 Hyegyeong Park , Dongwon Lee , Jaekyun Moon

In distributed storage systems (DSSs), the optimal tradeoff between node storage and repair bandwidth is an important issue for designing distributed coding strategies to ensure large scale data reliability. The capacity of DSSs is obtained…

Information Theory · Computer Science 2019-01-11 Jingzhao Wang , Tinghan Wang , Yuan Luo , Kenneth W. Shum

The optimal tradeoff between node storage and repair bandwidth is an important issue for distributed storage systems (DSSs). As for realistic DSSs with clusters, when repairing a failed node, it is more efficient to download more data from…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-08 Jingzhao Wang , Tinghan Wang , Yuan Luo

Piggybacking is an efficient method to decrease the repair bandwidth of Maximum Distance Separable (MDS) codes or Minimum Storage Regenerating (MSR) codes. In this paper, for minimizing the repair bandwidth of parity nodes of the known MSR…

Information Theory · Computer Science 2014-08-26 Bin Yang , Xiaohu Tang , Jie Li

We present the construction of a new family of erasure correcting codes for distributed storage that yield low repair bandwidth and low repair complexity. The construction is based on two classes of parity symbols. The primary goal of the…

Information Theory · Computer Science 2015-08-28 Siddhartha Kumar , Alexandre Graell i Amat , Iryna Andriyanova , Fredrik Brännström

Erasure codes provide a storage efficient alternative to replication based redundancy in (networked) storage systems. They however entail high communication overhead for maintenance, when some of the encoded fragments are lost and need to…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-11-24 Frederique Oggier , Anwitaman Datta

MDS array codes are widely used in storage systems due to their computationally efficient encoding and decoding procedures. An MDS code with $r$ redundancy nodes can correct any $r$ node erasures by accessing all the remaining information…

Information Theory · Computer Science 2016-03-04 Zhiying Wang , Itzhak Tamo , Jehoshua Bruck

This paper presents and analyzes a novel concatenated coding scheme for enabling error resilience in two distributed storage settings: one being storage using existing regenerating codes and the second being storage using locally repairable…

Information Theory · Computer Science 2013-12-12 Natalia Silberstein , Ankit Singh Rawat , Sriram Vishwanath

Fractional repetition (FR) codes is a family of codes for distributed storage systems (DSS) that allow uncoded exact repairs with minimum repair bandwidth. In this work, we consider a bound on the maximum amount of data that can be stored…

Information Theory · Computer Science 2015-01-22 Natalia Silberstein , Tuvi Etzion

Distributed storage systems often introduce redundancy to increase reliability. When coding is used, the repair problem arises: if a node storing encoded information fails, in order to maintain the same level of reliability we need to…

Information Theory · Computer Science 2010-04-27 Alexandros G. Dimakis , Kannan Ramchandran , Yunnan Wu , Changho Suh

Minimum storage regenerating (MSR) codes are MDS codes which allow for recovery of any single erased symbol with optimal repair bandwidth, based on the smallest possible fraction of the contents downloaded from each of the other symbols.…

Data Structures and Algorithms · Computer Science 2019-07-10 Venkatesan Guruswami , Haotian Jiang

Maximum-distance separable (MDS) array codes with high rate and an optimal repair property were introduced recently. These codes could be applied in distributed storage systems, where they minimize the communication and disk access required…

Information Theory · Computer Science 2013-02-19 Eyal En Gad , Robert Mateescu , Filip Blagojevic , Cyril Guyot , Zvonimir Bandic

In this work, we consider a novel distributed data storage/caching scenario in a cellular setting where multiple nodes may fail/depart at the same time. In order to maintain the target reliability, we allow cooperative regeneration of lost…

Information Theory · Computer Science 2021-05-06 Suayb S. Arslan , Massoud Pourmandi , Elif Haytaoglu

This paper presents a novel construction of $(n,k,d=n-1)$ access-optimal regenerating codes for an arbitrary sub-packetization level $\alpha$ for exact repair of any systematic node. We refer to these codes as general sub-packetized because…

Information Theory · Computer Science 2020-02-14 Katina Kralevska , Danilo Gligoroski , Harald Øverby

Reed-Solomon (RS) codes are widely used in distributed storage systems. In this paper, we study the repair bandwidth and sub-packetization size of RS codes. The repair bandwidth is defined as the amount of transmitted information from…

Information Theory · Computer Science 2019-03-11 Weiqi Li , Zhiying Wang , Hamid Jafarkhani

In large scale distributed storage systems (DSS) deployed in cloud computing, correlated failures resulting in simultaneous failure (or, unavailability) of blocks of nodes are common. In such scenarios, the stored data or a content of a…

Information Theory · Computer Science 2014-06-30 Gokhan Calis , O. Ozan Koyluoglu

We consider $(n,k,l)$ MDS codes of length $n$, dimension $k$, and subpacketization $l$ over a finite field $\mathbb{F}$. A codeword of such a code consists of $n$ column-vectors of length $l$ over $\mathbb{F}$, with the property that any…

Information Theory · Computer Science 2021-04-06 Ameera Chowdhury , Alexander Vardy

We study the repair problem of distributed storage systems in erasure networks where the packets transmitted from surviving nodes to the new node might be lost. The fundamental storage-bandwidth tradeoff is calculated by multicasting…

Information Theory · Computer Science 2013-01-30 Majid Gerami , Ming Xiao