English
Related papers

Related papers: Rack-Aware Cooperative Regenerating Codes

200 papers

We introduce a dynamical model of node repair in distributed storage systems wherein the storage nodes are subjected to failures according to independent Poisson processes. The main parameter that we study is the time-average capacity of…

Information Theory · Computer Science 2020-09-22 Ohad Elishco , Alexander Barg

The explosion in the volumes of data being stored online has resulted in distributed storage systems transitioning to erasure coding based schemes. Yet, the codes being deployed in practice are fairly short. In this work, we address what we…

Information Theory · Computer Science 2016-09-22 Parikshit Gopalan , Guangda Hu , Swastik Kopparty , Shubhangi Saraf , Carol Wang , Sergey Yekhanin

In this paper, three outer bounds on the normalized storage-repair bandwidth (S-RB) tradeoff of regenerating codes having parameter set $\{(n,k,d),(\alpha,\beta)\}$ under the exact-repair (ER) setting are presented. The first outer bound is…

Information Theory · Computer Science 2016-06-15 Birenjith Sasidharan , N. Prakash , M. Nikhil Krishnan , Myna Vajha , Kaushik Senthoor , P. Vijay Kumar

Typically, locally repairable codes (LRCs) and regenerating codes have been studied independently of each other, and it has not been clear how the parameters of one relate to those of the other. In this paper, a novel connection between…

Information Theory · Computer Science 2016-11-22 Toni Ernvall , Thomas Westerbäck , Ragnar Freij-Hollanti , Camilla Hollanti

Distributed storage systems support failures of individual devices by the use of replication or erasure correcting codes. While erasure correcting codes offer a better storage efficiency than replication for similar fault tolerance, they…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-12-10 Nicolas Le Scouarnec

The high repair cost of (n,k) Maximum Distance Separable (MDS) erasure codes has recently motivated a new class of codes, called Regenerating Codes, that optimally trade off storage cost for repair bandwidth. On one end of this spectrum of…

Information Theory · Computer Science 2010-04-19 Changho Suh , Kannan Ramchandran

In a distributed storage network, reliability and bandwidth optimization can be provided by regenerating codes. Recently table based regenerating codes viz. DRESS (Distributed Replication-based Exact Simple Storage) codes has been proposed…

Information Theory · Computer Science 2013-02-18 Manish K Gupta , Anupam Agrawal , Deepak Yadav

Fractional repetition (FR) codes are a family of repair-efficient storage codes that provide exact and uncoded node repair at the minimum bandwidth regenerating point. The advantageous repair properties are achieved by a tailor-made…

Information Theory · Computer Science 2020-05-15 Bing Zhu , Hui Li , Kenneth W. Shum , Shuo-Yen Robert Li

This paper generalizes the piggybacking constructions for distributed storage systems by considering various protected instances and piggybacked instances. Analysis demonstrates that the proportion of protected instances determines the…

Information Theory · Computer Science 2017-02-07 Shuai Yuan , Qin Huang , Zulin Wang

Minimum storage regenerating (MSR) codes, with the MDS property and the optimal repair bandwidth, are widely used in distributed storage systems (DSS) for data recovery. In this paper, we consider the construction of $(n,k,l)$ MSR codes in…

Information Theory · Computer Science 2023-09-28 Shenghua Li , Maximilien Gadouleau , Jiaojiao Wang , Dabin Zheng

A new system model reflecting the clustered structure of distributed storage is suggested to investigate bandwidth requirements for repairing failed storage nodes. Large data centers with multiple racks/disks or local networks of storage…

Information Theory · Computer Science 2017-02-14 Jy-yong Sohn , Beongjun Choi , Sung Whan Yoon , Jaekyun Moon

Coded distributed computing can alleviate the communication load by leveraging the redundant storage and computation resources with coding techniques in distributed computing. In this paper, we study a MapReduce-type distributed computing…

Information Theory · Computer Science 2023-01-11 Qifa Yan , Xiaohu Tang , Meixia Tao , Qin Huang

Repair performance in hierarchical data centers is often bottlenecked by cross-rack network transfer. Recent theoretical results show that the cross-rack repair traffic can be minimized through repair layering, whose idea is to partition a…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-18 Yuchong Hu , Xiaolu Li , Mi Zhang , Patrick P. C. Lee , Xiaoyang Zhang , Pan Zhou , Dan Feng

We address the multi-node failure repair challenges for MDS array codes. Presently, two primary models are employed for multi-node repairs: the centralized model where all failed nodes are restored in a singular data center, and the…

Information Theory · Computer Science 2025-02-25 Zihao Zhang , Guodong Li , Sihuang Hu

Clustered distributed storage models real data centers where intra- and cross-cluster repair bandwidths are different. In this paper, exact-repair minimum-storage-regenerating (MSR) codes achieving capacity of clustered distributed storage…

Information Theory · Computer Science 2018-01-09 Jy-yong Sohn , Beongjun Choi , Jaekyun Moon

Regenerating codes provide an efficient way to recover data at failed nodes in distributed storage systems. It has been shown that regenerating codes can be designed to minimize the per-node storage (called MSR) or minimize the…

Information Theory · Computer Science 2013-01-14 Yunghsiang S. Han , Hong-Ta Pai , Rong Zheng , Pramod K. Varshney

Storage codes are used to ensure reliable storage of data in distributed systems. Here we consider functional repair codes, where individual storage nodes that fail may be repaired efficiently and the ability to recover original data and to…

Discrete Mathematics · Computer Science 2018-09-24 Siaw-Lynn Ng , Maura B. Paterson

In distributed storage systems built using commodity hardware, it is necessary to have data redundancy in order to ensure system reliability. In such systems, it is also often desirable to be able to quickly repair storage nodes that fail.…

Information Theory · Computer Science 2012-01-24 Joseph C. Koo , John Gill

This paper presents a novel construction of $(n,k,d=n-1)$ access-optimal regenerating codes for an arbitrary sub-packetization level $\alpha$ for exact repair of any systematic node. We refer to these codes as general sub-packetized because…

Information Theory · Computer Science 2020-02-14 Katina Kralevska , Danilo Gligoroski , Harald Øverby

The continuously increasing amount of digital data generated by today's society asks for better storage solutions. This survey looks at a new generation of coding techniques designed specifically for the needs of distributed networked…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-01-31 Anwitaman Datta , Frederique Oggier