English
Related papers

Related papers: HashTag Erasure Codes: From Theory to Practice

200 papers

Erasure codes are being increasingly used in distributed-storage systems in place of data-replication, since they provide the same level of reliability with much lower storage overhead. We consider the problem of constructing explicit…

Information Theory · Computer Science 2015-09-08 Preetum Nakkiran , K. V. Rashmi , Kannan Ramchandran

We study the exact and optimal repair of multiple failures in codes for distributed storage. More particularly, we provide an explicit construction of exact minimum bandwidth coordinated regenerating codes (MBCR) for n=d+t,k,d >= k,t >= 1.…

Information Theory · Computer Science 2012-07-05 Steve Jiekak , Nicolas Le Scouarnec

The issue of repairing Reed-Solomon codes currently employed in industry has been sporadically discussed in the literature. In this work we carry out a systematic study of these codes and investigate important aspects of repairing them…

Information Theory · Computer Science 2022-05-24 Thi Xinh Dinh , Luu Y Nhi Nguyen , Lakshmi J. Mohan , Serdar Boztas , Tran Thi Luong , Son Hoang Dau

We study the problem of centralized exact repair of multiple failures in distributed storage. We describe constructions that achieve a new set of interior points under exact repair. The constructions build upon the layered code construction…

Information Theory · Computer Science 2018-02-02 Marwen Zorgui , Zhiying Wang

In the literature, most of the known high-rate $(n,k)$ MDS array codes with the optimal repair property only support a single repair degree (i.e., the number of helper nodes contacted during a repair process) $d$, where $k\le d\le n-1$.…

Information Theory · Computer Science 2022-05-27 Y. Liu , J. Li , X. H. Tang

Large-scale distributed storage systems typically use erasure codes to provide durability of data in the face of failures. A set of $k$ blocks to be stored is encoded using an $[n, k]$ code to generate $n$ blocks that are then stored on…

Information Theory · Computer Science 2019-07-31 Francisco Maturana , K. V. Rashmi

Erasure codes play an important role in storage systems to prevent data loss. In this work, we study a class of erasure codes called Multi-Erasure Locally Recoverable Codes (ME-LRCs) for storage arrays. Compared to previous related works,…

Information Theory · Computer Science 2017-09-29 Pengfei Huang , Eitan Yaakobi , Paul H. Siegel

We present the construction of a new family of erasure correcting codes for distributed storage that yield low repair bandwidth and low repair complexity. The construction is based on two classes of parity symbols. The primary goal of the…

Information Theory · Computer Science 2015-08-28 Siddhartha Kumar , Alexandre Graell i Amat , Iryna Andriyanova , Fredrik Brännström

It is well known that an (n,k) code can be used to store 'k' units of information in 'n' unit-capacity disks of a distributed data storage system. If the code used is maximum distance separable (MDS), then the system can tolerate any (n-k)…

Information Theory · Computer Science 2011-06-08 Viveck R. Cadambe , Cheng Huang , Syed A. Jafar , Jin Li

The distributed data storage systems are constructed by large number of nodes which are interconnected over a network. Each node in such peer-to-peer network is vulnerable and at a potential risk for attack. The attackers can eavesdrop the…

Information Theory · Computer Science 2016-02-08 Ninoslav Marina , Aneta Velkoska , Natasa Paunkoska

An $(n, k, d, \alpha)$-MSR (minimum storage regeneration) code is a set of $n$ nodes used to store a file. For a file of total size $k\alpha$, each node stores $\alpha$ symbols, any $k$ nodes recover the file, and any $d$ nodes can repair…

Information Theory · Computer Science 2022-01-07 Iwan Duursma , Hsin-Po Wang

We continue our study of regenerating codes in distributed storage systems where connections between the nodes are constrained by a graph. In this problem, the failed node downloads the information stored at a subset of vertices of the…

Information Theory · Computer Science 2022-11-03 Adway Patra , Alexander Barg

We propose a generic transformation that can convert any nonbinary $(n=k+r,k)$ maximum distance separable (MDS) code into another $(n,k)$ MDS code over the same field such that 1) some arbitrarily chosen $r$ nodes have the optimal repair…

Information Theory · Computer Science 2018-08-24 Jie Li , Xiaohu Tang , Chao Tian

We consider $(n,k,l)$ MDS codes of length $n$, dimension $k$, and subpacketization $l$ over a finite field $\mathbb{F}$. A codeword of such a code consists of $n$ column-vectors of length $l$ over $\mathbb{F}$, with the property that any…

Information Theory · Computer Science 2021-04-06 Ameera Chowdhury , Alexander Vardy

Local Reconstruction Codes (LRCs) allow for recovery from a small number of erasures in a local manner based on just a few other codeword symbols. A maximally recoverable (MR) LRC offers the best possible blend of such local and global…

Information Theory · Computer Science 2018-08-15 Venkatesan Guruswami , Lingfei Jin , Chaoping Xing

In this paper, we propose a novel cooperative repair scheme for Zigzag MSR codes with optimal repair bandwidth, enabling the repair of any h failed nodes. To the best of our knowledge, this is the first optimal cooperative repair scheme for…

Information Theory · Computer Science 2025-02-28 Yajuan Liu , Han Cai , Xiaohu Tang

The explosion in the volumes of data being stored online has resulted in distributed storage systems transitioning to erasure coding based schemes. Local Reconstruction Codes (LRCs) have emerged as the codes of choice for these…

Information Theory · Computer Science 2018-11-19 Sivakanth Gopi , Venkatesan Guruswami , Sergey Yekhanin

Recently we constructed an explicit family of locally repairable and locally regenerating codes. Their existence was proven by Kamath et al. but no explicit construction was given. Our design is based on HashTag codes that can have…

Information Theory · Computer Science 2020-02-14 Danilo Gligoroski , Katina Kralevska , Rune E. Jensen , Per Simonsen

Residue codes have been traditionally used for compute error correction rather than storage error correction. In this paper, we use these codes for storage error correction with surprising results. We find that adapting residue codes to…

Hardware Architecture · Computer Science 2022-12-20 Evgeny Manzhosov , Adam Hastings , Meghna Pancholi , Ryan Piersma , Mohamed Tarek Ibn Ziad , Simha Sethumadhavan

An $(m,n,a,b)$-tensor code consists of $m\times n$ matrices whose columns satisfy `$a$' parity checks and rows satisfy `$b$' parity checks (i.e., a tensor code is the tensor product of a column code and row code). Tensor codes are useful in…

Information Theory · Computer Science 2022-12-05 Joshua Brakensiek , Sivakanth Gopi , Visu Makam