中文
相关论文

相关论文: HashTag Erasure Codes: From Theory to Practice

200 篇论文

Partial maximum distance separable (PMDS) codes are a kind of erasure codes where the nodes are divided into multiple groups with each forming an MDS code with a smaller code length, thus they allow repairing a failed node with only a few…

信息论 · 计算机科学 2022-11-15 Jie Li , Xiaohu Tang , Hanxu Hou , Yunghsiang S. Han , Bo Bai , Gong Zhang

Maximum-distance separable (MDS) array codes with high rate and an optimal repair property were introduced recently. These codes could be applied in distributed storage systems, where they minimize the communication and disk access required…

信息论 · 计算机科学 2013-02-19 Eyal En Gad , Robert Mateescu , Filip Blagojevic , Cyril Guyot , Zvonimir Bandic

In this paper, we propose locally repairable codes (LRCs) with optimal minimum distance for distributed storage systems (DSS). A two-layer encoding structure is employed to ensure data reconstruction and the designated repair locality. The…

信息论 · 计算机科学 2014-08-15 Hongmei Xie , Zhiyuan Yan

Regenerating codes are a class of recently developed codes for distributed storage that, like Reed-Solomon codes, permit data recovery from any subset of k nodes within the n-node network. However, regenerating codes possess in addition,…

信息论 · 计算机科学 2015-03-17 Nihar B. Shah , K. V. Rashmi , P. Vijay Kumar , Kannan Ramchandran

Streaming codes are a class of packet-level erasure codes that are designed with the goal of ensuring recovery in low-latency fashion, of erased packets over a communication network. It is well-known in the streaming code literature, that…

信息论 · 计算机科学 2021-09-08 Vinayak Ramkumar , Myna Vajha , P. Vijay Kumar

Scientific computing workflows generate enormous distributed data that is short-lived, yet critical for job completion time. This class of data is called intermediate data. A common way to achieve high data availability is to replicate…

分布式、并行与集群计算 · 计算机科学 2020-04-14 Zhe Zhang , Brian Bockelman , Derek Weitzel , David Swanson

Erasure codes are an integral part of many distributed storage systems aimed at Big Data, since they provide high fault-tolerance for low overheads. However, traditional erasure codes are inefficient on reading stored data in degraded…

分布式、并行与集群计算 · 计算机科学 2013-06-27 Kyumars Sheykh Esmaili , Lluis Pamies-Juarez , Anwitaman Datta

Cooperative regenerating codes are designed for repairing multiple node failures in distributed storage systems. In contrast to the original repair model of regenerating codes, which are for the repair of single node failure, data exchange…

信息论 · 计算机科学 2016-07-29 Kenneth W. Shum , Junyu Chen

Fast and efficient failure recovery is a new challenge for cloud storage systems with a large number of storage nodes. A pivotal recovery metric upon the failure of a storage node is repair bandwidth cost which refers to the amount of data…

信息论 · 计算机科学 2016-05-24 Mahdi Hajiaghayi , Hamid Jafarkhani

In this paper, we revisit the problem of characterizing the secrecy capacity of minimum storage regenerating (MSR) codes under the passive $(l_1,l_2)$-eavesdropper model, where the eavesdropper has access to data stored on $l_1$ nodes and…

信息论 · 计算机科学 2016-08-10 Kun Huang , Udaya Parampalli , Ming Xian

Partial MDS (PMDS) and sector-disk (SD) codes are classes of erasure correcting codes that combine locality with strong erasure correction capabilities. We construct PMDS and SD codes with local regeneration where each local code is a…

信息论 · 计算机科学 2021-06-14 Lukas Holzbaur , Sven Puchinger , Eitan Yaakobi , Antonia Wachter-Zeh

In this paper, we propose two new constructions of exact-repair minimum storage regenerating (exact-MSR) codes. For both constructions, the encoded symbols are obtained by treating the message vector over GF(q) as a linearized polynomial…

信息论 · 计算机科学 2013-01-22 Hongmei Xie , Zhiyuan Yan

In coding for distributed storage systems, efficient data reconstruction and repair through accessing a predefined number of arbitrarily chosen storage nodes is guaranteed by regenerating codes. Traditionally, code parameters, specially the…

信息论 · 计算机科学 2018-01-01 Kaveh Mahdaviani , Soheil Mohajer , Ashish Khisti

A novel coding scheme for exact repair-regenerating codes is presented in this paper. The codes proposed in this work can trade between the repair bandwidth of nodes (number of downloaded symbols from each surviving node in a repair…

信息论 · 计算机科学 2021-01-05 Mehran Elyasi , Soheil Mohajer

Minimum storage regenerating codes have minimum storage of data in each node and therefore are maximal distance separable (MDS for short) codes. Thus, the number of nodes is upper bounded by $2^{\fb}$, where $\fb$ is the bits of data stored…

信息论 · 计算机科学 2017-10-06 Lingfei Jin , Yuan Luo , Chaoping Xing

Erasure codes are an efficient means of storing data across a network in comparison to data replication, as they tend to reduce the amount of data stored in the network and offer increased resilience in the presence of node failures. The…

信息论 · 计算机科学 2016-11-17 K. V. Rashmi , Nihar B. Shah , P. Vijay Kumar

Blockchain is a distributed ledger with wide applications. Due to the increasing storage requirement for blockchains, the computation can be afforded by only a few miners. Sharding has been proposed to scale blockchains so that storage and…

密码学与安全 · 计算机科学 2020-11-13 Divija Swetha Gadiraju , V. Lalitha , Vaneet Aggarwal

Two widely studied models of multiple-node repair in distributed storage systems are centralized repair and cooperative repair. The centralized model assumes that all the failed nodes are recreated in one location, while the cooperative one…

信息论 · 计算机科学 2018-07-12 Min Ye , Alexander Barg

Modern large-scale distributed storage systems use erasure codes to protect against node failures with low storage overhead. In practice, the failure rate and other factors of storage devices in the system may vary significantly over time,…

信息论 · 计算机科学 2023-08-15 Xiangliang Kong

Erasure correcting codes are widely used to ensure data persistence in distributed storage systems. This paper addresses the simultaneous repair of multiple failures in such codes. We go beyond existing work (i.e., regenerating codes by…

信息论 · 计算机科学 2013-09-18 Anne-Marie Kermarrec , Gilles Straub , Nicolas Le Scouarnec