English
Related papers

Related papers: Network Traffic Driven Storage Repair

200 papers

One of the design objectives in distributed storage system is the minimization of the data traffic during the repair of failed storage nodes. By repairing multiple failures simultaneously and cooperatively, further reduction of repair…

Information Theory · Computer Science 2015-03-20 Kenneth W. Shum , Yuchong Hu

We continue our study of regenerating codes in distributed storage systems where connections between the nodes are constrained by a graph. In this problem, the failed node downloads the information stored at a subset of vertices of the…

Information Theory · Computer Science 2022-11-03 Adway Patra , Alexander Barg

Diversity coding is a network restoration technique which offers near-hitless restoration, while other state-of-the art techniques are significantly slower. Furthermore, the extra spare capacity requirement of diversity coding is…

Networking and Internet Architecture · Computer Science 2016-11-11 Serhat Nazim Avci , Ender Ayanoglu

The continuously increasing amount of digital data generated by today's society asks for better storage solutions. This survey looks at a new generation of coding techniques designed specifically for the needs of distributed networked…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-01-31 Anwitaman Datta , Frederique Oggier

Distributed storage systems for large-scale applications typically use replication for reliability. Recently, erasure codes were used to reduce the large storage overhead, while increasing data reliability. A main limitation of…

Information Theory · Computer Science 2014-05-06 Dimitris S. Papailiopoulos , Alexandros G. Dimakis

Distributed storage systems are mainly justified due to the limited amount of storage capacity and improving the reliability through distributing data over multiple storage nodes. On the other hand, it may happen the data is stored in…

Information Theory · Computer Science 2010-04-15 Soroush Akhlaghi , Abbas Kiani , Mohammad Reza Ghanavati

A major issue of locally repairable codes is their robustness. If a local repair group is not able to perform the repair process, this will result in increasing the repair cost. Therefore, it is critical for a locally repairable code to…

Information Theory · Computer Science 2019-04-09 Ali Tebbi , Terence H. Chan , Chi Wan Sung

Network codes designed specifically for distributed storage systems have the potential to provide dramatically higher storage efficiency for the same availability. One main challenge in the design of such codes is the exact repair problem:…

Information Theory · Computer Science 2011-09-02 Dimitris S. Papailiopoulos , Jianqiang Luo , Alexandros G. Dimakis , Cheng Huang , Jin Li

In the context of distributed storage systems, locally repairable codes have become important. In this paper we focus on codes that allow for multi-erasure pattern decoding with low computational effort. Different optimality requirements,…

Information Theory · Computer Science 2025-04-16 Margreta Kuijper , Julia Lieb , Diego Napp

In order to provide high data reliability, distributed storage systems disperse data with redundancy to multiple storage nodes. Regenerating codes is a new class of erasure codes to introduce redundancy for the purpose of improving the data…

Information Theory · Computer Science 2015-03-18 Kenneth W. Shum , Yuchong Hu

Repair performance in hierarchical data centers is often bottlenecked by cross-rack network transfer. Recent theoretical results show that the cross-rack repair traffic can be minimized through repair layering, whose idea is to partition a…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-18 Yuchong Hu , Xiaolu Li , Mi Zhang , Patrick P. C. Lee , Xiaoyang Zhang , Pan Zhou , Dan Feng

Distributed storage systems in the presence of a wiretapper are considered. A distributed storage system (DSS) is parameterized by three parameters (n, k,d), in which a file stored across n distributed nodes, can be recovered from any k out…

Information Theory · Computer Science 2016-11-17 Ravi Tandon , SaiDhiraj Amuru , T. Charles Clancy , R. Michael Buehrer

In distributed storage systems that employ erasure coding, the issue of minimizing the total {\it repair bandwidth} required to exactly regenerate a storage node after a failure arises. This repair bandwidth depends on the structure of the…

Information Theory · Computer Science 2011-06-10 Dimitris S. Papailiopoulos , Alexandros G. Dimakis

In this paper, we evaluate the efficacy, in a Hadoop setting, of two coding schemes, both possessing an inherent double replication of data. The two coding schemes belong to the class of regenerating and locally regenerating codes…

To recover simultaneous multiple failures in erasure coded storage systems, Patrick Lee et al introduce concurrent repair based minimal storage regenerating codes to reduce repair traffic. The architecture of this approach is simpler and…

Information Theory · Computer Science 2016-04-25 Huayu Zhang , Hui Li , Hanxu Hou , K. W. Shum , ShuoYen Robert Li

When there are multiple node failures in a distributed storage system, regenerating the failed storage nodes individually in a one-by-one manner is suboptimal as far as repair-bandwidth minimization is concerned. If data exchange among the…

Information Theory · Computer Science 2016-11-15 Kenneth W. Shum

Recently, the research on local repair codes is mainly confined to repair the failed nodes within each repair group. But if the extreme cases occur that the entire repair group has failed, the local code stored in the failed group need to…

Information Theory · Computer Science 2016-02-10 Jing Wang , Zhiyuan Yan , Hongmei Xie

Distributed storage systems provide large-scale reliable data storage services by spreading redundancy across a large group of storage nodes. In such a large system, node failures take place on a regular basis. When a storage node breaks…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-03-17 Yan Wang , Xunrui Yin , Dongsheng Wei , Xin Wang , Yucheng He

When a node in a distributed storage system fails, it needs to be promptly repaired to maintain system integrity. While typical erasure codes can provide a significant storage advantage over replication, they suffer from poor repair…

Information Theory · Computer Science 2018-07-10 Geonu Kim , Jungwoo Lee

We consider the complexities of repair algorithms for locally repairable codes and propose a class of codes that repair single node failures using addition operations only, or codes with addition based repair. We construct two families of…

Information Theory · Computer Science 2015-06-09 Han Mao Kiah , Son Hoang Dau , Wentu Song , Chau Yuen