中文
相关论文

相关论文: Network Traffic Driven Storage Repair

200 篇论文

One of the design objectives in distributed storage system is the minimization of the data traffic during the repair of failed storage nodes. By repairing multiple failures simultaneously and cooperatively, further reduction of repair…

信息论 · 计算机科学 2015-03-20 Kenneth W. Shum , Yuchong Hu

We continue our study of regenerating codes in distributed storage systems where connections between the nodes are constrained by a graph. In this problem, the failed node downloads the information stored at a subset of vertices of the…

信息论 · 计算机科学 2022-11-03 Adway Patra , Alexander Barg

Diversity coding is a network restoration technique which offers near-hitless restoration, while other state-of-the art techniques are significantly slower. Furthermore, the extra spare capacity requirement of diversity coding is…

网络与互联网体系结构 · 计算机科学 2016-11-11 Serhat Nazim Avci , Ender Ayanoglu

The continuously increasing amount of digital data generated by today's society asks for better storage solutions. This survey looks at a new generation of coding techniques designed specifically for the needs of distributed networked…

分布式、并行与集群计算 · 计算机科学 2013-01-31 Anwitaman Datta , Frederique Oggier

Distributed storage systems for large-scale applications typically use replication for reliability. Recently, erasure codes were used to reduce the large storage overhead, while increasing data reliability. A main limitation of…

信息论 · 计算机科学 2014-05-06 Dimitris S. Papailiopoulos , Alexandros G. Dimakis

Distributed storage systems are mainly justified due to the limited amount of storage capacity and improving the reliability through distributing data over multiple storage nodes. On the other hand, it may happen the data is stored in…

信息论 · 计算机科学 2010-04-15 Soroush Akhlaghi , Abbas Kiani , Mohammad Reza Ghanavati

A major issue of locally repairable codes is their robustness. If a local repair group is not able to perform the repair process, this will result in increasing the repair cost. Therefore, it is critical for a locally repairable code to…

信息论 · 计算机科学 2019-04-09 Ali Tebbi , Terence H. Chan , Chi Wan Sung

Network codes designed specifically for distributed storage systems have the potential to provide dramatically higher storage efficiency for the same availability. One main challenge in the design of such codes is the exact repair problem:…

信息论 · 计算机科学 2011-09-02 Dimitris S. Papailiopoulos , Jianqiang Luo , Alexandros G. Dimakis , Cheng Huang , Jin Li

In the context of distributed storage systems, locally repairable codes have become important. In this paper we focus on codes that allow for multi-erasure pattern decoding with low computational effort. Different optimality requirements,…

信息论 · 计算机科学 2025-04-16 Margreta Kuijper , Julia Lieb , Diego Napp

In order to provide high data reliability, distributed storage systems disperse data with redundancy to multiple storage nodes. Regenerating codes is a new class of erasure codes to introduce redundancy for the purpose of improving the data…

信息论 · 计算机科学 2015-03-18 Kenneth W. Shum , Yuchong Hu

Repair performance in hierarchical data centers is often bottlenecked by cross-rack network transfer. Recent theoretical results show that the cross-rack repair traffic can be minimized through repair layering, whose idea is to partition a…

分布式、并行与集群计算 · 计算机科学 2017-09-18 Yuchong Hu , Xiaolu Li , Mi Zhang , Patrick P. C. Lee , Xiaoyang Zhang , Pan Zhou , Dan Feng

Distributed storage systems in the presence of a wiretapper are considered. A distributed storage system (DSS) is parameterized by three parameters (n, k,d), in which a file stored across n distributed nodes, can be recovered from any k out…

信息论 · 计算机科学 2016-11-17 Ravi Tandon , SaiDhiraj Amuru , T. Charles Clancy , R. Michael Buehrer

In distributed storage systems that employ erasure coding, the issue of minimizing the total {\it repair bandwidth} required to exactly regenerate a storage node after a failure arises. This repair bandwidth depends on the structure of the…

信息论 · 计算机科学 2011-06-10 Dimitris S. Papailiopoulos , Alexandros G. Dimakis

In this paper, we evaluate the efficacy, in a Hadoop setting, of two coding schemes, both possessing an inherent double replication of data. The two coding schemes belong to the class of regenerating and locally regenerating codes…

To recover simultaneous multiple failures in erasure coded storage systems, Patrick Lee et al introduce concurrent repair based minimal storage regenerating codes to reduce repair traffic. The architecture of this approach is simpler and…

信息论 · 计算机科学 2016-04-25 Huayu Zhang , Hui Li , Hanxu Hou , K. W. Shum , ShuoYen Robert Li

When there are multiple node failures in a distributed storage system, regenerating the failed storage nodes individually in a one-by-one manner is suboptimal as far as repair-bandwidth minimization is concerned. If data exchange among the…

信息论 · 计算机科学 2016-11-15 Kenneth W. Shum

Recently, the research on local repair codes is mainly confined to repair the failed nodes within each repair group. But if the extreme cases occur that the entire repair group has failed, the local code stored in the failed group need to…

信息论 · 计算机科学 2016-02-10 Jing Wang , Zhiyuan Yan , Hongmei Xie

Distributed storage systems provide large-scale reliable data storage services by spreading redundancy across a large group of storage nodes. In such a large system, node failures take place on a regular basis. When a storage node breaks…

分布式、并行与集群计算 · 计算机科学 2016-03-17 Yan Wang , Xunrui Yin , Dongsheng Wei , Xin Wang , Yucheng He

When a node in a distributed storage system fails, it needs to be promptly repaired to maintain system integrity. While typical erasure codes can provide a significant storage advantage over replication, they suffer from poor repair…

信息论 · 计算机科学 2018-07-10 Geonu Kim , Jungwoo Lee

We consider the complexities of repair algorithms for locally repairable codes and propose a class of codes that repair single node failures using addition operations only, or codes with addition based repair. We construct two families of…

信息论 · 计算机科学 2015-06-09 Han Mao Kiah , Son Hoang Dau , Wentu Song , Chau Yuen