中文
相关论文

相关论文: Network Coding for Distributed Storage Systems

200 篇论文

Robust distributed storage systems dedicated to wireless sensor networks utilize several nodes to redundantly store sensed data so that when some storage nodes fail, the sensed data can still be reconstructed. For the same level of…

分布式、并行与集群计算 · 计算机科学 2011-06-16 Soji Omiwade , Rong Zheng

In a distributed storage systems (DSS), regenerating codes are used to optimize bandwidth in the repair process of a failed node. To optimize other DSS parameters such as computation and disk I/O, Distributed Replication-based Simple…

信息论 · 计算机科学 2013-03-28 Srijan Anil , Manish K. Gupta , T. Aaron Gulliver

This paper describes in detail how erasure codes are implemented in the Swarm system. First, in Section 1, we introduce erasure codes, and show how to apply them to files in Swarm (Section 2). In Section 3, we introduce security levels of…

网络与互联网体系结构 · 计算机科学 2024-09-04 Viktor Trón , Viktor Tóth , Callum Toner , Dan Nickless , Dániel A. Nagy , Áron Fischer , György Barabás

Cloud storage systems generally add redundancy in storing content files such that $K$ files are replicated or erasure coded and stored on $N > K$ nodes. In addition to providing reliability against failures, the redundant copies can be used…

Digital contents in large scale distributed storage systems may have different reliability and access delay requirements, and for this reason, erasure codes with different strengths need to be utilized to achieve the best storage…

信息论 · 计算机科学 2016-04-29 Chao Tian , Tie Liu

Erasure codes have been widely considered a promising solution to enhance data reliability at low storage costs. However, in modern geo-distributed storage systems, erasure codes may incur high data access latency as they require data…

信息论 · 计算机科学 2020-12-08 Kaiyang Liu , Jun Peng , Jingrong Wang , Jianping Pan

The paper is devoted to the problem of erasure coding in distributed storage. We consider a model of storage that assumes that nodes are organized into equally sized groups, called racks, that within each group the nodes can communicate…

信息论 · 计算机科学 2019-01-15 Zitan Chen , Alexander Barg

To recover simultaneous multiple failures in erasure coded storage systems, Patrick Lee et al introduce concurrent repair based minimal storage regenerating codes to reduce repair traffic. The architecture of this approach is simpler and…

信息论 · 计算机科学 2016-04-25 Huayu Zhang , Hui Li , Hanxu Hou , K. W. Shum , ShuoYen Robert Li

In a distributed storage network, reliability and bandwidth optimization can be provided by regenerating codes. Recently table based regenerating codes viz. DRESS (Distributed Replication-based Exact Simple Storage) codes has been proposed…

信息论 · 计算机科学 2013-02-18 Manish K Gupta , Anupam Agrawal , Deepak Yadav

We consider the design of regenerating codes for distributed storage systems that enjoy the property of local, exact and uncoded repair, i.e., (a) upon failure, a node can be regenerated by simply downloading packets from the surviving…

信息论 · 计算机科学 2013-05-27 Oktay Olmez , Aditya Ramamoorthy

Distributed storage systems are mainly justified due to the limited amount of storage capacity and improving the reliability through distributing data over multiple storage nodes. On the other hand, it may happen the data is stored in…

信息论 · 计算机科学 2010-04-15 Soroush Akhlaghi , Abbas Kiani , Mohammad Reza Ghanavati

MDS (maximum distance separable) array codes are widely used in storage systems due to their computationally efficient encoding and decoding procedures. An MDS code with r redundancy nodes can correct any r erasures by accessing (reading)…

信息论 · 计算机科学 2011-07-11 Zhiying Wang , Itzhak Tamo , Jehoshua Bruck

Regenerating codes are a class of codes for distributed storage networks that provide reliability and availability of data, and also perform efficient node repair. Another important aspect of a distributed storage network is its security.…

信息论 · 计算机科学 2015-03-19 Nihar B. Shah , K. V. Rashmi , P. Vijay Kumar

Distributed data storage systems are essential to deal with the need to store massive volumes of data. In order to make such a system fault-tolerant, some form of redundancy becomes crucial, incurring various overheads - most prominently in…

分布式、并行与集群计算 · 计算机科学 2011-12-25 Frederique Oggier , Anwitaman Datta

A network coding-based scheme is proposed to improve the energy efficiency of distributed storage systems in WSNs (wireless sensor networks), which mainly focuses on two problems: firstly, consideration is given to effective distributed…

网络与互联网体系结构 · 计算机科学 2013-04-08 Wang Lei , Yang Yuwang , Zhao Wei , Lu Wei

Scientific computing workflows generate enormous distributed data that is short-lived, yet critical for job completion time. This class of data is called intermediate data. A common way to achieve high data availability is to replicate…

分布式、并行与集群计算 · 计算机科学 2020-04-14 Zhe Zhang , Brian Bockelman , Derek Weitzel , David Swanson

Regenerating codes allow distributed storage systems to recover from the loss of a storage node while transmitting the minimum possible amount of data across the network. We present a systematic computer search for optimal systematic…

信息论 · 计算机科学 2009-10-14 Daniel Cullina , Alexandros G. Dimakis , Tracey Ho

Reliability in distributed storage systems has typically focused on the design and deployment of data replication or erasure coding techniques. Although some scenarios have considered the use of replication for hot data and erasure coding…

信息论 · 计算机科学 2025-11-04 Daniel E. Lucani , Marcell Fehér

Heterogeneous Distributed Storage Systems (DSS) are close to real world applications for data storage. Internet caching system and peer-to-peer storage clouds are the examples of such DSS. In this work, we calculate the capacity formula for…

信息论 · 计算机科学 2014-02-18 Krishna Gopal Benerjee , Manish Kumar Gupta

This paper studies the fundamental problem of data persistency for a general family of redundancy schemes in distributed storage systems, called replicated erasure codes. Namely, we analyze two strategies of replicated erasure codes…

分布式、并行与集群计算 · 计算机科学 2021-07-28 Roy Friedman , Rafał Kapelko , Karol Marchwicki