English
Related papers

Related papers: Tradeoff for Heterogeneous Distributed Storage Sys…

200 papers

Redundant storage maintains the performance of distributed systems under various forms of uncertainty. This paper considers the uncertainty in node access and download service. We consider two access models under two download service…

Information Theory · Computer Science 2021-08-09 Pei Peng , Moslem Noori , Emina Soljanin

Erasure codes have emerged as an efficient technology for providing data redundancy in distributed storage systems. However, it is a challenging task to repair the failed storage nodes in erasure-coded storage systems, which requires large…

Information Theory · Computer Science 2020-05-15 Bing Zhu , Kenneth W. Shum , Hui Li

It is well known that an (n,k) code can be used to store 'k' units of information in 'n' unit-capacity disks of a distributed data storage system. If the code used is maximum distance separable (MDS), then the system can tolerate any (n-k)…

Information Theory · Computer Science 2011-06-08 Viveck R. Cadambe , Cheng Huang , Syed A. Jafar , Jin Li

Solid state drives (SSDs) have seen wide deployment in mobiles, desktops, and data centers due to their high I/O performance and low energy consumption. As SSDs write data out-of-place, garbage collection (GC) is required to erase and…

Performance · Computer Science 2013-03-22 Yongkun Li , Patrick P. C. Lee , John C. S. Lui

Clustered distributed storage models real data centers where intra- and cross-cluster repair bandwidths are different. In this paper, exact-repair minimum-storage-regenerating (MSR) codes achieving capacity of clustered distributed storage…

Information Theory · Computer Science 2018-01-09 Jy-yong Sohn , Beongjun Choi , Jaekyun Moon

Regenerating codes (RCs) can significantly reduce the repair-bandwidth of distributed storage networks. Initially, the analysis of RCs was based on the assumption that during the repair process, the newcomer does not distinguish (among all…

Information Theory · Computer Science 2016-04-29 Imad Ahmad , Chih-Chun Wang

In this paper distributed storage systems with exact repair are studied. A construction for regenerating codes between the minimum storage regenerating (MSR) and the minimum bandwidth regenerating (MBR) points is given. To the best of…

Information Theory · Computer Science 2015-01-21 Toni Ernvall

Motivated by emerging applications to the edge computing paradigm, we introduce a two-layer erasure-coded fault-tolerant distributed storage system offering atomic access for read and write operations. In edge computing, clients interact…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-06-01 Kishori M. Konwar , N. Prakash , Nancy Lynch , Muriel Medard

We propose a generic transformation that can convert any nonbinary $(n=k+r,k)$ maximum distance separable (MDS) code into another $(n,k)$ MDS code over the same field such that 1) some arbitrarily chosen $r$ nodes have the optimal repair…

Information Theory · Computer Science 2018-08-24 Jie Li , Xiaohu Tang , Chao Tian

Battery Energy Storage Systems (BESS) can mitigate effects of intermittent energy production from renewable energy sources and play a critical role in peak shaving and demand charge management. To optimally size the BESS from an economic…

Optimization and Control · Mathematics 2017-03-01 Abdulelah H Habib , Vahid R. Disfani , Jan Kleissl , Raymond de Callafon

High availability of containerized applications requires to perform robust storage of applications' state. Since basic replication techniques are extremely costly at scale, storage space requirements can be reduced by means of erasure or…

Information Theory · Computer Science 2017-11-09 Francesco De Pellegrini , Rachid El Azouzi , Alonso Silva , and Olfa Hassani

In large scale distributed storage systems (DSS) deployed in cloud computing, correlated failures resulting in simultaneous failure (or, unavailability) of blocks of nodes are common. In such scenarios, the stored data or a content of a…

Information Theory · Computer Science 2017-02-22 Gokhan Calis , O. Ozan Koyluoglu

Storage allocation affects important performance measures of distributed storage systems. Most previous studies on the storage allocation consider its effect separately either on the success of the data recovery or on the service rate…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-17 Moslem Noori , Emina Soljanin , Masoud Ardakani

In this paper, we consider the setting of exact repair linear regenerating codes. Under this setting, we derive a new outer bound on the storage-repair-bandwidth trade-off for the case when $d = k = n -1$, where $(n, k, d)$ are parameters…

Information Theory · Computer Science 2015-01-27 N. Prakash , M. Nikhil Krishnan

In distributed storage systems that employ erasure coding, the issue of minimizing the total {\it communication} required to exactly rebuild a storage node after a failure arises. This repair bandwidth depends on the structure of the…

Information Theory · Computer Science 2011-06-09 Dimitris S. Papailiopoulos , Alexandros G. Dimakis , Viveck R. Cadambe

Repair operations in distributed storage systems potentially expose the data to malicious acts of passive eavesdroppers or active adversaries, which can be detrimental to the security of the system. This paper presents erasure codes and…

Information Theory · Computer Science 2015-08-18 Nihar B. Shah , K. V. Rashmi , Kannan Ramchandran , P. Vijay Kumar

Modern distributed storage systems apply redundancy coding techniques to stored data. One form of redundancy is based on regenerating codes, which can minimize the repair bandwidth, i.e., the amount of data transferred when repairing a…

Information Theory · Computer Science 2013-01-23 Yuchong Hu , Patrick P. C. Lee , Kenneth W. Shum

Distributed storage systems based on equidistant constant dimension codes are presented. These equidistant codes are based on the Pl\"{u}cker embedding, which is essential in the repair and the reconstruction algorithms. These systems…

Information Theory · Computer Science 2014-06-25 Netanel Raviv , Tuvi Etzion

Self-Repairing Codes (SRC) are codes designed to suit the need of coding for distributed networked storage: they not only allow stored data to be recovered even in the presence of node failures, they also provide a repair mechanism where as…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-05-03 Frederique Oggier , Anwitaman Datta

Binary maximum distance separable (MDS) array codes are a special class of erasure codes for distributed storage that not only provide fault tolerance with minimum storage redundancy but also achieve low computational complexity. They are…

Information Theory · Computer Science 2019-06-24 Hanxu Hou , Yunghsiang Han , Patrick P. C. Lee , Yuchong Hu , Hui Li