English
Related papers

Related papers: Deterministic Data Distribution for Efficient Reco…

200 papers

This paper presents a novel coding scheme for distributed storage systems containing nodes with adversarial errors. The key challenge in such systems is the propagation of erroneous data from a single corrupted node to the rest of the…

Information Theory · Computer Science 2012-07-17 Natalia Silberstein , Ankit Singh Rawat , Sriram Vishwanath

We study how erasure coding can improve service reliability in Data Center Networks (DCN). To this end, we find that coding can be best deployed in systems, where i) traffic is split into multiple parallel sub-flows, ii) each sub-flow is…

Performance · Computer Science 2018-10-30 Anna Engelmann , Admela Jukan , Rastin Pries

A high number of electric vehicles (EVs) in the transportation sector necessitates an advanced scheduling framework for e-mobility ecosystem operation as a whole in order to overcome range anxiety and create a viable business model for…

Systems and Control · Electrical Eng. & Systems 2021-10-26 Mahsa Bagheri Tookanlou , S. Ali Pourmousavi , Mousa Marzband

Distributed storage systems introduce redundancy to protect data from node failures. After a storage node fails, the lost data should be regenerated at a replacement storage node as soon as possible to maintain the same level of redundancy.…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-06-19 Qingyuan Gong , Jiaqi Wang , Yan Wang , Dongsheng Wei , Jin Wang , Xin Wang

Distributed storage systems that deploy erasure codes can provide better features such as lower storage overhead and higher data reliability. In this paper, we focus on fractional repetition (FR) codes, which are a class of storage codes…

Information Theory · Computer Science 2020-05-15 Bing Zhu , Kenneth W. Shum , Hui Li

Data-driven Distributionally Robust Optimization (DD-DRO) via optimal transport has been shown to encompass a wide range of popular machine learning algorithms. The distributional uncertainty size is often shown to correspond to the…

Machine Learning · Statistics 2021-05-12 Jose Blanchet , Yang Kang , Fan Zhang , Fei He , Zhangyi Hu

A novel coding scheme for exact repair-regenerating codes is presented in this paper. The codes proposed in this work can trade between the repair bandwidth of nodes (number of downloaded symbols from each surviving node in a repair…

Information Theory · Computer Science 2021-01-05 Mehran Elyasi , Soheil Mohajer

In this paper, we consider heterogeneous distributed storage systems (DSSs) having flexible reconstruction degree, where each node in the system has dynamic repair bandwidth and dynamic storage capacity. In particular, a data collector can…

Information Theory · Computer Science 2015-03-10 Krishna Gopal Benerjee , Manish K. Gupta

In large scale distributed storage systems (DSS) deployed in cloud computing, correlated failures resulting in simultaneous failure (or, unavailability) of blocks of nodes are common. In such scenarios, the stored data or a content of a…

Information Theory · Computer Science 2017-02-22 Gokhan Calis , O. Ozan Koyluoglu

In this paper we study the problem of storing reliably an archive of versioned data. Specifically, we focus on systems where the differences (deltas) between subsequent versions rather than the whole objects are stored - a typical model for…

Information Theory · Computer Science 2014-11-19 J. Harshan , Frédérique Oggier , Anwitaman Datta

The high repair cost of (n,k) Maximum Distance Separable (MDS) erasure codes has recently motivated a new class of codes, called Regenerating Codes, that optimally trade off storage cost for repair bandwidth. On one end of this spectrum of…

Information Theory · Computer Science 2010-04-19 Changho Suh , Kannan Ramchandran

Data-intensive platforms such as Hadoop and Spark are routinely used to process massive amounts of data residing on distributed file systems like HDFS. Increasing memory sizes and new hardware technologies (e.g., NVRAM, SSDs) have recently…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-22 Herodotos Herodotou , Elena Kakoulli

In a distributed storage network, reliability and bandwidth optimization can be provided by regenerating codes. Recently table based regenerating codes viz. DRESS (Distributed Replication-based Exact Simple Storage) codes has been proposed…

Information Theory · Computer Science 2013-02-18 Manish K Gupta , Anupam Agrawal , Deepak Yadav

As storage systems grow in size, device failures happen more frequently than ever before. Given the commodity nature of hard drives employed, a storage system needs to tolerate a certain number of disk failures while maintaining data…

Information Theory · Computer Science 2014-05-20 Yan Wang , Xunrui Yin , Xin Wang

Regenerating codes enable trading off repair bandwidth for storage in distributed storage systems (DSS). Due to their distributed nature, these systems are intrinsically susceptible to attacks, and they may also be subject to multiple…

Information Theory · Computer Science 2014-07-10 O. Ozan Koyluoglu , Ankit Singh Rawat , Sriram Vishwanath

The rack-aware storage model improves repair efficiency by exploiting locality within racks to minimize cross-rack traffic in a distributed storage system. While the partially cooperative repair model presents a solution for multiple node…

Information Theory · Computer Science 2025-09-30 Hengming Zhao , Dianhua Wu , Minquan Cheng

Data redundancy techniques have been tested in several different applications to provide fault tolerance and performance gains. The use of these techniques is mostly seen at the hardware, device driver, or file system level. In practice,…

Cryptography and Security · Computer Science 2026-04-07 Ahmed Sharuvan , Ahmed Naufal Abdul Hadee

Cloud storage systems generally add redundancy in storing content files such that $K$ files are replicated or erasure coded and stored on $N > K$ nodes. In addition to providing reliability against failures, the redundant copies can be used…

In the context of distributed storage systems, locally repairable codes have become important. In this paper we focus on codes that allow for multi-erasure pattern decoding with low computational effort. Different optimality requirements,…

Information Theory · Computer Science 2025-04-16 Margreta Kuijper , Julia Lieb , Diego Napp

In distributed storage systems built using commodity hardware, it is necessary to have data redundancy in order to ensure system reliability. In such systems, it is also often desirable to be able to quickly repair storage nodes that fail.…

Information Theory · Computer Science 2012-01-24 Joseph C. Koo , John Gill