English
Related papers

Related papers: Multi-Rack Distributed Data Storage Networks

200 papers

We consider a network consisting of a file server connected through a shared link to a number of users, each equipped with a cache. Knowing the popularity distribution of the files, the goal is to optimally populate the caches such as to…

Information Theory · Computer Science 2017-06-23 Urs Niesen , Mohammad Ali Maddah-Ali

Clustered distributed storage models real data centers where intra- and cross-cluster repair bandwidths are different. In this paper, exact-repair minimum-storage-regenerating (MSR) codes achieving capacity of clustered distributed storage…

Information Theory · Computer Science 2018-01-09 Jy-yong Sohn , Beongjun Choi , Jaekyun Moon

Batched network coding is a variation of random linear network coding which has low computational and storage costs. In order to adapt to random fluctuations in the number of erasures in individual batches, it is not optimal to recode and…

Information Theory · Computer Science 2021-09-16 Hoover H. F. Yin , Bin Tang , Ka Hei Ng , Shenghao Yang , Xishi Wang , Qiaoqiao Zhou

Today's data centers have an abundance of computing resources, hosting server clusters consisting of as many as tens or hundreds of thousands of machines. To execute a complex computing task over a data center, it is natural to distribute…

Information Theory · Computer Science 2017-02-24 Qian Yu , Songze Li , Mohammad Ali Maddah-Ali , A. Salman Avestimehr

Due to individual unreliable commodity components, failures are common in large-scale distributed storage systems. Erasure codes are widely deployed in practical storage systems to provide fault tolerance with low storage overhead. However,…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-15 Liangliang Xu , Min Lyu , Zhipeng Li , Yongkun Li , Yinlong Xu

We consider the setting of data storage across n nodes in a distributed manner. A data collector (DC) should be able to reconstruct the entire data by connecting to any k out of the n nodes and downloading all the data stored in them. When…

Information Theory · Computer Science 2009-09-05 Nihar B. Shah , K. V. Rashmi , P. Vijay Kumar , Kannan Ramchandran

We introduce a dynamical model of node repair in distributed storage systems wherein the storage nodes are subjected to failures according to independent Poisson processes. The main parameter that we study is the time-average capacity of…

Information Theory · Computer Science 2020-09-22 Ohad Elishco , Alexander Barg

Large-scale distributed storage systems typically use erasure codes to provide durability of data in the face of failures. A set of $k$ blocks to be stored is encoded using an $[n, k]$ code to generate $n$ blocks that are then stored on…

Information Theory · Computer Science 2019-07-31 Francisco Maturana , K. V. Rashmi

Distributed Hash Tables offer a resilient lookup service for unstable distributed environments. Resilient data storage, however, requires additional data replication and maintenance algorithms. These algorithms can have an impact on both…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Matthew Leslie

We consider a set up where a file of size M is stored in n distributed storage nodes, using an (n,k) minimum storage regenerating (MSR) code, i.e., a maximum distance separable (MDS) code that also allows efficient exact-repair of any…

Information Theory · Computer Science 2010-04-27 Viveck R. Cadambe , Syed A. Jafar , Hamed Maleki

Motivated by applications to delivery of dynamically updated, but correlated data in settings such as content distribution networks, and distributed file sharing systems, we study a single source multiple destination network coded multicast…

Information Theory · Computer Science 2018-05-02 Milad Mahdian , N. Prakash , Muriel Médard , Edmund Yeh

Adaptive model predictive control (MPC) robustly ensures safety while reducing uncertainty during operation. In this paper, a distributed version is proposed to deal with network systems featuring multiple agents and limited communication.…

Systems and Control · Electrical Eng. & Systems 2024-04-17 Anilkumar Parsi , Ahmed Aboudonia , Andrea Iannelli , John Lygeros , Roy S. Smith

In applications of distributed storage systems to distributed computing and implementation of key- value stores, the following property, usually referred to as consistency in computer science and engineering, is an important requirement: as…

Information Theory · Computer Science 2015-10-20 Zhiying Wang , Viveck R. Cadambe

In future content-centric networks, content is identified independently of its location. From an end-user's perspective, individual storage systems dissolve into a seemingly omnipresent structureless `storage fog'. Content should be…

Information Theory · Computer Science 2020-09-14 Joachim Neu , Muriel Médard

We consider the data shuffling problem in a distributed learning system, in which a master node is connected to a set of worker nodes, via a shared link, in order to communicate a set of files to the worker nodes. The master node has access…

Information Theory · Computer Science 2020-06-24 Adel Elmahdy , Soheil Mohajer

In this paper, we consider heterogeneous distributed storage systems (DSSs) having flexible reconstruction degree, where each node in the system has dynamic repair bandwidth and dynamic storage capacity. In particular, a data collector can…

Information Theory · Computer Science 2015-03-10 Krishna Gopal Benerjee , Manish K. Gupta

We consider the problem of geographically distributed data storage in a network of servers (or nodes) where the nodes are connected to each other via communication links having certain round-trip times (RTTs). Each node serves a specific…

Information Theory · Computer Science 2024-05-14 Srivathsa Acharya , P. Vijay Kumar , Viveck R. Cadambe

There have been emerging lots of applications for distributed storage systems e.g., those in wireless sensor networks or cloud storage. Since storage nodes in wireless sensor networks have limited battery, it is valuable to find a repair…

Information Theory · Computer Science 2013-01-31 Majid Gerami , Ming Xiao , Carlo Fischione , Mikael Skoglund

Maximum-distance-separable (MDS) codes are a class of erasure codes that are widely adopted to enhance the reliability of distributed storage systems (DSS). In (n, k) MDS coded DSS, the original data are stored into n distributed nodes in…

Information Theory · Computer Science 2017-06-16 Sheng Guan , Haibin Kan , Xin Wang

With the widespread use of shared-nothing clusters of servers, there has been a proliferation of distributed object stores that offer high availability, reliability and enhanced performance for MapReduce-style workloads. However, relational…

Databases · Computer Science 2013-12-03 Lukasz Golab , Marios Hadjieleftheriou , Howard Karloff , Barna Saha