English
Related papers

Related papers: Coded Data Rebalancing for Distributed Data Storag…

200 papers

E-science applications may require huge amounts of data and high processing power where grid infrastructures are very suitable for meeting these requirements. The load distribution in a grid may vary leading to the bottlenecks and…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-10-11 Resat Umit Payli , Kayhan Erciyes , Orhan Dagdeviren

In cloud storage systems with a large number of servers, files are typically not stored in single servers. Instead, they are split, replicated (to ensure reliability in case of server malfunction) and stored in different servers. We analyze…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-07-09 Avishek Ghosh , Kannan Ramchandran

Coded distributed computing (CDC) introduced by Li et al. in 2015 offers an efficient approach to trade computing power to reduce the communication load in general distributed computing frameworks such as MapReduce. For the more general…

Information Theory · Computer Science 2019-01-24 Nicholas Woolsey , Rong-Rong Chen , Mingyue Ji

We consider a MapReduce-type task running in a distributed computing model which consists of ${K}$ edge computing nodes distributed across the edge of the network and a Master node that assists the edge nodes to compute output functions.…

Information Theory · Computer Science 2020-10-22 Haoning Chen , Youlong Wu

Placement delivery arrays for distributed computing (Comp-PDAs) have recently been proposed as a framework to construct universal computing schemes for MapReduce-like systems. In this work, we extend this concept to systems with straggling…

Information Theory · Computer Science 2020-04-28 Qifa Yan , Michèle Wigger , Sheng Yang , Xiaohu Tang

In large storage systems, files are often coded across several servers to improve reliability and retrieval speed. We study load balancing under the Batch Sampling routing scheme for a network of $n$ servers storing a set of files using the…

Probability · Mathematics 2017-07-10 Amarjit Budhiraja , Eric Friedlander

Replicating or caching popular content in memories distributed across the network is a technique to reduce peak network loads. Conventionally, the main performance gain of this caching was thought to result from making part of the requested…

Information Theory · Computer Science 2015-09-08 Mohammad Ali Maddah-Ali , Urs Niesen

Content distribution over networks is often achieved by using mirror sites that hold copies of files or portions thereof to avoid congestion and delay issues arising from excessive demands to a single location. Accordingly, there are…

Information Theory · Computer Science 2016-11-15 Shurui Huang , Aditya Ramamoorthy , Muriel Medard

A spatially distributed system contains a large amount of agents with limited sensing, data processing, and communication capabilities. Recent technological advances have opened up possibilities to deploy spatially distributed systems for…

Information Theory · Computer Science 2015-11-30 Cheng Cheng , Yingchun Jiang , Qiyu Sun

This thesis is concerned with the design of distributed algorithms for solving optimization problems. We consider networks where each node has exclusive access to a cost function, and design algorithms that make all nodes cooperate to find…

Optimization and Control · Mathematics 2013-12-03 João F. C. Mota

A fundamental challenge in large-scale networked systems viz., data centers and cloud networks is to distribute tasks to a pool of servers, using minimal instantaneous state information, while providing excellent delay performance. In this…

Probability · Mathematics 2018-09-07 Debankur Mukherjee

A new system model reflecting the clustered structure of distributed storage is suggested to investigate bandwidth requirements for repairing failed storage nodes. Large data centers with multiple racks/disks or local networks of storage…

Information Theory · Computer Science 2017-02-14 Jy-yong Sohn , Beongjun Choi , Sung Whan Yoon , Jaekyun Moon

Data load balancing is a challenging task in the P2P systems. Distributed hash table (DHT) abstraction, heterogeneous nodes, and non uniform distribution of objects are the reasons to cause load imbalance in structured P2P overlay networks.…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-02-16 Seyed Iman Mirrezaei , Javad Shahparian

Network codes designed specifically for distributed storage systems have the potential to provide dramatically higher storage efficiency for the same availability. One main challenge in the design of such codes is the exact repair problem:…

Information Theory · Computer Science 2011-09-02 Dimitris S. Papailiopoulos , Jianqiang Luo , Alexandros G. Dimakis , Cheng Huang , Jin Li

How can we optimally trade extra computing power to reduce the communication load in distributed computing? We answer this question by characterizing a fundamental tradeoff between computation and communication in distributed computing,…

Information Theory · Computer Science 2017-09-26 Songze Li , Mohammad Ali Maddah-Ali , Qian Yu , A. Salman Avestimehr

Coded Distributed Computing (CDC) introduced by Li et al. in 2015 offers an efficient approach to trade computing power to reduce the communication load in general distributed computing frameworks such as MapReduce and Spark. In particular,…

Information Theory · Computer Science 2020-07-23 Nicholas Woolsey , Rong-Rong Chen , Mingyue Ji

The distributed index coding problem is studied, whereby multiple messages are stored at different servers to be broadcast to receivers with side information. First, the existing composite coding scheme is enhanced for the centralized…

Information Theory · Computer Science 2017-01-24 Yucheng Liu , Parastoo Sadeghi , Fatemeh Arbabjolfaei , Young-Han Kim

We consider the setting of data storage across n nodes in a distributed manner. A data collector (DC) should be able to reconstruct the entire data by connecting to any k out of the n nodes and downloading all the data stored in them. When…

Information Theory · Computer Science 2009-09-05 Nihar B. Shah , K. V. Rashmi , P. Vijay Kumar , Kannan Ramchandran

The performance of distributed storage systems deployed on wide-area networks can be improved using weighted (majority) quorum systems instead of their regular variants due to the heterogeneous performance of the nodes. A significant…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-26 Hasan Heydari , Guthemberg Silvestre , Alysson Bessani

Load Balancing is a fundamental technology for scaling cloud infrastructure. It enables systems to distribute incoming traffic across backend servers using predefined algorithms such as round robin, weighted round robin, least connections,…

Networking and Internet Architecture · Computer Science 2025-05-14 Raju Singh