English
Related papers

Related papers: Design and Optimization of Heterogeneous Coded Dis…

200 papers

Coded distributed computing (CDC) was introduced to greatly reduce the communication load for MapReduce computing systems. Such a system has $K$ nodes, $N$ input files, and $Q$ Reduce functions. Each input file is mapped by $r$ nodes and…

Information Theory · Computer Science 2023-07-11 Yingjie Cheng , Gaojun Luo , Xiwang Cao , Martianus Frederic Ezerman , San Ling

Coded distributed computing framework enables large-scale machine learning (ML) models to be trained efficiently in a distributed manner, while mitigating the straggler effect. In this work, we consider a multi-task assignment problem in a…

Information Theory · Computer Science 2019-05-21 Yuxuan Sun , Junlin Zhao , Sheng Zhou , Deniz Gündüz

This paper aims to characterize the memory-rate tradeoff for decentralized caching under nonuniform file popularity and size. We consider a recently proposed decentralized modified coded caching scheme (D-MCCS) and formulate the cache…

Information Theory · Computer Science 2023-06-27 Yong Deng , Min Dong

A centralized coded caching scheme has been proposed by Maddah-Ali and Niesen to reduce the worst-case load of a network consisting of a server with access to N files and connected through a shared link to K users, each equipped with a…

Information Theory · Computer Science 2017-07-25 Sian Jin , Ying Cui , Hui Liu , Giuseppe Caire

This paper studies the caching system of multiple cache-enabled users with random demands. Under nonuniform file popularity, we thoroughly characterize the optimal uncoded cache placement structure for the coded caching scheme (CCS).…

Information Theory · Computer Science 2022-07-28 Yong Deng , Min Dong

A coded distributed computing (CDC) system aims to reduce the communication load in the MapReduce framework. Such a system has $K$ nodes, $N$ input files, and $Q$ Reduce functions. Each input file is mapped by $r$ nodes and each Reduce…

Information Theory · Computer Science 2023-09-11 Yingjie Cheng , Gaojun Luo , Xiwang Cao , Martianus Frederic Ezerman , San Ling

Consider a distributed computing system in which the worker nodes are connected over a shared wireless channel. Nodes can store a fraction of the data set over which computation needs to be carried out, and a Map-Shuffle-Reduce protocol is…

Information Theory · Computer Science 2018-10-29 Sukjong Ha , Jingjing Zhang , Osvaldo Simeone , Joonhyuk Kang

We consider a distributed computing system in which a master node coordinates $N$ workers to evaluate a function over $n$ input files, where this function accepts general decomposition. In particular, we focus on the general case where the…

Information Theory · Computer Science 2026-04-21 Javad Maheri , K. K. Krishnan Namboodiri , Petros Elia

Collaborative mobile edge computing (MEC) has emerged as a promising paradigm to enable low-capability edge nodes to cooperatively execute computation-intensive tasks. However, straggling edge nodes (stragglers) significantly degrade the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-12 Houming Qiu , Kun Zhu , Dusit Niyato , Nguyen Cong Luong , Changyan Yi , Chen Dai

We consider a distributed computing framework where the distributed nodes have different communication capabilities, motivated by the heterogeneous networks in data centers and mobile edge computing systems. Following the structure of…

Information Theory · Computer Science 2019-08-20 Nishant Shakya , Fan Li , Jinyuan Chen

We study the joint minimization of communication and computation costs in distributed computing, where a master node coordinates $N$ workers to evaluate a function over a library of $n$ files. Assuming that the function is decomposed into…

Information Theory · Computer Science 2026-01-12 Javad Maheri , K. K. Krishnan Namboodiri , Petros Elia

In large-scale distributed computing clusters, such as Amazon EC2, there are several types of "system noise" that can result in major degradation of performance: bottlenecks due to limited communication bandwidth, latency due to straggler…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-21 Amirhossein Reisizadeh , Saurav Prakash , Ramtin Pedarsani , Amir Salman Avestimehr

We consider a network consisting of a file server connected through a shared link to a number of users, each equipped with a cache. Knowing the popularity distribution of the files, the goal is to optimally populate the caches such as to…

Information Theory · Computer Science 2017-06-23 Urs Niesen , Mohammad Ali Maddah-Ali

Recently, coding has been a useful technique to mitigate the effect of stragglers in distributed computing. However, coding in this context has been mainly explored under the assumption of homogeneous workers, although the real-world…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-02-18 DaeJin Kim , Hyegyeong Park , Junkyun Choi

Distributed computing has become a common approach for large-scale computation of tasks due to benefits such as high reliability, scalability, computation speed, and costeffectiveness. However, distributed computing faces critical issues…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-08-21 Jer Shyuan Ng , Wei Yang Bryan Lim , Nguyen Cong Luong , Zehui Xiong , Alia Asheralieva , Dusit Niyato , Cyril Leung , Chunyan Miao

We consider the classical coded caching problem as defined by Maddah-Ali and Niesen, where a server with a library of $N$ files of equal size is connected to $K$ users via a shared error-free link. Each user is equipped with a cache with…

Information Theory · Computer Science 2018-07-10 Sian Jin , Ying Cui , Hui Liu , Giuseppe Caire

Deploying Convolutional Neural Networks (CNNs) on resource-constrained devices necessitates efficient management of computational resources, often via distributed environments susceptible to latency from straggler nodes. This paper…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-09 Shuo Tan , Rui Liu , Xuesong Han , XianLei Long , Kai Wan , Linqi Song , Yong Li

Coded caching is an effective technique to reduce the redundant traffic in wireless networks. The existing coded caching schemes require the splitting of files into a possibly large number of subfiles, i.e., they perform coded subfile…

Information Theory · Computer Science 2019-02-06 Seyed Ali Saberali , Lutz Lampe , Ian Blake

As software may be used by multiple users, caching popular software at the wireless edge has been considered to save computation and communications resources for mobile edge computing (MEC). However, fetching uncached software from the core…

Information Theory · Computer Science 2020-05-07 Wanli Wen , Ying Cui , Tony Q. S. Quek , Fu-Chun Zheng , Shi Jin

We propose a flexible low complexity design (FLCD) of coded distributed computing (CDC) with empirical evaluation on Amazon Elastic Compute Cloud (Amazon EC2). CDC can expedite MapReduce like computation by trading increased map…

Information Theory · Computer Science 2020-08-14 Nicholas Woolsey , Xingyue Wang , Rong-Rong Chen , Mingyue Ji