English
Related papers

Related papers: On Batch-Processing Based Coded Computing for Hete…

200 papers

Coded distributed computing (CDC) introduced by Li et. al. is an effective technique to trade computation load for communication load in a MapReduce framework. CDC achieves an optimal trade-off by duplicating map computations at $r$…

Information Theory · Computer Science 2019-03-04 Nicholas Woolsey , Rong-Rong Chen , Mingyue Ji

Coded distributed computing (CDC) introduced by Li et al. in 2015 offers an efficient approach to trade computing power to reduce the communication load in general distributed computing frameworks such as MapReduce. For the more general…

Information Theory · Computer Science 2019-01-24 Nicholas Woolsey , Rong-Rong Chen , Mingyue Ji

We consider the recently proposed Coded Distributed Computing (CDC) framework that leverages carefully designed redundant computations to enable coding opportunities that substantially reduce the communication load of distributed computing.…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-04 Mehrdad Kiamari , Chenwei Wang , A. Salman Avestimehr

Coded Distributed Computing (CDC) introduced by Li et al. in 2015 offers an efficient approach to trade computing power to reduce the communication load in general distributed computing frameworks such as MapReduce and Spark. In particular,…

Information Theory · Computer Science 2020-07-23 Nicholas Woolsey , Rong-Rong Chen , Mingyue Ji

Communication overhead is one of the major performance bottlenecks in large-scale distributed computing systems, in particular for machine learning applications. Conventionally, compression techniques are used to reduce the load of…

Information Theory · Computer Science 2018-05-08 Songze Li , Mohammad Ali Maddah-Ali , A. Salman Avestimehr

Coded distributed computing (CDC) is a new technique proposed with the purpose of decreasing the intense data exchange required for parallelizing distributed computing systems. Under the famous MapReduce paradigm, this coded approach has…

Information Theory · Computer Science 2022-06-28 Federico Brunero , Petros Elia

Coding theoretic approached have been developed to significantly reduce the communication load in modern distributed computing system. In particular, coded distributed computing (CDC) introduced by Li et al. can efficiently trade…

Information Theory · Computer Science 2020-08-04 Nicholas Woolsey , Rong-Rong Chen , Mingyue Ji

A central issue of distributed computing systems is how to optimally allocate computing and storage resources and design data shuffling strategies such that the total execution time for computing and data shuffling is minimized. This is…

Information Theory · Computer Science 2021-02-03 Shu-Jie Cao , Lihui Yi , Haoning Chen , Youlong Wu

Distributed computing has become a common approach for large-scale computation of tasks due to benefits such as high reliability, scalability, computation speed, and costeffectiveness. However, distributed computing faces critical issues…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-08-21 Jer Shyuan Ng , Wei Yang Bryan Lim , Nguyen Cong Luong , Zehui Xiong , Alia Asheralieva , Dusit Niyato , Cyril Leung , Chunyan Miao

Distributed computing is known as an emerging and efficient technique to support various intelligent services, such as large-scale machine learning. However, privacy leakage and random delays from straggling servers pose significant…

Information Theory · Computer Science 2023-10-31 Qicheng Zeng , Zhaojun Nan , Sheng Zhou

To improve the utility of learning applications and render machine learning solutions feasible for complex applications, a substantial amount of heavy computations is needed. Thus, it is essential to delegate the computations among several…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-04-29 Homa Esfahanizadeh , Alejandro Cohen , Muriel Medard

In distributed computing systems slow working nodes, known as stragglers, can greatly extend finishing times. Coded computing is a technique that enables straggler-resistant computation. Most coded computing techniques presented to date…

Information Theory · Computer Science 2021-02-02 Shahrzad Kiani , Nuwan Ferdinand , Stark C. Draper

In large-scale distributed computing clusters, such as Amazon EC2, there are several types of "system noise" that can result in major degradation of performance: bottlenecks due to limited communication bandwidth, latency due to straggler…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-21 Amirhossein Reisizadeh , Saurav Prakash , Ramtin Pedarsani , Amir Salman Avestimehr

This paper studies MapReduce-based heterogeneous coded distributed computing (CDC) where, besides different computing capabilities at workers, input files to be accessed by computing jobs have nonuniform popularity. We propose a file…

Information Theory · Computer Science 2024-10-22 Yong Deng , Min Dong

Li {\it et al}. introduced coded distributed computing (CDC) scheme to reduce the communication load in general distributed computing frameworks such as MapReduce. They also proposed cascaded CDC schemes where each output function is…

Information Theory · Computer Science 2021-11-25 Jing Jiang , Lingxiao Qu

Coded distributed computing (CDC), proposed by Li \emph{et al.}, offers significant potential for reducing the communication load in MapReduce computing systems. In cascaded CDC with $K$ nodes, $N$ input files, and $Q$ output functions,…

Information Theory · Computer Science 2025-01-24 Mingming Zhang , Youlong Wu , Minquan Cheng , Dianhua Wu

Distributed computing frameworks such as MapReduce and Spark are often used to process large-scale data computing jobs. In wireless scenarios, exchanging data among distributed nodes would seriously suffer from the communication bottleneck…

Information Theory · Computer Science 2023-10-25 Youlong Wu , Zhenhao Huang , Kai Yuan , Shuai Ma , Yue Bi

Collaborative mobile edge computing (MEC) has emerged as a promising paradigm to enable low-capability edge nodes to cooperatively execute computation-intensive tasks. However, straggling edge nodes (stragglers) significantly degrade the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-12 Houming Qiu , Kun Zhu , Dusit Niyato , Nguyen Cong Luong , Changyan Yi , Chen Dai

In a large-scale distributed machine learning system, coded computing has attracted wide-spread attention since it can effectively alleviate the impact of stragglers. However, several emerging problems greatly limit the performance of coded…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-10 Houming Qiu , Kun Zhu , Nguyen Cong Luong , Dusit Niyato

Coded distributed computing (CDC) introduced by Li \emph{et al.} can greatly reduce the communication load for MapReduce computing systems. In the general cascaded CDC with $K$ workers, $N$ input files and $Q$ Reduce functions, each input…

Information Theory · Computer Science 2023-11-22 Minquan Cheng , Youlong Wu , Xianxian Li , Dianhua Wu
‹ Prev 1 2 3 10 Next ›