English
Related papers

Related papers: Cascaded Coded Distributed Computing on Heterogene…

200 papers

We propose a flexible low complexity design (FLCD) of coded distributed computing (CDC) with empirical evaluation on Amazon Elastic Compute Cloud (Amazon EC2). CDC can expedite MapReduce like computation by trading increased map…

Information Theory · Computer Science 2020-08-14 Nicholas Woolsey , Xingyue Wang , Rong-Rong Chen , Mingyue Ji

Consider a multi-cell mobile edge computing network, in which each user wishes to compute the product of a user-generated data matrix with a network-stored matrix. This is done through task offloading by means of input uploading,…

Information Theory · Computer Science 2021-01-19 Kuikui Li , Meixia Tao , Jingjing Zhang , Osvaldo Simeone

MapReduce is a commonly used framework for executing data-intensive jobs on distributed server clusters. We introduce a variant implementation of MapReduce, namely "Coded MapReduce", to substantially reduce the inter-server communication…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-12-08 Songze Li , Mohammad Ali Maddah-Ali , A. Salman Avestimehr

With the advent of the modern mobile traffic, e.g., online gaming, augmented reality delivery and etc., a novel bidirectional computation task model where the input data of each task consists of two parts, one generated at the mobile device…

Information Theory · Computer Science 2020-01-14 Yaping Sun , Lyutianyang Zhang , Zhiyong Chen , Sumit Roy

Coded distributed computing framework enables large-scale machine learning (ML) models to be trained efficiently in a distributed manner, while mitigating the straggler effect. In this work, we consider a multi-task assignment problem in a…

Information Theory · Computer Science 2019-05-21 Yuxuan Sun , Junlin Zhao , Sheng Zhou , Deniz Gündüz

Performance of distributed graph processing systems significantly suffers from 'communication bottleneck' as a large number of messages are exchanged among servers at each step of the computation. Motivated by graph based MapReduce, we…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-11 Saurav Prakash , Amirhossein Reisizadeh , Ramtin Pedarsani , Amir Salman Avestimehr

Distributed computing enables large-scale computation tasks to be processed over multiple workers in parallel. However, the randomness of communication and computation delays across workers causes the straggler effect, which may degrade the…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-07-20 Yuxuan Sun , Fan Zhang , Junlin Zhao , Sheng Zhou , Zhisheng Niu , Deniz Gündüz

The emergence of intelligent applications and recent advances in the fields of computing and networks are driving the development of computing and networks convergence (CNC) system. However, existing researches failed to achieve…

Networking and Internet Architecture · Computer Science 2024-02-06 Yujiao Hu , Qingmin Jia , Meng Shen , Renchao Xie , Tao Huang , F. Richard Yu

In this paper, we consider a hierarchical distributed multi-task learning (MTL) system where distributed users wish to jointly learn different models orchestrated by a central server with the help of a layer of multiple relays. Since the…

Information Theory · Computer Science 2022-12-19 Haoyang Hu , Songze Li , Minquan Cheng , Youlong Wu

In this paper, we propose a new coding scheme and establish new bounds on the capacity region for the multi-sender unicast index-coding problem. We revisit existing partitioned Distributed Composite Coding (DCC) proposed by Sadeghi et al.…

Information Theory · Computer Science 2018-09-07 Min Li , Lawrence Ong , Sarah J. Johnson

Large scale clusters leveraging distributed computing frameworks such as MapReduce routinely process data that are on the orders of petabytes or more. The sheer size of the data precludes the processing of the data on a single computer. The…

Information Theory · Computer Science 2018-02-12 Konstantinos Konstantinidis , Aditya Ramamoorthy

In this work, a heterogeneous set of wireless devices sharing a common access point collaborates to perform a set of tasks. Using the Map-Reduce distributed computing framework, the tasks are optimally distributed amongst the nodes with the…

Signal Processing · Electrical Eng. & Systems 2019-03-07 Antoine Paris , Hamed Mirghasemi , Ivan Stupia , Luc Vandendorpe

Network coding is known to improve the throughput and the resilience to losses in most network scenarios. In a practical network scenario, however, the accurate modeling of the traffic is often too complex and/or infeasible. The goal is…

Information Theory · Computer Science 2009-08-25 Anoosheh Heidarzadeh , Amir H. Banihashemi

The emerging large-scale and data-hungry algorithms require the computations to be delegated from a central server to several worker nodes. One major challenge in the distributed computations is to tackle delays and failures caused by the…

Information Theory · Computer Science 2021-03-03 Alejandro Cohen , Guillaume Thiran , Homa Esfahanizadeh , Muriel Médard

Coded caching is a recently proposed technique for dealing with large scale content distribution over the Internet. As in conventional caching, it leverages the presence of local caches at the end users. However, it considers coding in the…

Information Theory · Computer Science 2016-05-06 Li Tang , Aditya Ramamoorthy

Distributed computing networks, tasked with both packet transmission and processing, require the joint optimization of communication and computation resources. We develop a dynamic control policy that determines both routes and processing…

Networking and Internet Architecture · Computer Science 2019-06-26 Jianan Zhang , Abhishek Sinha , Jaime Llorca , Antonia Tulino , Eytan Modiano

Content delivery networks store information distributed across multiple servers, so as to balance the load and avoid unrecoverable losses in case of node or disk failures. Coded caching has been shown to be a useful technique which can…

Information Theory · Computer Science 2016-11-22 Tianqiong Luo , Vaneet Aggarwal , Borja Peleato

Several network communication problems are highly related such as coded caching and distributed computation. The centralized coded caching focuses on reducing the network burden in peak times in a wireless network system and the coded…

Information Theory · Computer Science 2022-09-13 Min Xu , Zixiang Xu , Gennian Ge , Min-Qian Liu

Distributed computing platforms typically assume the availability of reliable and dedicated connections among the processors. This work considers an alternative scenario, relevant for wireless data centers and federated learning, in which…

Information Theory · Computer Science 2019-01-17 Sukjong Ha , Jingjing Zhang , Osvaldo Simeone , Joonhyuk Kang

In order to better accommodate the dramatically increasing demand for data caching and computing services, storage and computation capabilities should be endowed to some of the intermediate nodes within the network. In this paper, we design…

Networking and Internet Architecture · Computer Science 2017-06-30 Yuchen Zhou , F. Richard Yu , Jian Chen , Yonghong Kuo