English
Related papers

Related papers: Improved Computation-Communication Trade-Off for C…

200 papers

A central issue of distributed computing systems is how to optimally allocate computing and storage resources and design data shuffling strategies such that the total execution time for computing and data shuffling is minimized. This is…

Information Theory · Computer Science 2021-02-03 Shu-Jie Cao , Lihui Yi , Haoning Chen , Youlong Wu

Distributed computing, in which a resource-intensive task is divided into subtasks and distributed among different machines, plays a key role in solving large-scale problems. Coded computing is a recently emerging paradigm where redundancy…

Information Theory · Computer Science 2023-03-15 Hoang Dau , Ryan Gabrys , Yu-Chih Huang , Chen Feng , Quang-Hung Luu , Eidah Alzahrani , Zahir Tari

Li {\it et al}. introduced coded distributed computing (CDC) scheme to reduce the communication load in general distributed computing frameworks such as MapReduce. They also proposed cascaded CDC schemes where each output function is…

Information Theory · Computer Science 2021-11-25 Jing Jiang , Lingxiao Qu

Distributed learning platforms for processing large scale data-sets are becoming increasingly prevalent. In typical distributed implementations, a centralized master node breaks the data-set into smaller batches for parallel processing…

Information Theory · Computer Science 2016-10-03 Mohamed Attia , Ravi Tandon

Several network communication problems are highly related such as coded caching and distributed computation. The centralized coded caching focuses on reducing the network burden in peak times in a wireless network system and the coded…

Information Theory · Computer Science 2022-09-13 Min Xu , Zixiang Xu , Gennian Ge , Min-Qian Liu

The paper presents an improved upper bound (achievability result) on the optimal tradeoff between Normalized Delivery Time (NDT) and computation load for distributed computing MapReduce systems in certain ranges of the parameters. The upper…

Signal Processing · Electrical Eng. & Systems 2026-01-21 Yue Bi , Michèle Wigger

This paper explores the multi-access distributed computing (MADC) model, a novel distributed computing framework where mapper and reducer nodes are distinct entities. Unlike traditional MapReduce frameworks, MADC leverages coding-theoretic…

Information Theory · Computer Science 2025-08-08 Shanuja Sasi , Onur Günlü

In cache-aided networks, the server populates the cache memories at the users during low-traffic periods, in order to reduce the delivery load during peak-traffic hours. In turn, there exists a fundamental trade-off between the delivery…

Information Theory · Computer Science 2019-03-15 Abdelrahman M. Ibrahim , Ahmed A. Zewail , Aylin Yener

We consider the problem of coded distributed computing where a large linear computational job, such as a matrix multiplication, is divided into $k$ smaller tasks, encoded using an $(n,k)$ linear code, and performed over $n$ distributed…

Information Theory · Computer Science 2019-06-25 Mohammad Vahid Jamali , Mahdi Soleymani , Hessam Mahdavifar

It is well known that load balancing and low delivery communication cost are two critical issues in mapping requests to servers in Content Delivery Networks (CDNs). However, the trade-off between these two performance metrics has not been…

Networking and Internet Architecture · Computer Science 2016-10-17 Mahdi Jafari Siavoshani , Seyed Pooya Shariatpanahi , Hamid Ghasemi , Ali Pourmiri

Coded computing has emerged as a promising framework for tackling significant challenges in large-scale distributed computing, including the presence of slow, faulty, or compromised servers. In this approach, each worker node processes a…

Machine Learning · Computer Science 2026-03-26 Parsa Moradi , Behrooz Tahmasebi , Mohammad Ali Maddah-Ali

Data shuffling is one of the fundamental building blocks for distributed learning algorithms, that increases the statistical gain for each step of the learning process. In each iteration, different shuffled data points are assigned by a…

Information Theory · Computer Science 2016-09-19 Mohamed Attia , Ravi Tandon

This paper studies the distributed linearly separable computation problem, which is a generalization of many existing distributed computing problems such as distributed gradient descent and distributed linear transform. In this problem, a…

Information Theory · Computer Science 2020-10-06 Kai Wan , Hua Sun , Mingyue Ji , Giuseppe Caire

Recent advances in electronics are enabling substantial processing to be performed at each node (robots, sensors) of a networked system. Local processing enables data compression and may mitigate measurement noise, but it is still slower…

Optimization and Control · Mathematics 2025-03-04 Luca Ballotta , Luca Schenato , Luca Carlone

Today's data centers have an abundance of computing resources, hosting server clusters consisting of as many as tens or hundreds of thousands of machines. To execute a complex computing task over a data center, it is natural to distribute…

Information Theory · Computer Science 2017-02-24 Qian Yu , Songze Li , Mohammad Ali Maddah-Ali , A. Salman Avestimehr

This paper formulates a distributed computation problem, where a master asks $N$ distributed workers to compute a linearly separable function. The task function can be expressed as $K_c$ linear combinations of $K$ messages, where each…

Information Theory · Computer Science 2021-10-26 Kai Wan , Hua Sun , Mingyue Ji , Giuseppe Caire

Consider a distributed computing system in which the worker nodes are connected over a shared wireless channel. Nodes can store a fraction of the data set over which computation needs to be carried out, and a Map-Shuffle-Reduce protocol is…

Information Theory · Computer Science 2018-10-29 Sukjong Ha , Jingjing Zhang , Osvaldo Simeone , Joonhyuk Kang

A critical challenge for modern system design is meeting the overwhelming performance, storage, and communication bandwidth demand of emerging applications within a tightly bound power budget. As both the time and power, hence the energy,…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-30 Ismail Akturk , Ulya R. Karpuzcu

Edge computing provides a cloud-like architecture where small-scale resources are distributed near the network edge, enabling applications on resource-constrained devices to offload latency-critical computations to these resources. While…

Performance · Computer Science 2026-01-13 Muhammad Danish Waseem , Ahmed Ali-Eldin

This paper investigates task-oriented communication for multi-device cooperative edge inference, where a group of distributed low-end edge devices transmit the extracted features of local samples to a powerful edge server for inference.…

Signal Processing · Electrical Eng. & Systems 2023-09-13 Jiawei Shao , Yuyi Mao , Jun Zhang