English
Related papers

Related papers: A Fundamental Tradeoff Among Storage, Computation,…

200 papers

This paper develops coding techniques to reduce the running time of distributed learning tasks. It characterizes the fundamental tradeoff to compute gradients (and more generally vector summations) in terms of three parameters: computation…

Machine Learning · Statistics 2018-02-13 Min Ye , Emmanuel Abbe

We consider the distributed computing problem of multiplying a set of vectors with a matrix. For this scenario, Li et al. recently presented a unified coding framework and showed a fundamental tradeoff between computational delay and…

Information Theory · Computer Science 2017-09-19 Albin Severinson , Alexandre Graell i Amat , Eirik Rosnes

We consider the problem of geographically distributed data storage in a network of servers (or nodes) where the nodes are connected to each other via communication links having certain round-trip times (RTTs). Each node serves a specific…

Information Theory · Computer Science 2024-05-14 Srivathsa Acharya , P. Vijay Kumar , Viveck R. Cadambe

Maddah-Ali and Niesen's original coded caching scheme for shared-link broadcast networks is now known to be optimal to within a factor two, and has been applied to other types of networks. For practical reasons, this paper considers that a…

Information Theory · Computer Science 2018-04-06 Kai Wan , Mingyue Ji , Pablo Piantanida , Daniela Tuninetti

This paper introduces a federated learning framework that enables over-the-air computation via digital communications, using a new joint source-channel coding scheme. Without relying on channel state information at devices, this scheme…

Information Theory · Computer Science 2024-11-07 Seyed Mohammad Azimi-Abarghouyi , Lav R. Varshney

In a realistic distributed storage environment, storage nodes are usually placed in racks, a metallic support designed to accommodate electronic equipment. It is known that the communication (bandwidth) cost between nodes within a rack is…

Information Theory · Computer Science 2013-01-09 Bernat Gastón , Jaume Pujol , Mercè Villanueva

Inspired by prior work by Tian and by Cao and Xu, this paper presents an efficient computer-aided framework to characterize the fundamental limits of coded caching systems under the constraint of linear coding. The proposed framework…

Information Theory · Computer Science 2025-11-26 Niccolò Brembilla , Yinbin Ma , Pietro Belotti , Federico Malucelli , Daniela Tuninetti

This work studies a well-known shared-cache coded caching scenario where each cache can serve an arbitrary number of users, analyzing the case where there is some knowledge about such number of users (i.e., the topology) during the content…

Information Theory · Computer Science 2023-02-21 Emanuele Parrinello , Antonio Bazco-Nogueras , Petros Elia

In a distributed computing system operating according to the map-shuffle-reduce framework, coding data prior to storage can be useful both to reduce the latency caused by straggling servers and to decrease the inter-server communication…

Information Theory · Computer Science 2018-08-22 Jingjing Zhang , Osvaldo Simeone

The amount of digital data is rapidly growing. There is an increasing use of a wide range of computer systems, from mobile devices to large-scale data centers, and important for reliable operation of all computer systems is mitigating the…

Information Theory · Computer Science 2018-03-06 Katina Kralevska

This work aims to jointly optimize the coding and node selection to minimize the processing time for distributed computing tasks over wireless edge networks. Since the joint optimization problem formulation is NP-hard and nonlinear, we…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-11 Cong T. Nguyen , Diep N. Nguyen , Dinh Thai Hoang , Hoang-Anh Pham , Eryk Dutkiewicz

Replicating or caching popular content in memories distributed across the network is a technique to reduce peak network loads. Conventionally, the performance gain of caching was thought to result from making part of the requested data…

Information Theory · Computer Science 2015-01-13 Ajaykrishnan N. , Navya S. Prem , Vinod M. Prabhakaran , Rahul Vaze

A new system model reflecting the clustered structure of distributed storage is suggested to investigate interplay between storage overhead and repair bandwidth as storage node failures occur. Large data centers with multiple racks/disks or…

Information Theory · Computer Science 2018-05-02 Jy-yong Sohn , Beongjun Choi , Sung Whan Yoon , Jaekyun Moon

Coded caching utilizes proper file subpacketization and coded delivery to make full use of the multicast opportunities in content delivery, to alleviate file transfer load in massive content delivery scenarios. Most existing work considers…

Information Theory · Computer Science 2021-10-01 Jialing Liao , Olav Tirkkonen

Coded caching has been widely used in the wireless network for shifting the some transmissions during the peak traffic times to the off-peak traffic times. Multi-server coded caching, which can share responsibility for the total amount of…

Information Theory · Computer Science 2018-06-28 Minquan Cheng , Qiaoling Zhang , Jing Jiang , Reizhong Wei

Caching popular contents at the edge of cellular networks has been proposed to reduce the load, and hence the cost of backhaul links. It is significant to decide which files should be cached and where to cache them. In this paper, we…

Networking and Internet Architecture · Computer Science 2017-04-03 Shuo Wang , Xing Zhang , Kun Yang , Lin Wang , Wenbo Wang

Coded distributed computing has been considered as a promising technique which makes large-scale systems robust to the "straggler" workers. Yet, practical system models for distributed computing have not been available that reflect the…

Information Theory · Computer Science 2019-01-17 Muah Kim , Jy-yong Sohn , Jaekyun Moon

Codes are widely used in many engineering applications to offer robustness against noise. In large-scale systems there are several types of noise that can affect the performance of distributed machine learning algorithms -- straggler nodes,…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-01-30 Kangwook Lee , Maximilian Lam , Ramtin Pedarsani , Dimitris Papailiopoulos , Kannan Ramchandran

We consider the problem of coding over the multi-user Interference Channel (IC). It is well-known that aligning the interfering signals results in improved achievable rates in certain setups involving more than two users. We argue that in…

Information Theory · Computer Science 2016-02-18 F. Shirani , S. S. Pradhan

Coded caching has the potential to greatly reduce network traffic by leveraging the cheap and abundant storage available in end-user devices so as to create multicast opportunities in the delivery phase. In the seminal work by Maddah-Ali…

Information Theory · Computer Science 2020-01-13 Kai Wan , Hua Sun , Mingyue Ji , Daniela Tuninetti , Giuseppe Caire