English
Related papers

Related papers: An Umbrella Converse for Data Exchange: Applied to…

200 papers

Data shuffling of training data among different computing nodes (workers) has been identified as a core element to improve the statistical performance of modern large-scale machine learning algorithms. Data shuffling is often considered as…

Information Theory · Computer Science 2020-01-15 Kai Wan , Daniela Tuninetti , Mingyue Ji , Giuseppe Caire , Pablo Piantanida

Distributed learning platforms for processing large scale data-sets are becoming increasingly prevalent. In typical distributed implementations, a centralized master node breaks the data-set into smaller batches for parallel processing…

Information Theory · Computer Science 2016-10-03 Mohamed Attia , Ravi Tandon

Data shuffling between distributed cluster of nodes is one of the critical steps in implementing large-scale learning algorithms. Randomly shuffling the data-set among a cluster of workers allows different nodes to obtain fresh data…

Information Theory · Computer Science 2018-01-08 Mohamed A. Attia , Ravi Tandon

This paper studies the shuffling phase in a distributed computing model with rate-limited links between nodes. Each node is connected to all other nodes via a noiseless broadcast link with a finite capacity. For this network, the shuffling…

Information Theory · Computer Science 2024-05-07 Shanuja Sasi , Onur Günlü

We consider the data shuffling problem in a distributed learning system, in which a master node is connected to a set of worker nodes, via a shared link, in order to communicate a set of files to the worker nodes. The master node has access…

Information Theory · Computer Science 2020-06-24 Adel Elmahdy , Soheil Mohajer

We consider the problem of data exchange by a group of closely-located wireless nodes. In this problem each node holds a set of packets and needs to obtain all the packets held by other nodes. Each of the nodes can broadcast the packets in…

Information Theory · Computer Science 2016-11-15 Salim El Rouayheb , Alex Sprintson , Parastoo Sadeghi

We consider a distributed computing framework where the distributed nodes have different communication capabilities, motivated by the heterogeneous networks in data centers and mobile edge computing systems. Following the structure of…

Information Theory · Computer Science 2019-08-20 Nishant Shakya , Fan Li , Jinyuan Chen

We consider a wireless distributed computing system, in which multiple mobile users, connected wirelessly through an access point, collaborate to perform a computation task. In particular, users communicate with each other via the access…

Information Theory · Computer Science 2017-05-09 Songze Li , Qian Yu , Mohammad Ali Maddah-Ali , A. Salman Avestimehr

This work studies a well-known shared-cache coded caching scenario where each cache can serve an arbitrary number of users, analyzing the case where there is some knowledge about such number of users (i.e., the topology) during the content…

Information Theory · Computer Science 2023-02-21 Emanuele Parrinello , Antonio Bazco-Nogueras , Petros Elia

A promising research area that has recently emerged, is on how to use index coding to improve the communication efficiency in distributed computing systems, especially for data shuffling in iterative computations. In this paper, we posit…

Information Theory · Computer Science 2018-05-04 Linqi Song , Christina Fragouli , Tianchu Zhao

Caching is an efficient way to reduce network traffic congestion during peak hours by storing some content at the users' local caches. For the shared-link network with end-user-caches, Maddah-Ali and Niesen proposed a two-phase coded…

Information Theory · Computer Science 2021-11-08 Kai Wan , Daniela Tuninetti , Mingyue Ji , Pablo Piantanida

Several network communication problems are highly related such as coded caching and distributed computation. The centralized coded caching focuses on reducing the network burden in peak times in a wireless network system and the coded…

Information Theory · Computer Science 2022-09-13 Min Xu , Zixiang Xu , Gennian Ge , Min-Qian Liu

We consider the "coded cooperative data exchange problem" for general graphs. In this problem, given a graph G=(V,E) representing clients in a broadcast network, each of which initially hold a (not necessarily disjoint) set of information…

Information Theory · Computer Science 2012-02-10 Mira Gonen , Michael Langberg

The work identifies the fundamental limits of coded caching when the K receiving users share {\Lambda}$\leq$ K helper-caches, each assisting an arbitrary number of different users. The main result is the derivation of the exact optimal…

Information Theory · Computer Science 2018-10-17 Emanuele Parrinello , Ayşe Ünsal , Petros Elia

We consider \emph{plurality consensus} in a network of $n$ nodes. Initially, each node has one of $k$ opinions. The nodes execute a (randomized) distributed protocol to agree on the plurality opinion (the opinion initially supported by the…

Data Structures and Algorithms · Computer Science 2016-02-04 Petra Berenbrink , Tom Friedetzky , Peter Kling , Frederik Mallmann-Trenn , Chris Wastell

We consider information theoretic secret key agreement and secure function computation by multiple parties observing correlated data, with access to an interactive public communication channel. Our main result is an upper bound on the…

Information Theory · Computer Science 2015-06-01 Himanshu Tyagi , Shun Watanabe

We consider the recently proposed Coded Distributed Computing (CDC) framework that leverages carefully designed redundant computations to enable coding opportunities that substantially reduce the communication load of distributed computing.…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-04 Mehrdad Kiamari , Chenwei Wang , A. Salman Avestimehr

In this paper, we study the information-theoretic converse for the index coding problem. We generalize the definition for the alignment chain, introduced by Maleki et al., to capture more flexible relations among interfering messages at…

Information Theory · Computer Science 2019-05-30 Yucheng Liu , Parastoo Sadeghi

Existing decentralized coded caching solutions cannot guarantee small loads in the general scenario with arbitrary file sizes and cache sizes. In this paper, we propose an optimization framework for decentralized coded caching in the…

Information Theory · Computer Science 2019-05-07 Qi Wang , Ying Cui , Sian Jin , Junni Zou , Chenglin Li , Hongkai Xiong

Content delivery networks often employ caching to reduce transmission rates from the central server to the end users. Recently, the technique of coded caching was introduced whereby coding in the caches and coded transmission signals from…

Information Theory · Computer Science 2016-02-16 Hooshang Ghasemi , Aditya Ramamoorthy
‹ Prev 1 2 3 10 Next ›