English
Related papers

Related papers: Linear Coding Schemes for the Distributed Computat…

200 papers

Coded caching aims to minimize the network's peak-time communication load by leveraging the information pre-stored in the local caches at the users. The original single file retrieval setting by Maddah-Ali and Niesen has been recently…

Information Theory · Computer Science 2021-02-04 Yinbin Ma , Daniela Tuninetti

We address the problem of distributed computation of arbitrary functions of two correlated sources $X_1$ and $X_2$, residing in two distributed source nodes, respectively. We exploit the structure of a computation task by coding source…

Information Theory · Computer Science 2025-04-23 Mohammad Reza Deylam Salehi , Derya Malak

Coded distributed batch computation distributes a computation task, such as matrix multiplication, $N$-linear computation, or multivariate polynomial evaluation, across $S$ servers through a coding scheme, such that the response from any…

Information Theory · Computer Science 2019-11-18 Zhuqing Jia , Syed A. Jafar

We introduce the new concept of computation coding. Similar to how rate-distortion theory is concerned with the lossy compression of data, computation coding deals with the lossy computation of functions. Particularizing to linear…

Information Theory · Computer Science 2021-02-02 Ralf Müller , Bernhard Gäde , Ali Bereyhi

This paper investigates distributed source-channel coding for correlated image semantic transmission over wireless channels. In this setup, correlated images at different transmitters are separately encoded and transmitted through dedicated…

Information Theory · Computer Science 2025-06-10 Yufei Bo , Meixia Tao , Kai Niu

We consider a system in which two nodes take correlated measurements of a random source with time-varying and unknown statistics. The observations of the source at the first node are to be losslessly replicated with a given probability of…

Information Theory · Computer Science 2016-10-27 Fangzhou Chen , Bin Li , Can Emre Koksal

This paper investigates the distributed computation of the well-known linear matrix equation in the form of $AXB = F$, with the matrices A, B, X, and F of appropriate dimensions, over multi-agent networks from an optimization perspective.…

Optimization and Control · Mathematics 2018-06-12 Xianlin Zeng , Shu Liang , Yiguang Hong , Jie Chen

Distributed computation is a framework used to break down a complex computational task into smaller tasks and distributing them among computational nodes. Erasure correction codes have recently been introduced and have become a popular…

Information Theory · Computer Science 2021-08-17 Royee Yosibash , Ram Zamir

Consider a pair of correlated Gaussian sources (X1,X2). Two separate encoders observe the two components and communicate compressed versions of their observations to a common decoder. The decoder is interested in reconstructing a linear…

Information Theory · Computer Science 2007-07-25 D. Krithivasan , S. S. Pradhan

We consider a wireless sensors network scenario where two nodes detect correlated sources and deliver them to a central collector via a wireless link. Differently from the Slepian-Wolf approach to distributed source coding, in the proposed…

Information Theory · Computer Science 2007-07-13 A. Abrardo

This paper formulates a distributed computation problem, where a master asks $N$ distributed workers to compute a linearly separable function. The task function can be expressed as $K_c$ linear combinations of $K$ messages, where each…

Information Theory · Computer Science 2021-10-26 Kai Wan , Hua Sun , Mingyue Ji , Giuseppe Caire

Subspace codes were introduced by K\"otter and Kschischang for error control in random linear network coding. In this paper, a layered type of subspace codes is considered, which can be viewed as a superposition of multiple component…

Information Theory · Computer Science 2012-09-14 Chao Chen , Hongmei Xie , Baoming Bai

We investigate linear network coding in the context of robust function computation, where a sink node is tasked with computing a target function of messages generated at multiple source nodes. In a previous work, a new distance measure was…

Information Theory · Computer Science 2024-09-18 Hengjia Wei , Min Xu , Gennian Ge

In the supervised learning domain, considering the recent prevalence of algorithms with high computational cost, the attention is steering towards simpler, lighter, and less computationally extensive training and inference approaches. In…

Machine Learning · Computer Science 2022-09-02 Antonello Rosato , Massimo Panella , Denis Kleyko

Machine learning algorithms are typically run on large scale, distributed compute infrastructure that routinely face a number of unavailabilities such as failures and temporary slowdowns. Adding redundant computations using coding-theoretic…

Machine Learning · Computer Science 2018-06-05 Jack Kosaian , K. V. Rashmi , Shivaram Venkataraman

This work addresses the problem of distributed computation of linearly separable functions, where a master node with access to $K$ datasets, employs $N$ servers to compute $L$ user-requested functions, each defined over the datasets.…

Information Theory · Computer Science 2025-09-30 K. K. Krishnan Namboodiri , Elizabath Peter , Derya Malak , Petros Elia

Straggler nodes are well-known bottlenecks of distributed matrix computations which induce reductions in computation/communication speeds. A common strategy for mitigating such stragglers is to incorporate Reed-Solomon based MDS (maximum…

Information Theory · Computer Science 2023-08-24 Anindya Bijoy Das , Aditya Ramamoorthy , David J. Love , Christopher G. Brinton

A large class of MDS linear codes is constructed. These codes are endowed with an efficient decoding algorithm. Both the definition of the codes and the design of their decoding algorithm only require from Linear Algebra methods, making…

Information Theory · Computer Science 2020-06-02 José Gómez-Torrecillas , Gabriel Navarro , José Patricio Sánchez-Hernández

In this paper, we investigate the problem of multi-user linearly decomposable function computation, where $N$ servers help compute functions for $K$ users, and where each such function can be expressed as a linear combination of $L$ basis…

Information Theory · Computer Science 2024-02-07 Ali Khalesi , Petros Elia

We generalize the leverage score sampling sketch for $\ell_2$-subspace embeddings, to accommodate sampling subsets of the transformed data, so that the sketching approach is appropriate for distributed settings. This is then used to derive…

Information Theory · Computer Science 2024-06-27 Neophytos Charalambides , Mert Pilanci , Alfred Hero