English
Related papers

Related papers: Cross Subspace Alignment Codes for Coded Distribut…

200 papers

Cross-subspace alignment (CSA) codes are used in various private information retrieval (PIR) schemes (e.g., with secure storage) and in secure distributed batch matrix multiplication (SDBMM). Using a recently developed $N$-sum box…

Information Theory · Computer Science 2025-09-26 Yuxiang Lu , Syed Ali Jafar

A secure multi-party batch matrix multiplication problem (SMBMM) is considered, where the goal is to allow a master to efficiently compute the pairwise products of two batches of massive matrices, by distributing the computation across S…

Information Theory · Computer Science 2020-09-08 Zhen Chen , Zhuqing Jia , Zhiying Wang , Syed A. Jafar

A majority of coded matrix-matrix computation literature has broadly focused in two directions: matrix partitioning for computing a single computation task and batch processing of multiple distinct computation tasks. While these works…

Information Theory · Computer Science 2022-01-04 Lev Tauz , Lara Dolecek

Subspace codes were introduced by K\"otter and Kschischang for error control in random linear network coding. In this paper, a layered type of subspace codes is considered, which can be viewed as a superposition of multiple component…

Information Theory · Computer Science 2012-09-14 Chao Chen , Hongmei Xie , Baoming Bai

In distributed matrix multiplication, a common scenario is to assign each worker a fraction of the multiplication task, by partitioning the input matrices into smaller submatrices. In particular, by dividing two input matrices into…

Information Theory · Computer Science 2020-04-14 Qian Yu , A. Salman Avestimehr

Coded distributed computing (CDC) is a new technique proposed with the purpose of decreasing the intense data exchange required for parallelizing distributed computing systems. Under the famous MapReduce paradigm, this coded approach has…

Information Theory · Computer Science 2022-06-28 Federico Brunero , Petros Elia

Lagrange coded computation (LCC) is essential to solving problems about matrix polynomials in a coded distributed fashion; nevertheless, it can only solve the problems that are representable as matrix polynomials. In this paper, we propose…

Information Theory · Computer Science 2022-05-23 Navneet Agrawal , Yuqin Qiu , Matthias Frey , Igor Bjelakovic , Setareh Maghsudi , Slawomir Stanczak , Jingge Zhu

Let $X_1, ..., X_m$ be a set of $m$ statistically dependent sources over the common alphabet $\mathbb{F}_q$, that are linearly independent when considered as functions over the sample space. We consider a distributed function computation…

Information Theory · Computer Science 2016-11-17 V. Lalitha , N. Prakash , K. Vinodh , P. Vijay Kumar , S. Sandeep Pradhan

Matrix multiplication is a fundamental building block for large scale computations arising in various applications, including machine learning. There has been significant recent interest in using coding to speed up distributed matrix…

Information Theory · Computer Science 2019-05-17 Wei-Ting Chang , Ravi Tandon

Coded distributed computing was recently introduced to mitigate the effect of stragglers on distributed computing. This paper combines ideas of approximate computing with coded computing to further accelerate computation. We propose…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-11 Shahrzad Kiani , Stark C. Draper

We consider the problem of coded distributed computing where a large linear computational job, such as a matrix multiplication, is divided into $k$ smaller tasks, encoded using an $(n,k)$ linear code, and performed over $n$ distributed…

Information Theory · Computer Science 2019-06-25 Mohammad Vahid Jamali , Mahdi Soleymani , Hessam Mahdavifar

Tensor operations, such as matrix multiplication, are central to large-scale machine learning applications. For user-driven tasks these operations can be carried out on a distributed computing platform with a master server at the user side…

Information Theory · Computer Science 2019-01-24 Malihe Aliasgari , Osvaldo Simeone , Joerg Kliewer

We consider the problem of coded distributed computing where a large linear computational job, such as a matrix multiplication, is divided into $k$ smaller tasks, encoded using an $(n,k)$ linear code, and performed over $n$ distributed…

Information Theory · Computer Science 2021-10-06 Mahdi Soleymani , Mohammad Vahid Jamali , Hessam Mahdavifar

In an application, where a client wants to obtain many elements from a large database, it is often desirable to have some load balancing. Batch codes (introduced by Ishai et al. in STOC 2004) make it possible to do exactly that: the large…

Information Theory · Computer Science 2014-04-11 Helger Lipmaa , Vitaly Skachek

Coded computing is a distributed paradigm that uses coding theory to introduce \textit{redundancy} and overcome bottlenecks in large-scale systems. In the same vein, randomized numerical linear algebra employs probabilistic methods to…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-19 Neophytos Charalambides , Arya Mazumdar

Coding theoretic approached have been developed to significantly reduce the communication load in modern distributed computing system. In particular, coded distributed computing (CDC) introduced by Li et al. can efficiently trade…

Information Theory · Computer Science 2020-08-04 Nicholas Woolsey , Rong-Rong Chen , Mingyue Ji

Distributed computing frameworks such as MapReduce and Spark are often used to process large-scale data computing jobs. In wireless scenarios, exchanging data among distributed nodes would seriously suffer from the communication bottleneck…

Information Theory · Computer Science 2023-10-25 Youlong Wu , Zhenhao Huang , Kai Yuan , Shuai Ma , Yue Bi

We show that polynomial codes (and some related codes) used for distributed matrix multiplication are interleaved Reed-Solomon codes and, hence, can be collaboratively decoded. We consider a fault tolerant setup where $t$ worker nodes…

Information Theory · Computer Science 2019-06-03 Adarsh M. Subramaniam , Anoosheh Heiderzadeh , Krishna R. Narayanan

Communication overhead is one of the major performance bottlenecks in large-scale distributed computing systems, in particular for machine learning applications. Conventionally, compression techniques are used to reduce the load of…

Information Theory · Computer Science 2018-05-08 Songze Li , Mohammad Ali Maddah-Ali , A. Salman Avestimehr

Chunked codes are efficient random linear network coding (RLNC) schemes with low computational cost, where the input packets are encoded into small chunks (i.e., subsets of the coded packets). During the network transmission, RLNC is…

Information Theory · Computer Science 2015-03-27 Bin Tang , Shenghao Yang , Baoliu Ye , Yitong Yin , Sanglu Lu
‹ Prev 1 2 3 10 Next ›