English
Related papers

Related papers: Cross Subspace Alignment Codes for Coded Distribut…

200 papers

This paper presents a hierarchical low-rank decomposition algorithm assuming any matrix element can be computed in $O(1)$ time. The proposed algorithm computes rank-revealing decompositions of sub-matrices with a blocked adaptive cross…

Numerical Analysis · Mathematics 2019-09-06 Yang Liu , Wissam Sid-Lakhdar , Elizaveta Rebrova , Pieter Ghysels , Xiaoye Sherry Li

We consider the distributed computing problem of multiplying a set of vectors with a matrix. For this scenario, Li et al. recently presented a unified coding framework and showed a fundamental tradeoff between computational delay and…

Information Theory · Computer Science 2017-09-19 Albin Severinson , Alexandre Graell i Amat , Eirik Rosnes

A new framework for interference alignment in secure and private information retrieval (PIR) from colluding servers is proposed, generalizing the original cross-subspace alignment (CSA) codes proposed by Jia, Sun, and Jafar. The general…

Information Theory · Computer Science 2024-05-29 Okko Makkonen , David Karpuk , Camilla Hollanti

Combinatorial Batch Codes (CBCs), replication-based variant of Batch Codes introduced by Ishai et al. in STOC 2004, abstracts the following data distribution problem: $n$ data items are to be replicated among $m$ servers in such a way that…

Discrete Mathematics · Computer Science 2015-02-10 Srimanta Bhattacharya

This paper studies the large-scale subspace clustering (LSSC) problem with million data points. Many popular subspace clustering methods cannot directly handle the LSSC problem although they have been considered as state-of-the-art methods…

Machine Learning · Computer Science 2020-04-10 Jun Li , Hongfu Liu , Zhiqiang Tao , Handong Zhao , Yun Fu

The problem of finding network codes for general connections is inherently difficult in capacity constrained networks. Resource minimization for general connections with network coding is further complicated. Existing methods for…

Information Theory · Computer Science 2016-07-05 Ying Cui , Muriel Médard , Fan Lai , Edmund Yeh , Douglas Leith , Ken Duffy , Dhaivat Pandya

Coded Distributed Computing (CDC) introduced by Li et al. in 2015 offers an efficient approach to trade computing power to reduce the communication load in general distributed computing frameworks such as MapReduce and Spark. In particular,…

Information Theory · Computer Science 2020-07-23 Nicholas Woolsey , Rong-Rong Chen , Mingyue Ji

We consider the recently proposed Coded Distributed Computing (CDC) framework that leverages carefully designed redundant computations to enable coding opportunities that substantially reduce the communication load of distributed computing.…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-04 Mehrdad Kiamari , Chenwei Wang , A. Salman Avestimehr

Polynomial based approaches, such as the Mat-Dot and entangled polynomial codes (EPC) have been used extensively within coded matrix computations to obtain schemes with good recovery thresholds. However, these schemes are well-recognized to…

Information Theory · Computer Science 2023-05-11 Kyungrak Son , Aditya Ramamoorthy

We consider the problem of coded computing, where a computational task is performed in a distributed fashion in the presence of adversarial workers. We propose techniques to break the adversarial toleration threshold barrier previously…

Information Theory · Computer Science 2021-08-23 Mahdi Soleymani , Ramy E. Ali , Hessam Mahdavifar , A. Salman Avestimehr

Unsupervised hashing methods typically aim to preserve the similarity between data points in a feature space by mapping them to binary hash codes. However, these methods often overlook the fact that the similarity between data points in the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Kam Woh Ng , Xiatian Zhu , Jiun Tian Hoe , Chee Seng Chan , Tianyu Zhang , Yi-Zhe Song , Tao Xiang

Coded caching is a technique that generalizes conventional caching and promises significant reductions in traffic over caching networks. However, the basic coded caching scheme requires that each file hosted in the server be partitioned…

Information Theory · Computer Science 2018-02-20 Li Tang , Aditya Ramamoorthy

Array codes have been widely used in communication and storage systems. To reduce computational complexity, one important property of the array codes is that only XOR operation is used in the encoding and decoding process. In this work, we…

Information Theory · Computer Science 2016-12-01 Hanxu Hou , Yunghsiang S. Han

In this paper, we present a coded computation (CC) scheme for distributed computation of the inference phase of machine learning (ML) tasks, specifically, the task of image classification. Building upon Agrawal et al.~2022, the proposed…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-07-12 Jiepeng Tang , Navneet Agrawal , Slawomir Stanczak , Jingge Zhu

Batch codes serve as critical tools for load balancing in distributed storage systems. While numerous constructions exist for specific batch sizes t, current methodologies predominantly rely on code dimension parameters, limiting their…

Information Theory · Computer Science 2025-04-29 Eldho K. Thomas

Deep subspace clustering (DSC) networks based on self-expressive model learn representation matrix, often implemented in terms of fully connected network, in the embedded space. After the learning is finished, representation matrix is used…

Computer Vision and Pattern Recognition · Computer Science 2024-01-31 Lovro Sindičić , Ivica Kopriva

Parallel tensor network contraction algorithms have emerged as the pivotal benchmarks for assessing the classical limits of computation, exemplified by Google's demonstration of quantum supremacy through random circuit sampling. However,…

Information Theory · Computer Science 2024-05-24 Jin Lee , Sofia Gonzalez-Garcia , Zheng Zhang , Haewon Jeong

Several network communication problems are highly related such as coded caching and distributed computation. The centralized coded caching focuses on reducing the network burden in peak times in a wireless network system and the coded…

Information Theory · Computer Science 2022-09-13 Min Xu , Zixiang Xu , Gennian Ge , Min-Qian Liu

Linear computation coding is concerned with the compression of multidimensional linear functions, i.e. with reducing the computational effort of multiplying an arbitrary vector to an arbitrary, but known, constant matrix. This paper…

Information Theory · Computer Science 2025-07-02 Hans Rosenberger , Johanna S. Fröhlich , Ali Bereyhi , Ralf R. Müller

This paper formulates a distributed computation problem, where a master asks $N$ distributed workers to compute a linearly separable function. The task function can be expressed as $K_c$ linear combinations of $K$ messages, where each…

Information Theory · Computer Science 2021-10-26 Kai Wan , Hua Sun , Mingyue Ji , Giuseppe Caire