English
Related papers

Related papers: Subspace-Aware Index Codes

200 papers

Matrix computations are a fundamental building-block of edge computing systems, with a major recent uptick in demand due to their use in AI/ML training and inference procedures. Existing approaches for distributing matrix computations…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-12 Anindya Bijoy Das , Aditya Ramamoorthy , David J. Love , Christopher G. Brinton

Index structures are important for efficient data access, which have been widely used to improve the performance in many in-memory systems. Due to high in-memory overheads, traditional index structures become difficult to process the…

Databases · Computer Science 2019-05-16 Pengfei Li , Yu Hua , Pengfei Zuo , Jingnan Jia

We study the following one-way asymmetric transmission problem, also a variant of model-based compressed sensing: a resource-limited encoder has to report a small set $S$ from a universe of $N$ items to a more powerful decoder (server). The…

Data Structures and Algorithms · Computer Science 2018-07-30 Alexandr Andoni , Javad Ghaderi , Daniel Hsu , Dan Rubenstein , Omri Weinstein

Data compression is an efficient technique to save data storage and transmission costs. However, traditional data compression methods always ignore the impact of user preferences on the statistical distributions of symbols transmitted over…

Information Theory · Computer Science 2019-04-01 Yawei Lu , Wei Chen , H. Vincent Poor

In linear optimization, matrix structure can often be exploited algorithmically. However, beneficial presolving reductions sometimes destroy the special structure of a given problem. In this article, we discuss structure-aware…

Optimization and Control · Mathematics 2019-08-05 Ambros Gleixner , Nils-Christian Kempke , Thorsten Koch , Daniel Rehfeldt , Svenja Uslu

Recent work on approximate quantum error correction (QEC) has opened up the possibility of constructing subspace codes that protect information with high fidelity in scenarios where perfect error correction is impossible. Motivated by this,…

Quantum Physics · Physics 2012-07-31 Prabha Mandayam , Hui Khoon Ng

Sparse coding approximates the data sample as a sparse linear combination of some basic codewords and uses the sparse codes as new presentations. In this paper, we investigate learning discriminative sparse codes by sparse coding in a…

Machine Learning · Statistics 2015-01-19 Jim Jing-Yan Wang , Xin Gao

We consider the problem of constructing prefix-free codes in which a designated symbol, a space, can only appear at the end of codewords. We provide a linear-time algorithm to construct almost-optimal codes with this property, meaning that…

Information Theory · Computer Science 2024-05-13 Roberto Bruno , Ugo Vaccaro

This article introduces a novel communication scheme, termed coded compressed sensing, for unsourced multiple-access communication. The proposed divide-and-conquer approach leverages recent advances in compressed sensing and forward error…

Signal Processing · Electrical Eng. & Systems 2019-06-26 Vamsi K. Amalladinne , Jean-Francois Chamberland , Krishna R. Narayanan

Source coding is the canonical problem of data compression in information theory. In a locally encodable source coding, each compressed bit depends on only few bits of the input. In this paper, we show that a recently popular model of…

Machine Learning · Statistics 2020-11-10 Arya Mazumdar , Soumyabrata Pal

We consider a large-scale matrix multiplication problem where the computation is carried out using a distributed system with a master node and multiple worker nodes, where each worker can store parts of the input matrices. We propose a…

Information Theory · Computer Science 2018-01-25 Qian Yu , Mohammad Ali Maddah-Ali , A. Salman Avestimehr

Adaptive coding faces the following problem: given a collection of source classes such that each class in the collection has non-trivial minimax redundancy rate, can we design a single code which is asymptotically minimax over each class in…

Information Theory · Computer Science 2016-09-02 Anna Ben-Hamou , Stephane Boucheron , Elisabeth Gassiat

We present a construction of subspace codes along with an efficient algorithm for list decoding from both insertions and deletions, handling an information-theoretically maximum fraction of these with polynomially small rate. Our…

Information Theory · Computer Science 2012-02-03 Venkatesan Guruswami , Srivatsan Narayanan , Carol Wang

We propose application-layer coding schemes to recover lost data in delay-sensitive uplink (sensor-to-gateway) communications in the Internet of Things. Built on an approach that combines retransmissions and forward erasure correction, the…

Information Theory · Computer Science 2022-07-26 Vatsalya Chaubey , Siddhartha S. Borkotoky

The ubiquitous Variable-Byte encoding is one of the fastest compressed representation for integer sequences. However, its compression ratio is usually not competitive with other more sophisticated encoders, especially when the integers to…

Information Retrieval · Computer Science 2022-02-08 Giulio Ermanno Pibiri , Rossano Venturini

The capacity of symmetric, neighboring and consecutive side-information single unicast index coding problems (SNC-SUICP) with number of messages equal to the number of receivers was given by Maleki, Cadambe and Jafar. For these index coding…

Information Theory · Computer Science 2017-05-17 Mahesh Babu Vaddi , B. Sundar Rajan

Recent indexing techniques inspired by source coding have been shown successful to index billions of high-dimensional vectors in memory. In this paper, we propose an approach that re-ranks the neighbor hypotheses obtained by these…

Information Retrieval · Computer Science 2011-02-21 Hervé Jégou , Romain Tavenard , Matthijs Douze , Laurent Amsaleg

The capacity of symmetric instance of the multiple unicast index coding problem with neighboring antidotes (side-information) with number of messages equal to the number of receivers was given by Maleki, Cadambe and Jafar. In this paper we…

Information Theory · Computer Science 2015-10-20 Mahesh Babu Vaddi , Roop Kumar Bhattaram , B. Sundar Rajan

Modern optimizing compilers are able to exploit memory access or computation patterns to generate vectorization codes. However, such patterns in irregular applications are unknown until runtime due to the input dependence. Thus, either…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-10-26 Changxi Liu , Hailong Yang , Xu Liu , Zhongzhi Luan , Depei Qian

Subspace sparse coding (SSC) algorithms have proven to be beneficial to clustering problems. They provide an alternative data representation in which the underlying structure of the clusters can be better captured. However, most of the…

Machine Learning · Computer Science 2019-03-14 Babak Hosseini , Barbara Hammer