English
Related papers

Related papers: Rice-Marlin Codes: Tiny and Efficient Variable-to-…

200 papers

Large information sizes in samples and features can be encoded to speed up the learning of statistical models based on linear algebra and remove unwanted signals. Encoding information can reduce both sample and feature dimension to a…

Machine Learning · Computer Science 2022-06-23 David Banh , Alan Huang

V2X (Vehicle-to-everything) communication relies on short messages for short-range transmissions over a fading wireless channel, yet requires high reliability and low latency. Hard-decision decoding sacrifices the preservation of diversity…

Information Theory · Computer Science 2024-08-08 Praveen Sai Bere , Mohammed Zafar Ali Khan , Lajos Hanzo

Reed Muller (RM) codes are known for their good minimum distance. One can use their structure to construct polar-like codes with good distance properties by choosing the information set as the rows of the polarization matrix with the…

Information Theory · Computer Science 2022-04-15 Samet Gelincik , Philippe Mary , Anne Savard , Jean-Yves Baudais

We consider recursive decoding for Reed-Muller (RM) codes and their subcodes. Two new recursive techniques are described. We analyze asymptotic properties of these algorithms and show that they substantially outperform other decoding…

Information Theory · Computer Science 2017-03-17 Ilya Dumer , Kirill Shabunov

Long polar codes can achieve the symmetric capacity of arbitrary binary-input discrete memoryless channels under a low complexity successive cancelation (SC) decoding algorithm. However, for polar codes with short and moderate code length,…

Hardware Architecture · Computer Science 2014-11-18 Jun Lin , Zhiyuan Yan

We initiate a study of locally decodable codes with randomized encoding. Standard locally decodable codes are error correcting codes with a deterministic encoding function and a randomized decoding function, such that any desired message…

Information Theory · Computer Science 2020-01-14 Kuan Cheng , Xin Li , Yu Zheng

Large Language Models (LLMs) have achieved remarkable success in source code understanding, yet as software systems grow in scale, computational efficiency has become a critical bottleneck. Currently, these models rely on a text-based…

Computation and Language · Computer Science 2026-04-29 Yuling Shi , Chaoxiang Xie , Zhensu Sun , Yeheng Chen , Chenxu Zhang , Longfei Yun , Chengcheng Wan , Hongyu Zhang , David Lo , Xiaodong Gu

State-constrained signal codes directly encode modulation signals using signal processing filters, the coefficients of which are constrained over the rings of formal power series. Although the performance of signal codes is defined by these…

Information Theory · Computer Science 2019-01-08 Manato Takai , Koji Ishibashi

This letter investigates a new class of index coding problems. One sender broadcasts packets to multiple users, each desiring a subset, by exploiting prior knowledge of linear combinations of packets. We refer to this class of problems as…

Information Theory · Computer Science 2016-11-18 Namyoon Lee , Alexandros G. Dimakis , Robert W. Heath

Fractional repetition (FR) codes are a family of repair-efficient storage codes that provide exact and uncoded node repair at the minimum bandwidth regenerating point. The advantageous repair properties are achieved by a tailor-made…

Information Theory · Computer Science 2020-05-15 Bing Zhu , Hui Li , Kenneth W. Shum , Shuo-Yen Robert Li

Motivated by distributed storage applications, we investigate the degree to which capacity achieving encodings can be efficiently updated when a single information bit changes, and the degree to which such encodings can be efficiently…

Information Theory · Computer Science 2013-10-08 Arya Mazumdar , Venkat Chandar , Gregory W. Wornell

A sender wishes to broadcast an n character word x in F^n (for a field F) to n receivers R_1,...,R_n. Every receiver has some side information on x consisting of a subset of the characters of x. The side information of the receivers is…

Information Theory · Computer Science 2015-03-19 Ishay Haviv , Michael Langberg

We introduce ReALLM, a novel approach for compression and memory-efficient adaptation of pre-trained language models that encompasses most of the post-training quantization and fine-tuning methods for a budget of <4 bits. Pre-trained…

Machine Learning · Computer Science 2024-05-24 Louis Leconte , Lisa Bedin , Van Minh Nguyen , Eric Moulines

Universal variable-to-fixed (V-F) length coding of $d$-dimensional exponential family of distributions is considered. We propose an achievable scheme consisting of a dictionary, used to parse the source output stream, making use of the…

Information Theory · Computer Science 2017-08-02 Nematollah Iri , Oliver Kosut

An index code for broadcast channel with receiver side information is locally decodable if each receiver can decode its demand by observing only a subset of the transmitted codeword symbols instead of the entire codeword. Local decodability…

Information Theory · Computer Science 2020-07-31 Lakshmi Natarajan , Prasad Krishnan , V. Lalitha , Hoang Dau

In a distributed storage network, reliability and bandwidth optimization can be provided by regenerating codes. Recently table based regenerating codes viz. DRESS (Distributed Replication-based Exact Simple Storage) codes has been proposed…

Information Theory · Computer Science 2013-02-18 Manish K Gupta , Anupam Agrawal , Deepak Yadav

Constrained coding plays a key role in optimizing performance and mitigating errors in applications such as storage and communication, where specific constraints on codewords are required. While non-parametric constraints have been…

Information Theory · Computer Science 2025-05-05 Daniella Bar-Lev , Michael Shlizerman

Two-dimensional constrained coding is a problem that is much more difficult than its one-dimensional counterpart. Indeed, in two dimensions, obtaining the answers to very natural questions becomes uncomputable. In particular, it is…

Signal Processing · Electrical Eng. & Systems 2019-04-17 Danny Dubé

Polar codes have received growing attention in the past decade and have been selected as the coding scheme for the control channel in the fifth generation (5G) wireless communication systems. However, the conventional polar codes have only…

Information Theory · Computer Science 2023-01-26 Hossein Rezaei , Nandana Rajatheva , Matti Latva-aho

Lifted Reed-Solomon and multiplicity codes are classes of codes, constructed from specific sets of $m$-variate polynomials. These codes allow for the design of high-rate codes that can recover every codeword or information symbol from many…

Information Theory · Computer Science 2021-10-12 Lukas Holzbaur , Rina Polyanskaya , Nikita Polyanskii , Ilya Vorobyev , Eitan Yaakobi