English
Related papers

Related papers: Overlapped Arithmetic Codes

200 papers

Distributed Arithmetic Coding (DAC) has emerged as a feasible solution to the Slepian-Wolf problem, particularly in scenarios with non-stationary sources and for data sequences with lengths ranging from small to medium. Due to the inherent…

Information Theory · Computer Science 2025-04-17 Junwei Zhou , HaoYun Xiao , Jianwen Xi , Qiuzhen Lin

The problem of distributed function computation is studied, where functions to be computed is not necessarily symbol-wise. A new method to derive a converse bound for distributed computing is proposed; from the structure of functions to be…

Information Theory · Computer Science 2017-07-10 Shigeaki Kuzuoka , Shun Watanabe

The broadcast throughput in a network is defined as the average number of messages that can be transmitted per unit time from a given source to all other nodes when time goes to infinity. Classical broadcast algorithms treat messages as…

Data Structures and Algorithms · Computer Science 2014-08-29 Noga Alon , Mohsen Ghaffari , Bernhard Haeupler , Majid Khabbazian

We consider the problem of coded distributed computing where a large linear computational job, such as a matrix multiplication, is divided into $k$ smaller tasks, encoded using an $(n,k)$ linear code, and performed over $n$ distributed…

Information Theory · Computer Science 2019-06-25 Mohammad Vahid Jamali , Mahdi Soleymani , Hessam Mahdavifar

This introduction to arithmetic coding is divided in two parts. The first explains how and why arithmetic coding works. We start presenting it in very general terms, so that its simplicity is not lost under layers of implementation details.…

Information Theory · Computer Science 2023-02-03 Amir Said

We introduce a definition of perfect and quasi-perfect codes for symmetric channels parametrized by an auxiliary output distribution. This notion generalizes previous definitions of perfect and quasi-perfect codes and encompasses maximum…

Information Theory · Computer Science 2018-05-28 Gonzalo Vazquez-Vilar , Albert Guillén i Fàbregas , Sergio Verdú

A new coding technique, based on \textit{fixed block-length} codes, is proposed for the problem of communicating a pair of correlated sources over a $2-$user interference channel. Its performance is analyzed to derive a new set of…

Information Theory · Computer Science 2017-02-08 Arun Padakandla

This work investigates the fundamental limits of communication over a noisy discrete memoryless channel that wears out, in the sense of signal-dependent catastrophic failure. In particular, we consider a channel that starts as a memoryless…

Information Theory · Computer Science 2018-08-07 Ting-Yi Wu , Lav R. Varshney , Vincent Y. F. Tan

The problem of computing sum of sources over a multiple access channel (MAC) is considered. Building on the technique of linear computation coding (LCC) proposed by Nazer and Gastpar [2007], we employ the ensemble of nested coset codes to…

Information Theory · Computer Science 2022-03-02 Arun Padakandla , S. Sandeep Pradhan

The fundamental limit of Semantic Communications (joint source-channel coding) is established when the transmission needs to be kept covert from an external warden. We derive information-theoretic achievability and matching converse results…

Information Theory · Computer Science 2024-06-21 Abdelaziz Bounhar , Mireille Sarkiss , Michèle Wigger

In problems of lossy source/noisy channel coding with side information, the theoretical bounds are achieved using "good" source/channel codes that can be partitioned into "good" channel/source codes. A scheme that achieves optimality in…

Information Theory · Computer Science 2009-04-07 Lorenzo Cappellari

Polar codes have attracted much recent attention as the first codes with low computational complexity that provably achieve optimal rate-regions for a large class of information-theoretic problems. One significant drawback, however, is that…

Information Theory · Computer Science 2010-01-15 Mayank Bakshi , Sidharth Jaggi , Michelle Effros

Regenerating codes are a class of recently developed codes for distributed storage that, like Reed-Solomon codes, permit data recovery from any arbitrary k of n nodes. However regenerating codes possess in addition, the ability to repair a…

Information Theory · Computer Science 2015-03-17 Nihar B. Shah , K. V. Rashmi , P. Vijay Kumar , Kannan Ramchandran

In the two-user Gaussian interference channel with Gaussian inputs and treating interference as noise (TIN), improper complex signals can be beneficial if time-sharing is not allowed or if only the data rates are averaged over several…

Information Theory · Computer Science 2020-12-30 Christoph Hellings , Ferhad Askerbeyli , Wolfgang Utschick

We define multi-block interleaved codes as codes that allow reading information from either a small sub-block or from a larger full block. The former offers faster access, while the latter provides better reliability. We specify the…

Information Theory · Computer Science 2017-01-26 Yuval Cassuto , Evyatar Hemo , Sven Puchinger , Martin Bossert

Multishot network coding is considered in a worst-case adversarial setting in which an omniscient adversary with unbounded computational resources may inject erroneous packets in up to $t$ links, erase up to $\rho$ packets, and wire-tap up…

Information Theory · Computer Science 2019-04-18 Umberto Martínez-Peñas , Frank R. Kschischang

We study network coding gaps for the problem of makespan minimization of multiple unicasts. In this problem distinct packets at different nodes in a network need to be delivered to a destination specific to each packet, as fast as possible.…

Data Structures and Algorithms · Computer Science 2020-04-30 Bernhard Haeupler , David Wajc , Goran Zuzic

We approach index coding as a special case of rate-distortion with multiple receivers, each with some side information about the source. Specifically, using techniques developed for the rate-distortion problem, we provide two upper bounds…

Information Theory · Computer Science 2015-07-28 Sinem Unal , Aaron B. Wagner

Multi-hop relay channels use multiple relay stages, each with multiple relay nodes, to facilitate communication between a source and destination. Previously, distributed space-time coding was used to maximize diversity gain. Assuming a…

Information Theory · Computer Science 2008-05-22 Rahul Vaze , Robert W. Heath

Source coding is the canonical problem of data compression in information theory. In a locally encodable source coding, each compressed bit depends on only few bits of the input. In this paper, we show that a recently popular model of…

Machine Learning · Statistics 2020-11-10 Arya Mazumdar , Soumyabrata Pal