English
Related papers

Related papers: Returning to Shannon's Original Meaning

200 papers

Shannon's channel coding theorem describes the maximum possible rate of reliable information transfer through a classical noisy communication channel. It, together with the source coding theorem, characterizes lossless channel communication…

Quantum Physics · Physics 2021-05-17 Sristy Agrawal , Rajashik Tarafder , Graeme Smith , Arup Roy , Manik Banik

In this paper, firstly, the Shannon channel capacity formula is briefly stated, and the relationship between the formula and the signal uncertainty principle is analyzed in order to prepare for deriving the formula which is able to break…

Information Theory · Computer Science 2020-04-28 Dequn Liang , Xinyu Dou

Muroga [M52] showed how to express the Shannon channel capacity of a discrete channel with noise [S49] as an explicit function of the transition probabilities. His method accommodates channels with any finite number of input symbols, any…

Information Theory · Computer Science 2017-02-01 Simon Cowell

In Shannon information theory the capacity of a memoryless communication channel cannot be increased by the use of feedback from receiver to sender. In this paper the use of classical feedback is shown to provide no increase in the…

Quantum Physics · Physics 2007-05-23 Garry Bowen , Rajagopal Nagarajan

We consider ergodic causal classical-quantum channels (cq-channels) which additionally have a decaying input memory. In the first part we develop some structural properties of ergodic cq-channels and provide equivalent conditions for…

Quantum Physics · Physics 2016-11-18 Igor Bjelakovic , Holger Boche

The channel capacity theorem for additive white Gaussian noise channel (AWGN), widely known as the Shannon-Hartley Law, expresses the information capacity of a channel bandlimited in the conventional Fourier domain in terms of the…

Information Theory · Computer Science 2009-01-29 Kamalesh Kumar Sharma

Channel capacity describes the size of the nearly ideal channels, which can be obtained from many uses of a given channel, using an optimal error correcting code. In this paper we collect and compare minor and major variations in the…

Quantum Physics · Physics 2009-11-10 Dennis Kretschmann , Reinhard F Werner

New sufficient conditions for determining in closed form the capacity region of point-to-point memoryless two-way channels (TWCs) are derived. The proposed conditions not only relax Shannon's condition which can identify only TWCs with a…

Information Theory · Computer Science 2018-05-08 Jian-Jia Weng , Lin Song , Fady Alajaji , Tamás Linder

Dual to the usual noisy channel coding problem, where a noisy (classical or quantum) channel is used to simulate a noiseless one, reverse Shannon theorems concern the use of noiseless channels to simulate noisy ones, and more generally the…

Quantum Physics · Physics 2014-07-22 Charles H. Bennett , Igor Devetak , Aram W. Harrow , Peter W. Shor , Andreas Winter

Particularly motivated by DNA storage channels, we consider channels with synchronization errors modeled as insertions and deletions, along with substitutions. We focus on the case where the synchronization error process has memory and…

Information Theory · Computer Science 2026-04-14 Ruslan Morozov , Tolga M. Duman

Shannon defined channel capacity as the highest rate at which there exists a sequence of codes of block length $n$ such that the error probability goes to zero as $n$ goes to infinity. In this definition, it is implicit that the block…

Information Theory · Computer Science 2010-06-03 Rui A. Costa , Michael Langberg , João Barros

The zero-error capacity of a channel (or Shannon capacity of a graph) quantifies how much information can be transmitted with no risk of error. In contrast to the Shannon capacity of a channel, the zero-error capacity has not even been…

Information Theory · Computer Science 2024-03-19 Alexander Meiburg

According to Blackwell's Theorem it is equivalent to compare channels by either a garbling order or optimal decision making. This equivalence does not hold anymore if also allowing pre-garbling, i. e. for the so-called Shannon-order (see…

Optimization and Control · Mathematics 2019-06-18 Sebastian Lämmel , Vladimir Shikhman

Many communication applications incorporate event-triggered behavior, where the conventional Shannon capacity may not effectively gauge performance. Consequently, we advocate for the concept of identification capacity as a more suitable…

Information Theory · Computer Science 2025-02-04 Ilya Vorobyev , Christian Deppe , Holger Boche

The Shannon capacity of a graph G is the maximum asymptotic rate at which messages can be sent with zero probability of error through a noisy channel with confusability graph G. This extensively studied graph parameter disregards the fact…

Quantum Physics · Physics 2014-03-05 Jop Briet , Harry Buhrman , Dion Gijswijt

In part I, we reviewed how Shannon's classical notion of capacity is not sufficient to characterize a noisy communication channel if the channel is intended to be used as part of a feedback loop to stabilize an unstable scalar linear…

Information Theory · Computer Science 2007-12-06 Anant Sahai , Sanjoy Mitter

Memoryless channels with deletion errors as defined by a stochastic channel matrix allowing for bit drop outs are considered in which transmitted bits are either independently deleted with probability $d$ or unchanged with probability…

Information Theory · Computer Science 2012-11-13 Mojtaba Rahmati , Tolga M. Duman

The capacity of a classical-quantum channel (or in other words the classical capacity of a quantum channel) is considered in the most general setting, where no structural assumptions such as the stationary memoryless property are made on a…

Quantum Physics · Physics 2016-11-17 Masahito Hayashi , Hiroshi Nagaoka

Motivated by results in optical communications, where the performance can degrade dramatically if the transmit power is sufficiently increased, the channel capacity is characterized for various kinds of memoryless vector channels. It is…

Information Theory · Computer Science 2015-03-20 Erik Agrell

The primary objective of quantum Shannon theory is to evaluate the capacity of quantum channels. In spite of the existence of rigorous coding theorems that quantify the transmission of information through quantum channels, superadditivity…

Quantum Physics · Physics 2024-01-17 Rajiuddin Sk , Prasanta K. Panigrahi