English
Related papers

Related papers: Information-Theoretic Extensions of the Shannon-Ny…

200 papers

For a continuous-input-continuous-output arbitrarily distributed quantum channel carrying classical information, the channel capacity can be computed in terms of the distribution of the channel envelope, received signal strength over a…

Information Theory · Computer Science 2022-06-09 Mouli Chakraborty , Harun Siljak , Indrakshi Dey , Nicola Marchetti

The minimum mean-square error of the estimation of a signal where observed from the additive white Gaussian noise (WGN) channel's output, is analyzed. It is assumed that the channel input's signal is composed of a (normalized) sum of N…

Information Theory · Computer Science 2007-07-13 Jacob Binia

While information is ubiquitously generated, shared, and analyzed in a modern-day life, there is still some controversy around the ways to asses the amount and quality of information inside a noisy optical channel. A number of theoretical…

Sampling theory has benefited from a surge of research in recent years, due in part to the intense research in wavelet theory and the connections made between the two fields. In this survey we present several extensions of the Shannon…

Information Theory · Computer Science 2008-12-17 Y. C. Eldar , T. Michaeli

A group of transition probability functions form a Shannon's channel whereas a group of truth functions form a semantic channel. By the third kind of Bayes' theorem, we can directly convert a Shannon's channel into an optimized semantic…

Machine Learning · Computer Science 2018-03-28 Chenguang Lu

Shannon's channel coding theorem describes the maximum possible rate of reliable information transfer through a classical noisy communication channel. It, together with the source coding theorem, characterizes lossless channel communication…

Quantum Physics · Physics 2021-05-17 Sristy Agrawal , Rajashik Tarafder , Graeme Smith , Arup Roy , Manik Banik

We prove that whenever the coherent information of a one-mode Gaussian channel is non-zero its supremum is achieved for the infinite input power. This is a well established fact for the zero added classical noise, whereas the nonzero case…

Quantum Physics · Physics 2016-02-08 Kamil Bradler

Almost all modern communication systems rely on electromagnetic fields as a means of information transmission, and finding the capacities of these systems is a problem of significant practical importance. The Additive White Gaussian Noise…

Quantum Physics · Physics 2013-02-05 Robert Koenig , Graeme Smith

A formula is derived for the capacity of the Gaussian channel with a benevolent message-cognizant rate-limited helper that provides a noncausal description of the noise to the encoder and decoder. This capacity is strictly larger than when…

Information Theory · Computer Science 2023-10-25 Amos Lapidoth , Ligong Wang , Yiming Yan

Recent studies have explored theoretically the ability of populations of neurons to carry information about a set of stimuli, both in the case of purely discrete or purely continuous stimuli, and in the case of multidimensional continuous…

Disordered Systems and Neural Networks · Physics 2009-11-10 Valeria Del Prete

The aim of this paper is to present an extension of the well-known as-ymptotic equivalence between density estimation experiments and a Gaussian white noise model. Our extension consists in enlarging the nonparametric class of the…

Probability · Mathematics 2015-03-18 Ester Mariucci

In this work we review the application of the theory of Gaussian processes to the modeling of noise in pulsar-timing data analysis, and we derive various useful and optimized representations for the likelihood expressions that are needed in…

General Relativity and Quantum Cosmology · Physics 2014-11-19 Rutger van Haasteren , Michele Vallisneri

Statements of Shannon's Noiseless Coding Theorem by various authors, including the original, are reviewed and clarified. Traditional statements of the theorem are often unclear as to when it applies. A new notation is introduced and the…

Information Theory · Computer Science 2010-11-01 L. F. Johnson

The aim of the present thesis is to review the Blanchet-Damour approach to analytical study of gravitational waves emitted by localized perfect fluid sources. It is assumed these perfect fluids are such that it is possible to define small…

General Relativity and Quantum Cosmology · Physics 2020-11-26 Abbas Mirahmadi

The entanglement-assisted classical capacity of a noisy quantum channel is the amount of information per channel use that can be sent over the channel in the limit of many uses of the channel, assuming that the sender and receiver have…

Quantum Physics · Physics 2007-05-23 Charles H. Bennett , Peter W. Shor , John A. Smolin , Ashish V. Thapliyal

We consider the problem of communicating the state of a dynamical system via a Shannon Gaussian channel. The receiver, which acts as both a decoder and estimator, observes the noisy measurement of the channel output and makes an optimal…

Information Theory · Computer Science 2015-06-02 Ather Gattami

The model considered is that of ``signal plus white noise.'' Known connections between the noncausal filtering error and mutual information are combined with new ones involving the causal estimation error, in a general abstract setup. The…

Probability · Mathematics 2009-09-29 Eddy Mayer-Wolf , Moshe Zakai

This paper investigates the problem of zero-delay joint source-channel coding of a vector Gauss-Markov source over a multiple-input multiple-output (MIMO) additive white Gaussian noise (AWGN) channel with feedback. In contrast to the…

Information Theory · Computer Science 2023-10-19 Barron Han , Oron Sabag , Victoria Kostina , Babak Hassibi

We present simple coding strategies, which are variants of the Schalkwijk-Kailath scheme, for communicating reliably over additive white noise channels in the presence of corrupted feedback. More specifically, we consider a framework…

Information Theory · Computer Science 2007-07-13 Nuno C Martins , Tsachy Weissman

Shannon channel capacity of an additive white Gaussian noise channel is the highest reliable transmission bit rate (RTBR) with arbitrary small error probability. However, the authors find that the concept is correct only when the channel…

Information Theory · Computer Science 2019-06-12 Bingli Jiao