English
Related papers

Related papers: Strong Data Processing Inequalities for Input Cons…

200 papers

We consider a channel with a binary input X being corrupted by a continuous-valued noise that results in a continuous-valued output Y. An optimal binary quantizer is used to quantize the continuous-valued output Y to the final binary output…

Signal Processing · Electrical Eng. & Systems 2020-01-08 Thuan Nguyen , Thinh Nguyen

The exponential strong converse for a coding problem states that, if a coding rate is beyond the theoretical limit, the correct probability converges to zero exponentially. For the lossy source coding with side-information, also known as…

Information Theory · Computer Science 2025-04-24 Shun Watanabe

The installation of wireless technologies in power substations requires characterizing the impulsive noise produced by the high-voltage equipment. Substation impulsive noise might interfere with classic wireless communications and none of…

Networking and Internet Architecture · Computer Science 2013-05-20 Fabien Sacuto , Fabrice Labeau , Basile. L Agba

Deep neural networks have been successfully applied to a broad range of problems where overparametrization yields weight matrices which are partially random. A comparison of weight matrix singular vectors to the Porter-Thomas distribution…

Disordered Systems and Neural Networks · Physics 2024-01-22 Max Staats , Matthias Thamm , Bernd Rosenow

This paper addresses the problem of coding a continuous random source correlated with another source which is only available at the decoder. The proposed approach is based on the extension of the channel coding concept of syndrome from the…

Information Theory · Computer Science 2007-10-11 Lorenzo Cappellari

In this paper we propose a method of proving impossibility results based on applying strong data-processing inequalities to estimate mutual information between sets of variables forming certain Markov random fields. The end result is that…

Information Theory · Computer Science 2020-05-22 Yury Polyanskiy , Yihong Wu

In many communication scenarios, the communication signals simultaneously suffer from white Gaussian noise (WGN) and non-Gaussian impulsive noise (IN), i.e., mixed Gaussian-impulsive noise (MGIN). Under MGIN channel, classical communication…

Signal Processing · Electrical Eng. & Systems 2023-01-20 Chengjie Zhao , Jun Wang , Wei Huang , Xiaonan Chen , Tianfu Qi

Noise injection is a fundamental tool for data augmentation, and yet there is no widely accepted procedure to incorporate it with learning frameworks. This study analyzes the effects of adding or applying different noise models of varying…

Computer Vision and Pattern Recognition · Computer Science 2023-07-14 M. Eren Akbiyik

Applying perturbation theory to the path-integral representation for the mutual information of the nonlinear communication channel described by the nonlinear Shr\"{o}dinger equation (NLSE) with the additive Gaussian noise we analyze the…

Information Theory · Computer Science 2016-08-19 I. S. Terekhov , A. V. Reznichenko , S. K. Turitsyn

Fundamental limitations or performance trade-offs/limits are important properties and constraints of both control and filtering systems. Among various trade-off metrics, total information rate that characterizes the sensitivity trade-offs…

Systems and Control · Electrical Eng. & Systems 2025-03-18 Neng Wan , Dapeng Li , Naira Hovakimyan , Petros G. Voulgaris

This paper characterizes the trade-offs between information and energy transmission over an additive white Gaussian noise channel in the finite block-length regime with finite sets of channel input symbols. These trade-offs are…

Information Theory · Computer Science 2023-05-25 Sadaf Ul Zuhra , Samir M. Perlaza , H. Vincent Poor , Mikael Skoglund

Consider several source nodes communicating across a wireless network to a destination node with the help of several layers of relay nodes. Recent work by Avestimehr et al. has approximated the capacity of this network up to an additive…

Information Theory · Computer Science 2013-06-05 Urs Niesen , Bobak Nazer , Phil Whiting

In this work, we consider the problem of distributed approximation of functions over multiple-access channels with additive noise. In contrast to previous works, we take fast fading into account and give explicit probability bounds for the…

Information Theory · Computer Science 2021-03-01 Igor Bjelakovic , Matthias Frey , Slawomir Stanczak

In this article we focus on the problem of channel decoding in presence of a-priori information. In particular, assuming that the a-priori information reliability is not perfectly estimated at the receiver, we derive a novel analytical…

Information Theory · Computer Science 2007-11-14 Andrea Abrardo

A novel technique to optimize the input distribution and compute a lower bound for the capacity of the nonlinear optical fiber channel is proposed. The technique improves previous bounds obtained with the additive white Gaussian noise…

Information Theory · Computer Science 2021-06-09 Stella Civelli , Enrico Forestieri , Alexey Lotsmanov , Dmitry Razdoburdin , Marco Secondini

Nonlinear interference is modeled by a time-varying conditionally Gaussian channel. It is shown that approximating this channel with a time-invariant channel imposes considerable loss in the performance of channel decoding. An adaptive…

Information Theory · Computer Science 2021-02-02 Reza Rafie Borujeny , Frank R. Kschischang

The sum-rate capacity of the parallel Gaussian interference channel is shown to be achieved by independent transmission across sub-channels and treating interference as noise in each sub-channel if the channel coefficients and power…

Information Theory · Computer Science 2009-03-04 Xiaohu Shang , Biao Chen , Gerhard Kramer , H. Vincent Poor

Estimating the information transmission capability of a quantum channel remains one of the fundamental problems in quantum information processing. In contrast to classical channels, the information-carrying capability of quantum channels is…

Quantum Physics · Physics 2024-07-26 Aditya Nema , Ananda G. Maity , Sergii Strelchuk , David Elkouss

Generalized mutual information (GMI) is used to compute achievable rates for fading channels with various types of channel state information at the transmitter (CSIT) and receiver (CSIR). The GMI is based on variations of auxiliary channel…

Information Theory · Computer Science 2023-05-23 Gerhard Kramer

A deep understanding of the queuing performance of wireless networks is essential for the advancement of future wireless communications. The stochastic nature of wireless channels in general gives rise to a time varying transmission rate.…

Networking and Internet Architecture · Computer Science 2016-04-05 Sebastian Schiessl , Farshad Naghibi , Hussein Al-Zubaidy , Markus Fidler , James Gross