English
Related papers

Related papers: Eigenvalue Estimates and Mutual Information for th…

200 papers

The problem of transmitting a parameter value over an additive white Gaussian noise (AWGN) channel is considered, where, in addition to the transmitter and the receiver, there is a helper that observes the noise non-causally and provides a…

Information Theory · Computer Science 2024-10-28 Anatoly Khina , Neri Merhav

We consider the scenario of classical communication over a finite-dimensional quantum channel with memory using a separable-state input ensemble and local output measurements. We propose algorithms for estimating the information rate of…

Information Theory · Computer Science 2024-10-30 Michael X. Cao , Pascal O. Vontobel

Accurately estimating the statistical properties of noise is important in data analysis for space-based gravitational wave detectors. Noise in different time-delay interferometry channels correlates with each other. Many studies often…

Instrumentation and Methods for Astrophysics · Physics 2025-06-18 Ya-Nan Li , Yi-Ming Hu , En-Kun Li

We consider a model nondispersive nonlinear optical fiber channel with additive white Gaussian noise at large $\mathrm{SNR}$ (signal-to-noise ratio) in the intermediate power region. Using Feynman path-integral technique we for the first…

Information Theory · Computer Science 2016-05-06 I. S. Terekhov , A. V. Reznichenko , Ya. A. Kharkov , S. K. Turitsyn

Estimation of mutual information between (multidimensional) real-valued variables is used in analysis of complex systems, biological systems, and recently also quantum systems. This estimation is a hard problem, and universally good…

Quantitative Methods · Quantitative Biology 2019-08-14 Caroline M. Holmes , Ilya Nemenman

Unveiling a fundamental link between information theory and estimation theory, the I-MMSE relationship by Guo, Shamai and Verdu~\cite{gu05}, together with its numerous extensions, has great theoretical significance and various practical…

Information Theory · Computer Science 2020-07-07 Guangyue Han , Jian Song

In a frequency selective slow-fading channel in a MIMO system, the channel matrix is of the form of a block matrix. We propose a method to calculate the limit of the eigenvalue distribution of block matrices if the size of the blocks tends…

Information Theory · Computer Science 2008-09-02 Reza Rashidi Far , Tamer Oraby , Wlodzimierz Bryc , Roland Speicher

We address the practical problems of estimating the information relations that characterize large networks. Building on methods developed for analysis of the neural code, we show that reliable estimates of mutual information can be obtained…

Information Theory · Computer Science 2007-07-13 Noam Slonim , Gurinder S. Atwal , Gasper Tkacik , William Bialek

Channel uncertainty and co-channel interference are two major challenges in the design of wireless systems such as future generation cellular networks. This paper studies receiver design for a wireless channel model with both time-varying…

Information Theory · Computer Science 2009-10-15 Yan Zhu , Dongning Guo , Michael L. Honig

The diffusion model is used to calculate the time-averaged flow of particles in stochastic media and the propagation of waves averaged over ensembles of disordered static configurations. For classical waves exciting static disordered…

Disordered Systems and Neural Networks · Physics 2024-01-11 Azriel Z. Genack , Yiming Huang , Asher Maor , Zhou Shi

We consider the problem of estimating a continuous-time Gauss-Markov source process observed through a vector Gaussian channel with an adjustable channel gain matrix. For a given (generally time-varying) channel gain matrix, we provide…

Information Theory · Computer Science 2022-02-08 Takashi Tanaka , Vrushabh Zinage , Valery Ugrinovskii , Mikael Skoglund

In a recent work we have introduced a novel approach to study the effect of weak non-linearities in the transfer function on the information transmitted by an analogue channel, by means of a perturbative diagrammatic expansion. We extend…

Statistical Mechanics · Physics 2009-11-07 E. Korutcheva , V. Del Prete

A system with two correlated Gaussian white noises is analysed. This system can describe both stochastic localization and long tails in the stationary distribution. Correlations between the noises can lead to a nonmonotonic behaviour of the…

Statistical Mechanics · Physics 2015-06-25 P. F. Gora

A formula is derived for the capacity of the Gaussian channel with a benevolent message-cognizant rate-limited helper that provides a noncausal description of the noise to the encoder and decoder. This capacity is strictly larger than when…

Information Theory · Computer Science 2023-10-25 Amos Lapidoth , Ligong Wang , Yiming Yan

Consider a pair of terminals connected by two independent (feedforward and feedback) Additive White Gaussian Noise (AWGN) channels, and limited by individual power constraints. The first terminal would like to reliably send information to…

Information Theory · Computer Science 2015-04-16 Assaf Ben-Yishai , Ofer Shayevitz

Generalized mutual information (GMI) is used to compute achievable rates for fading channels with various types of channel state information at the transmitter (CSIT) and receiver (CSIR). The GMI is based on variations of auxiliary channel…

Information Theory · Computer Science 2023-05-23 Gerhard Kramer

The scalar additive Gaussian noise channel has the "single crossing point" property between the minimum-mean square error (MMSE) in the estimation of the input given the channel output, assuming a Gaussian input to the channel, and the MMSE…

Information Theory · Computer Science 2016-11-17 Ronit Bustin , Miquel Payaro , Daniel Palomar , Shlomo Shamai

We investigate the potential of adaptive blind equalizers based on variational inference for carrier recovery in optical communications. These equalizers are based on a low-complexity approximation of maximum likelihood channel estimation.…

Signal Processing · Electrical Eng. & Systems 2022-09-16 Vincent Lauinger , Fred Buchali , Laurent Schmalen

Shannon-Hartley theorem can accurately calculate the channel capacity when the signal observation time is infinite. However, the calculation of finite-time mutual information, which remains unknown, is essential for guiding the design of…

Information Theory · Computer Science 2022-10-05 Jieao Zhu , Zijian Zhang , Zhongzhichao Wan , Linglong Dai

Interval-valued data receives much attention due to its wide applications in the fields of finance, econometrics, meteorology and medicine. However, most regression models developed for interval-valued data assume observations are mutually…

Applications · Statistics 2022-10-31 Tingting Huang