English
Related papers

Related papers: An MSE Based Ttransfer Chart to Analyze Iterative …

200 papers

This paper deals with arbitrarily distributed finite-power input signals observed through an additive Gaussian noise channel. It shows a new formula that connects the input-output mutual information and the minimum mean-square error (MMSE)…

Information Theory · Computer Science 2007-07-13 Dongning Guo , Shlomo Shamai , Sergio Verdu

In this paper, we generalize the fundamental relation between the mutual information and the minimum mean squared error (MMSE) by Guo, Shamai, and Verdu [1] to K-User Gaussian channels. We prove that the derivative of the multiuser mutual…

Information Theory · Computer Science 2017-04-20 Samah A. M. Ghanem

Joint equalization and decoding schemes are described for two-dimensional intersymbol interference (ISI) channels. Equalization is performed using the minimum mean-square-error (MMSE) criterion. Low-density parity-check codes are used for…

Information Theory · Computer Science 2016-11-18 N. Singla , J. A. O'Sullivan

We examine codes, over the additive Gaussian noise channel, designed for reliable communication at some specific signal-to-noise ratio (SNR) and constrained by the permitted minimum mean-square error (MMSE) at lower SNRs. The maximum…

Information Theory · Computer Science 2012-08-10 Ronit Bustin , Shlomo Shamai

Consider the minimum mean-square error (MMSE) of estimating an arbitrary random variable from its observation contaminated by Gaussian noise. The MMSE can be regarded as a function of the signal-to-noise ratio (SNR) as well as a functional…

Information Theory · Computer Science 2010-04-21 Dongning Guo , Yihong Wu , Shlomo Shamai , Sergio Verdu

We study the excess mean square error (EMSE) above the minimum mean square error (MMSE) in large linear systems where the posterior mean estimator (PME) is evaluated with a postulated prior that differs from the true prior of the input…

Information Theory · Computer Science 2015-05-18 Yanting Ma , Dror Baron , Ahmad Beirami

In this paper, a modified extrinsic information transfer (EXIT) chart analysis that takes into account the relation between mutual information (MI) and bit-error-rate (BER) is presented to study the convergence behavior of block Markov…

Information Theory · Computer Science 2015-02-03 Kechao Huang , Xiao Ma , Daniel J. Costello

In this paper, we generalize the fundamental relation between the derivative of the mutual information and the minimum mean squared error (MMSE) to multiuser setups. We prove that the derivative of the mutual information with respect to the…

Information Theory · Computer Science 2017-03-27 Samah A. M. Ghanem

The minimum mean-square error of the estimation of a signal where observed from the additive white Gaussian noise (WGN) channel's output, is analyzed. It is assumed that the channel input's signal is composed of a (normalized) sum of N…

Information Theory · Computer Science 2007-07-13 Jacob Binia

This paper investigates the minimum mean square error (MMSE) estimation of x, given the observation y = Hx+n, when x and n are independent and Gaussian Mixture (GM) distributed. The introduction of GM distributions, represents a…

Statistics Theory · Mathematics 2011-08-18 John T. Flam , Saikat Chatterjee , Kimmo Kansanen , Torbjorn Ekman

Detailed derivations of two bounds of the minimum mean-square error (MMSE) of complex-valued multiple-input multiple-output (MIMO) systems are proposed for performance evaluation. Particularly, the lower bound is derived based on a…

Information Theory · Computer Science 2021-11-29 Chongjun Ouyang , Hongwen Yang

The I-MMSE formula connects two important quantities in information theory and estimation theory: the mutual information and the minimum mean-squared error (MMSE). It states that in a scalar Gaussian channel, the derivative of the mutual…

Information Theory · Computer Science 2024-08-27 Minh-Toan Nguyen

We consider the problem of signal estimation (denoising) from a statistical-mechanical perspective, in continuation to a recent work on the analysis of mean-square error (MSE) estimation using a direct relationship between optimum…

Information Theory · Computer Science 2013-06-04 Wasim Huleihel , Neri Merhav

We consider mean squared estimation with lookahead of a continuous-time signal corrupted by additive white Gaussian noise. We show that the mutual information rate function, i.e., the mutual information rate as function of the…

Information Theory · Computer Science 2016-11-18 Kartik Venkat , Tsachy Weissman , Yair Carmon , Shlomo Shamai

In this work we explore possibilities for coding and decoding tailor-made for mean squared error evaluation of error in contexts such as image transmission. To do so, we introduce a loss function that expresses the overall performance of a…

Information Theory · Computer Science 2014-11-06 Marcelo Firer , Luciano Panek , Jerry Anderson Pinheiro

In this article, a study of the mean-square error (MSE) performance of linear echo-state neural networks is performed, both for training and testing tasks. Considering the realistic setting of noise present at the network nodes, we derive…

Machine Learning · Computer Science 2016-03-28 Romain Couillet , Gilles Wainrib , Harry Sevi , Hafiz Tiomoko Ali

We take an information theoretic perspective on a classical sparse-sampling noisy linear model and present an analytical expression for the mutual information, which plays central role in a variety of communications/processing problems.…

Information Theory · Computer Science 2014-03-25 Wasim Huleihel , Neri Merhav , Shlomo Shamai

The minimum mean-squared error (MMSE) is one of the most popular criteria for Bayesian estimation. Conversely, the signal-to-noise ratio (SNR) is a typical performance criterion in communications, radar, and generally detection theory. In…

Information Theory · Computer Science 2016-10-12 Luca Rugini , Paolo Banelli

In this paper, the minimum mean square error (MMSE) channel estimation for intelligent reflecting surface (IRS) assisted wireless communication systems is investigated. In the considered setting, each row vector of the equivalent channel…

Information Theory · Computer Science 2021-04-06 Mangqing Guo , M. Cenk Gursoy

We consider the characterization of the asymptotic behavior of the average minimum mean-squared error (MMSE) and the average mutual information in scalar and vector fading coherent channels, where the receiver knows the exact fading channel…

Information Theory · Computer Science 2012-10-17 Alberto Gil C. P. Ramos , Miguel R. D. Rodrigues
‹ Prev 1 2 3 10 Next ›