English
Related papers

Related papers: Mutual Information and Minimum Mean-square Error i…

200 papers

This paper investigates the statistical properties of non-linear transformations (NLT) of random variables, in order to establish useful tools for estimation and information theory. Specifically, the paper focuses on linear regression…

Information Theory · Computer Science 2013-05-13 Paolo Banelli

We consider a problem where a memoryless bi-variate Gaussian source is to be transmitted over an additive white Gaussian multiple-access channel with two transmitting terminals and one receiving terminal. The first transmitter only sees the…

Information Theory · Computer Science 2007-07-16 Amos Lapidoth , Stephan Tinguely

The minimum mean-square error (MMSE) achievable by optimal estimation of a random variable $Y\in\mathbb{R}$ given another random variable $X\in\mathbb{R}^{d}$ is of much interest in a variety of statistical settings. In the context of…

Information Theory · Computer Science 2022-07-12 Mario Diaz , Peter Kairouz , Lalitha Sankar

This paper determines to within a single measurement the minimum number of measurements required to successfully reconstruct a signal drawn from a Gaussian mixture model in the low-noise regime. The method is to develop upper and lower…

Information Theory · Computer Science 2015-06-16 Francesco Renna , Robert Calderbank , Lawrence Carin , Miguel R. D. Rodrigues

A recent result of the authors shows a so-called I-MMSE-like relationship that, for the two-user Gaussian interference channel, an I-MMSE relationship holds in the limit, as n $\to \infty$, between the interference and the interfered-with…

Information Theory · Computer Science 2018-04-17 Ronit Bustin , H. Vincent Poor , Shlomo Shamai

The information rate of coupled space-division multiplexing (SDM) transmission systems is impaired by the stochastic effects of mode-dependent gain (MDG) and mode-dependent loss (MDL), turning it into a random variable and reducing its…

Signal Processing · Electrical Eng. & Systems 2025-05-27 Lucas Alves Zischler , Darli A. A. Mello

We consider the transmission of a memoryless bivariate Gaussian source over an average-power-constrained one-to-two Gaussian broadcast channel. The transmitter observes the source and describes it to the two receivers by means of an…

Information Theory · Computer Science 2009-03-20 Shraga Bross , Amos Lapidoth , Stephan Tinguely

Minimizing the Mean Squared Error (MSE) is a key objective in machine learning and is commonly used for imputing missing values. While this approach provides accurate point estimates, it introduces systematic biases in downstream analyses.…

Machine Learning · Statistics 2026-05-06 Stef van Buuren

Using state-space representation, mobile object positioning problems can be described as dynamic systems, with the state representing the unknown location and the observations being the information gathered from the location sensors. For…

Systems and Control · Computer Science 2015-06-26 Leila Pishdad , Fabrice Labeau

We present the derivation of post-processing SNR for Minimum-Mean-Squared-Error (MMSE) receivers with imperfect channel estimates, and show that it is an accurate indicator of the error rate performance of MIMO systems in the presence of…

Performance · Computer Science 2016-11-15 Eren Eraslan , Babak Daneshrad , Chung-Yu Lou

Sensing performance is typically evaluated by classical metrics, such as Cramer-Rao bound and signal-to-clutter-plus-noise ratio. The recent development of the integrated sensing and communication (ISAC) framework motivated the efforts to…

Information Theory · Computer Science 2023-11-14 Lei Xie , Fan Liu , Zhanyuan Xie , Zheng Jiang , Shenghui Song

For information transmission a discrete time channel with independent additive Gaussian noise is used. There is also feedback channel with independent additive Gaussian noise, and the transmitter observes without delay all outputs of the…

Information Theory · Computer Science 2012-08-15 M. V. Burnashev , H. Yamamoto

We consider the information fiber optical channel modeled by the nonlinear Schrodinger equation with additive Gaussian noise. Using path-integral approach and perturbation theory for the small dimensionless parameter of the second…

Information Theory · Computer Science 2023-08-03 A. V. Reznichenko , V. O. Guba

We study communication over a Gaussian multiple-access channel (MAC) with two types of transmitters: Digital transmitters hold a message from a discrete set that needs to be communicated to the receiver with vanishing error probability.…

Information Theory · Computer Science 2025-04-28 Matthias Frey , Igor Bjelaković , Michael C. Gastpar , Jingge Zhu

The inference of a large symmetric signal-matrix $\mathbf{S} \in \mathbb{R}^{N\times N}$ corrupted by additive Gaussian noise, is considered for two regimes of growth of the rank $M$ as a function of $N$. For sub-linear ranks…

Information Theory · Computer Science 2024-07-16 Farzad Pourkamali , Jean Barbier , Nicolas Macris

We consider the task of estimating a low-rank matrix from non-linear and noisy observations. We prove a strong universality result showing that Bayes-optimal performances are characterized by an equivalent Gaussian model with an effective…

Machine Learning · Statistics 2024-03-08 Pierre Mergny , Justin Ko , Florent Krzakala , Lenka Zdeborová

This paper considers the channel estimation of a single user in a MISO system with an intelligent reflecting surface (IRS). The performances of the minimum variance unbiased (MVU) and minimum mean square error (MMSE) estimators using the…

Information Theory · Computer Science 2023-09-01 Rıfat Volkan Şenyuva

This paper considers linear minimum meansquare- error (MMSE) transceiver design problems for downlink multiuser multiple-input multiple-output (MIMO) systems where imperfect channel state information is available at the base station (BS)…

Optimization and Control · Mathematics 2013-11-26 Tadilo Endeshaw Bogale , Luc Vandendorpe

This paper extends the "single crossing point" property of the scalar MMSE function, derived by Guo, Shamai and Verd\'u (first presented in ISIT 2008), to the parallel degraded MIMO scenario. It is shown that the matrix Q(t), which is the…

Information Theory · Computer Science 2010-04-27 Ronit Bustin , Miquel Payaró , Daniel P. Palomar , Shlomo Shamai

This paper considers the problem of transmitting the difference of two jointly Gaussian sources over a two-user additive Gaussian noise multiple access channel (MAC). The goal is to recover this difference within an average mean squared…

Information Theory · Computer Science 2008-12-08 Rajiv Soundararajan , Sriram Vishwanath
‹ Prev 1 3 4 5 6 7 10 Next ›