English
Related papers

Related papers: Mutual Information and Minimum Mean-square Error i…

200 papers

An abstraction for multisensor communication termed the Gaussian Multiplex Channel is presented and analyzed. In this model, the sensor outputs can be added together in any combination through a network of switches, and the combinations can…

Signal Processing · Electrical Eng. & Systems 2024-12-20 Daniel R. Fuhrmann , Muhammad Fahad

In this paper, the minimum mean square error (MMSE) channel estimation for intelligent reflecting surface (IRS) assisted wireless communication systems is investigated. In the considered setting, each row vector of the equivalent channel…

Information Theory · Computer Science 2021-04-06 Mangqing Guo , M. Cenk Gursoy

In this paper, we introduce new Stein identities for gamma target distribution as well as a new non-linear channel specifically designed for gamma inputs. From these two ingredients, we derive an explicit and simple formula for the…

Probability · Mathematics 2019-08-20 Benjamin Arras , Yvik Swan

This letter establishes a unified analytical framework to study the asymptotic average mutual information (AMI) of mixture gamma (MG) distributed fading channels driven by finite input signals in the high signal-to-noise ratio (SNR) regime.…

Information Theory · Computer Science 2021-11-29 Chongjun Ouyang , Sheng Wu , Chunxiao Jiang , Yuanwei Liu , Julian Cheng , Hongwen Yang

This paper focuses on the problem of separately modulating and jointly estimating two independent continuous-valued parameters sent over a Gaussian multiple-access channel (MAC) under the mean square error (MSE) criterion. To this end, we…

Information Theory · Computer Science 2016-09-28 Ayse Unsal , Raymond Knopp , Neri Merhav

When recovering a sparse signal from noisy compressive linear measurements, the distribution of the signal's non-zero coefficients can have a profound effect on recovery mean-squared error (MSE). If this distribution was apriori known, then…

Information Theory · Computer Science 2015-06-05 Jeremy P. Vila , Philip Schniter

We consider generalized linear models in regimes where the number of nonzero components of the signal and accessible data points are sublinear with respect to the size of the signal. We prove a variational formula for the asymptotic mutual…

Information Theory · Computer Science 2020-10-29 Clément Luneau , Jean Barbier , Nicolas Macris

Within the framework of linear vector Gaussian channels with arbitrary signaling, closed-form expressions for the Jacobian of the minimum mean square error and Fisher information matrices with respect to arbitrary parameters of the system…

Information Theory · Computer Science 2009-03-12 M. Payaró , D. P. Palomar

When is optimal estimation linear? It is well known that, when a Gaussian source is contaminated with Gaussian noise, a linear estimator minimizes the mean square estimation error. This paper analyzes, more generally, the conditions for…

Information Theory · Computer Science 2015-03-19 Emrah Akyol , Kumar Viswanatha , Kenneth Rose

The mean square error (MSE)-optimal estimator is known to be the conditional mean estimator (CME). This paper introduces a parametric channel estimation technique based on Bayesian estimation. This technique uses the estimated channel…

Signal Processing · Electrical Eng. & Systems 2025-11-24 Franz Weißer , Wolfgang Utschick

We study the problem of community detection when there is covariate information about the node labels and one observes multiple correlated networks. We provide an asymptotic upper bound on the per-node mutual information as well as a…

Information Theory · Computer Science 2019-12-12 Vaishakhi Mayya , Galen Reeves

For vector Gaussian channels, a precise differential connection between channel capacity and a quantity termed normalized optimal detection error (NODE) is presented. Then, this C-NODE relationship is extended to continuous-time Gaussian…

Information Theory · Computer Science 2017-05-02 Edwin Hammerich

Sensor placement approaches in networks often involve using information-theoretic measures such as entropy and mutual information. We prove that mutual information abides by submodularity and is non-decreasing when considering the mutual…

Information Theory · Computer Science 2024-09-06 George Crowley , Inaki Esnaola

In this paper, we propose a sparse signal estimation algorithm that is suitable for many wireless communication systems, especially for the future millimeter wave and underwater communication systems. This algorithm is not only…

Information Theory · Computer Science 2018-07-20 Chongwen Huang , Lei Liu , Chau Yuen

We consider the problem of sparse normal means estimation in a distributed setting with communication constraints. We assume there are $M$ machines, each holding $d$-dimensional observations of a $K$-sparse vector $\mu$ corrupted by…

Machine Learning · Statistics 2022-02-15 Chen Amiraz , Robert Krauthgamer , Boaz Nadler

Tight bounds on the minimum mean square error for the additive Gaussian noise channel are derived, when the input distribution is constrained to be epsilon-close to a Gaussian reference distribution in terms of the Kullback--Leibler…

Statistics Theory · Mathematics 2018-04-27 Michael Fauss , Alex Dytso , Abdelhak M. Zoubir , H. Vincent Poor

The mutual information between a complex-valued channel input and its complex-valued output is decomposed into four parts based on polar coordinates: an amplitude term, a phase term, and two mixed terms. Numerical results for the additive…

Information Theory · Computer Science 2015-03-13 Bernhard Goebel , René-Jean Essiambre , Gerhard Kramer , Peter J. Winzer , Norbert Hanik

We consider channel estimation (CE) in narrowband Internet-of-Things (NB-IoT) systems. Due to the fluctuations in phase within receiver and transmitter oscillators, and also the residual frequency offset (FO) caused by discontinuous…

Information Theory · Computer Science 2017-10-02 Fredrik Rusek , Sha Hu

This paper is devoted to the study of the performance of the Linear Minimum Mean-Square Error receiver for (receive) correlated Multiple-Input Multiple-Output systems. By the random matrix theory, it is well-known that the Signal-to-Noise…

Information Theory · Computer Science 2008-10-17 Abla Kammoun , Malika Kharouf , Walid Hachem , Jamal Najim

In this paper, we focus on the convex mutual information, which was found at the lowest level split in multilevel coding schemes with communications over the additive white Gaussian noise (AWGN) channel. Theoretical analysis shows that…

Information Theory · Computer Science 2021-05-25 Mingxi Yin , Bingli Jiao , Dongsheng Zheng , Yuli Yang