English
Related papers

Related papers: On mutual information, likelihood-ratios and estim…

200 papers

Wyner's Common Information and a natural relaxation are studied in the special case of Gaussian random variables. The relaxation replaces conditional independence by a bound on the conditional mutual information. The main contribution is…

Information Theory · Computer Science 2020-09-29 Erixhen Sula , Michael Gastpar

The statistical analysis of the fading End to End channel gain of the amplify and forward relaying protocol, however, is well known as extremely complex, and research work to date have only studied the asymptotic behaviour of the outage…

Information Theory · Computer Science 2016-04-22 Quoc Tuan Nguyen , D. T. Nguyen , Cong Lam Sinh

We describe a general approach to detection of transient gravitational-wave signals in the presence of non-Gaussian background noise. We prove that under quite general conditions, the ratio of the likelihood of observed data to contain a…

Using a semi-parametric approach based on the fourth-order Edgeworth expansion for the unknown signal distribution, we derive an explicit expression for the likelihood detection statistic in the presence of non-normally distributed…

Cosmology and Nongalactic Astrophysics · Physics 2015-06-19 Lionel Martellini , Tania Regimbau

Consider a fading Gaussian MIMO channel with $N_\mathrm{t}$ transmit and $N_\mathrm{r}$ receive antennas. The transmitter selects $L_\mathrm{t}$ antennas corresponding to the strongest channels. For this setup, we study the distribution of…

Information Theory · Computer Science 2017-04-28 Saba Asaad , Ali Bereyhi , Ralf R. Müller , Amir M. Rabiei

The intensity statistics of signals in the presence of Gaussian noise is obtained by studying the model of a random signal plus a random phasor sum. The additive Gaussian noise is shown to result in a Bessel transform of the probability…

Disordered Systems and Neural Networks · Physics 2015-05-13 A. A. Chabanov

We consider distributed estimation of a Gaussian source in a heterogenous bandwidth constrained sensor network, where the source is corrupted by independent multiplicative and additive observation noises, with incomplete statistical…

Information Theory · Computer Science 2018-05-23 Alireza Sani , Azadeh Vosoughi

This paper focuses on the problem of separately modulating and jointly estimating two independent continuous-valued parameters sent over a Gaussian multiple-access channel (MAC) under the mean square error (MSE) criterion. To this end, we…

Information Theory · Computer Science 2016-09-28 Ayse Unsal , Raymond Knopp , Neri Merhav

Motivated by applications to group synchronization and quadratic assignment on random data, we study a general problem of Bayesian inference of an unknown ``signal'' belonging to a high-dimensional compact group, given noisy pairwise…

Statistics Theory · Mathematics 2025-12-23 Kaylee Y. Yang , Timothy L. H. Wee , Zhou Fan

The transmission of digital data is one of the principal tasks in modern wireless communication. Classically, the communication channel consists of one transmitter and one receiver; however, due to the constantly increasing demand in higher…

Information Theory · Computer Science 2015-01-08 Andrei Osipov

The problem of transmitting a parameter value over an additive white Gaussian noise (AWGN) channel is considered, where, in addition to the transmitter and the receiver, there is a helper that observes the noise non-causally and provides a…

Information Theory · Computer Science 2024-10-28 Anatoly Khina , Neri Merhav

Tight bounds on the minimum mean square error for the additive Gaussian noise channel are derived, when the input distribution is constrained to be epsilon-close to a Gaussian reference distribution in terms of the Kullback--Leibler…

Statistics Theory · Mathematics 2018-04-27 Michael Fauss , Alex Dytso , Abdelhak M. Zoubir , H. Vincent Poor

Non-data-aided (NDA) parameter estimation is considered for binary-phase-shift-keying transmission in an additive white Gaussian noise channel. Cramer-Rao lower bounds (CRLBs) for signal amplitude, noise variance, channel reliability…

Information Theory · Computer Science 2007-07-13 Fredrik Brannstrom , Lars K. Rasmussen

We extend previous results on covert communication over the additive white Gaussian noise channel to two other types of additive noise channels. The first is the Gaussian channel with memory, where the noise sequence is a Gaussian vector…

Information Theory · Computer Science 2023-03-22 Cécile Bouette , Laura Luzzi , Ligong Wang

A continuous-time white Gaussian channel can be formulated using a white Gaussian noise, and a conventional way for examining such a channel is the sampling approach based on the classical Shannon-Nyquist sampling theorem, where the…

Probability · Mathematics 2018-10-19 Xianming Liu , Guangyue Han

The first terms of the low-signal-energy asymptotics for the mutual information in the discrete-time Poisson channel are derived and compared to an asymptotic expression of the capacity. In the presence of non-zero additive noise (either…

Information Theory · Computer Science 2008-08-21 Alfonso Martinez

This paper deals with Bayesian inference of a mixture of Gaussian distributions. A novel formulation of the mixture model is introduced, which includes the prior constraint that each Gaussian component is always assigned a minimal number of…

Methodology · Statistics 2014-05-21 Colin J. Stoneking

Consider the problem of estimating a random variable $X$ from noisy observations $Y = X+ Z$, where $Z$ is standard normal, under the $L^1$ fidelity criterion. It is well known that the optimal Bayesian estimator in this setting is the…

Statistics Theory · Mathematics 2024-08-08 Leighton P. Barnes , Alex Dytso , Jingbo Liu , H. Vincent Poor

In this work, we consider linear-feedback schemes for the two-user Gaussian broadcast channel with noiseless feedback. We extend the transmission scheme of [Ozarow and Leung, 1984] by applying estimators with memory instead of the…

Information Theory · Computer Science 2014-12-23 Yonathan Murin , Yonatan Kaspi , Ron Dabora

We consider the problem of learning high-dimensional, nonparametric and structured (e.g. Gaussian) distributions in distributed networks, where each node in the network observes an independent sample from the underlying distribution and can…

Information Theory · Computer Science 2019-06-04 Leighton Pate Barnes , Yanjun Han , Ayfer Ozgur