English
Related papers

Related papers: Some Relations between Divergence Derivatives and …

200 papers

We consider the distributional connection between the lossy compressed representation of a high-dimensional signal $X$ using a random spherical code and the observation of $X$ under an additive white Gaussian noise (AWGN). We show that the…

Information Theory · Computer Science 2021-12-14 Alon Kipnis , Galen Reeves

The achievable and converse regions for sparse representation of white Gaussian noise based on an overcomplete dictionary are derived in the limit of large systems. Furthermore, the marginal distribution of such sparse representations is…

Information Theory · Computer Science 2017-02-13 Ori Shental

Minimum mean squared error (MMSE) estimators of signals from samples corrupted by jitter (timing noise) and additive noise are nonlinear, even when the signal prior and additive noise have normal distributions. This paper develops a…

Applications · Statistics 2015-03-24 Daniel S. Weller , Vivek K Goyal

This paper proposes a new family of lower and upper bounds on the minimum mean squared error (MMSE). The key idea is to minimize/maximize the MMSE subject to the constraint that the joint distribution of the input-output statistics lies in…

Information Theory · Computer Science 2020-06-09 Michael Fauß , Alex Dysto , H. Vincent Poor

Recently, Tian et al. [1] considered joint source-channel coding of transmitting a Gaussian source over $K$-user Gaussian broadcast channel, and derived an outer bound on the admissible distortion region. In [1], they stated "due to its…

Information Theory · Computer Science 2016-11-17 Lei Yu , Houqiang Li , Weiping Li

Performance guarantees for compression in nonlinear models under non-Gaussian observations can be achieved through the use of distributional characteristics that are sensitive to the distance to normality, and which in particular return the…

Statistics Theory · Mathematics 2017-10-03 Larry Goldstein , Xiaohan Wei

The symbol error rate of the minimum distance detector for an arbitrary multi-dimensional constellation impaired by additive white Gaussian noise is characterized as the product of a completely monotone function with a non-negative power of…

Information Theory · Computer Science 2013-01-21 Adithya Rajan , Cihan Tepedelenlioglu

In this paper we consider the classical capacity problem for Gaussian measurement channels without imposing any kind of threshold condition. We prove Gaussianity of the average state of the optimal ensemble in general and discuss the…

Quantum Physics · Physics 2022-04-04 A. S. Holevo

As the array dimension of massive MIMO systems increases to unprecedented levels, two problems occur. First, the spatial stationarity assumption along the antenna elements is no longer valid. Second, the large array size results in an…

Information Theory · Computer Science 2024-01-25 Tianyu Yang , Johannes Maly , Sjoerd Dirksen , Giuseppe Caire

We derive a method to reconstruct Gaussian signals from linear measurements with Gaussian noise. This new algorithm is intended for applications in astrophysics and other sciences. The starting point of our considerations is the principle…

Instrumentation and Methods for Astrophysics · Physics 2011-10-18 Niels Oppermann , Georg Robbers , Torsten A. Ensslin

Information transmission over discrete-time channels with memoryless additive noise obeying a Cauchy, rather than Gaussian, distribution, are studied. The channel input satisfies an average power constraint. Upper and lower bounds to such…

Information Theory · Computer Science 2024-11-19 Shuqin Pang , Wenyi Zhang

From a wavelet analysis, one derives a nonparametrical estimator for the spectral density of a Gaussian process with stationary increments. First, the idealistic case of a continuous time path of the process is considered. A punctual…

Statistics Theory · Mathematics 2008-07-03 Jean-Marc Bardet , Pierre Bertrand , Véronique Billat

We revisit the problem of estimating the mean of a real-valued distribution, presenting a novel estimator with sub-Gaussian convergence: intuitively, "our estimator, on any distribution, is as accurate as the sample mean is for the Gaussian…

Statistics Theory · Mathematics 2020-11-18 Jasper C. H. Lee , Paul Valiant

This study is to investigate the feasibility of least square method in fitting non-Gaussian noise data. We add different levels of the two typical non-Gaussian noises, L\'evy and stretched Gaussian noises, to exact value of the selected…

Other Statistics · Statistics 2018-01-17 Wei Xu , Wen Chen , Yingjie Liang

There are two major routes to address the ubiquitous family of inverse problems appearing in signal and image processing, such as denoising or deblurring. A first route relies on Bayesian modeling, where prior probabilities are used to…

Statistics Theory · Mathematics 2026-03-24 Rémi Gribonval , Mila Nikolova

A very important property of a statistical distribution is to know whether it obeys Gaussian statistics or not. On the one hand, it is of paramount importance in the context of CMB anisotropy studies, since deviations from a Gaussian…

Astrophysics · Physics 2009-10-31 N. Aghanim , O. Forni , F. R. Bouchet

We construct an adaptive wavelet estimator that attains minimax near-optimal rates in a wide range of Besov balls. The convergence rates are affected only by the weakest dependence amongst the channels, and take into account both noise…

Statistics Theory · Mathematics 2018-06-20 Rida Benhaddou

We propose an adversarial evaluation framework for sensitive feature inference based on minimum mean-squared error (MMSE) estimation with a finite sample size and linear predictive models. Our approach establishes theoretical lower bounds…

Machine Learning · Statistics 2025-05-15 Monica Welfert , Nathan Stromberg , Mario Diaz , Lalitha Sankar

This paper studies the achievable rates of Gaussian interference channels with additive white Gaussian noise (AWGN), when improper or circularly asymmetric complex Gaussian signaling is applied. For the Gaussian multiple-input…

Information Theory · Computer Science 2016-11-18 Yong Zeng , Cenk M. Yetis , Erry Gunawan , Yong Liang Guan , Rui Zhang

In order to analyze data produced by the kilometer-scale gravitational wave detectors that will begin operation early next century, one needs to develop robust statistical tools capable of extracting weak signals from the detector noise.…

General Relativity and Quantum Cosmology · Physics 2010-01-06 Jolien D. E. Creighton