English
Related papers

Related papers: Bayesian Estimation of a Gaussian source in Middle…

200 papers

Consider the problem of estimating a random variable $X$ from noisy observations $Y = X+ Z$, where $Z$ is standard normal, under the $L^1$ fidelity criterion. It is well known that the optimal Bayesian estimator in this setting is the…

Statistics Theory · Mathematics 2024-08-08 Leighton P. Barnes , Alex Dytso , Jingbo Liu , H. Vincent Poor

The fundamental task of a digital receiver is to decide the transmitted symbols in the best possible way, i.e., with respect to an appropriately defined performance metric. Examples of usual performance metrics are the probability of error…

Information Theory · Computer Science 2013-03-19 Dimitrios Katselis , Cristian R. Rojas , Håkan Hjalmarsson , Mats Bengtsson , Mikael Skoglund

In this manuscript, we propose to use a variational autoencoder-based framework for parameterizing a conditional linear minimum mean squared error estimator. The variational autoencoder models the underlying unknown data distribution as…

Signal Processing · Electrical Eng. & Systems 2024-08-23 Michael Baur , Benedikt Fesl , Wolfgang Utschick

In this paper, online linear regression in environments corrupted by non-Gaussian noise (especially heavy-tailed noise) is addressed. In such environments, the error between the system output and the label also does not follow a Gaussian…

Information Theory · Computer Science 2021-05-13 Sajjad Bahrami , Ertem Tuncel

This paper presents adaptive bidirectional minimum mean-square error (MMSE) parameter estimation algorithms for fast-fading channels. The time correlation between successive channel gains is exploited to improve the estimation and tracking…

Information Theory · Computer Science 2013-06-12 Patrick Clarke , Rodrigo C. de Lamare

Accurate knowledge of transmission line parameters is essential for a variety of power system monitoring, protection, and control applications. The use of phasor measurement unit (PMU) data for transmission line parameter estimation (TLPE)…

Signal Processing · Electrical Eng. & Systems 2022-08-30 Antos Cheeramban Varghese , Anamitra Pal , Gautam Dasarathy

In this paper, we investigate power-constrained sensing matrix design in a sparse Gaussian linear dimensionality reduction framework. Our study is carried out in a single--terminal setup as well as in a multi--terminal setup consisting of…

Information Theory · Computer Science 2015-10-28 Amirpasha Shirazinia , Subhrakanti Dey

In this paper, we investigate a Bayesian sparse reconstruction algorithm called compressive sensing via Bayesian support detection (CS-BSD). This algorithm is quite robust against measurement noise and achieves the performance of a minimum…

Information Theory · Computer Science 2012-05-15 Jaewook Kang , Heung-No Lee , Kiseon Kim

We consider benchmarked empirical Bayes (EB) estimators under the basic area-level model of Fay and Herriot while requiring the standard benchmarking constraint. In this paper we determine the excess mean squared error (MSE) from…

Methodology · Statistics 2013-04-08 Rebecca C. Steorts , Malay Ghosh

We consider the problem of sparse normal means estimation in a distributed setting with communication constraints. We assume there are $M$ machines, each holding $d$-dimensional observations of a $K$-sparse vector $\mu$ corrupted by…

Machine Learning · Statistics 2022-02-15 Chen Amiraz , Robert Krauthgamer , Boaz Nadler

For enhancing noisy signals, machine-learning based single-channel speech enhancement schemes exploit prior knowledge about typical speech spectral structures. To ensure a good generalization and to meet requirements in terms of…

Sound · Computer Science 2018-01-17 Robert Rehr , Timo Gerkmann

We investigate schemes for Hamiltonian parameter estimation of a two-level system using repeated measurements in a fixed basis. The simplest (Fourier based) schemes yield an estimate with a mean square error (MSE) that decreases at best as…

We present a neural network based predictor which is derived by starting from the linear minimum mean squared error (LMMSE) predictor and by further making two key assumptions. With these assumptions, we first derive a weighted sum of LMMSE…

Information Theory · Computer Science 2019-11-19 Nurettin Turan , Wolfgang Utschick

We establish exact asymptotic expressions for the normalized mutual information and minimum mean-square-error (MMSE) of sparse linear regression in the sub-linear sparsity regime. Our result is achieved by a generalization of the adaptive…

Information Theory · Computer Science 2023-04-11 Lan V. Truong

We consider the problem of recovering random graph signals from nonlinear measurements. For this case, closed-form Bayesian estimators are usually intractable and even numerical evaluation of these estimators may be hard to compute for…

Signal Processing · Electrical Eng. & Systems 2022-06-23 Ariel Kroizer , Tirza Routtenberg , Yonina C. Eldar

This note studies a method for the efficient estimation of a finite number of unknown parameters from linear equations, which are perturbed by Gaussian noise. In case the unknown parameters have only few nonzero entries, the proposed…

Systems and Control · Computer Science 2014-05-27 Liang Dai , Kristiaan Pelckmans

This paper considers mean square error (MSE) analysis for stochastic gradient sampling algorithms applied to underdamped Langevin dynamics under a global convexity assumption. A novel discrete Poisson equation framework is developed to…

Numerical Analysis · Mathematics 2025-11-07 Jianfeng Lu , Xuda Ye , Zhennan Zhou

We present an asymptotic analysis of the minimum probability of error (MPE) in inferring the correct hypothesis in a Bayesian multi-hypothesis testing (MHT) formalism using many pixels of data that are corrupted by signal dependent shot…

Optics · Physics 2015-06-19 Sudhakar Prasad

In this letter, we consider two sets of observations defined as subspace signals embedded in noise and we wish to analyze the distance between these two subspaces. The latter entails evaluating the angles between the subspaces, an issue…

Methodology · Statistics 2015-06-17 Olivier Besson , Nicolas Dobigeon , Jean-Yves Tourneret

Consider random linear estimation with Gaussian measurement matrices and noise. One can compute infinitesimal variations of the mutual information under infinitesimal variations of the signal-to-noise ratio or of the measurement rate. We…

Information Theory · Computer Science 2017-04-14 Jean Barbier , Nicolas Macris