English
Related papers

Related papers: An MMSE Lower Bound via Poincar\'e Inequality

200 papers

We consider the problem of subspace estimation in a Bayesian setting. Since we are operating in the Grassmann manifold, the usual approach which consists of minimizing the mean square error (MSE) between the true subspace $U$ and its…

Methodology · Statistics 2015-05-27 Olivier Besson , Nicolas Dobigeon , Jean-Yves Tourneret

We investigate a power-constrained sensing matrix design problem for a compressed sensing framework. We adopt a mean square error (MSE) performance criterion for sparse source reconstruction in a system where the source-to-sensor channel…

Information Theory · Computer Science 2014-09-29 Amirpasha Shirazinia , Subhrakanti Dey

We consider estimation models of the form $Y=X^*+N$, where $X^*$ is some $m$-dimensional signal we wish to recover, and $N$ is symmetrically distributed noise that may be unbounded in all but a small $\alpha$ fraction of the entries. We…

Machine Learning · Computer Science 2022-11-15 Tommaso d'Orsi , Rajai Nasser , Gleb Novikov , David Steurer

A continuous-time average consensus system is a linear dynamical system defined over a graph, where each node has its own state value that evolves according to a simultaneous linear differential equation. A node is allowed to interact with…

Optimization and Control · Mathematics 2023-03-31 Tadashi Wadayama , Ayano Nakai-Kasai

Noise Contrastive Estimation (NCE) has fueled major breakthroughs in representation learning and generative modeling. Yet a long-standing challenge remains: accurately estimating ratios between distributions that differ substantially, which…

Adding inequality constraints (e.g. boundedness, monotonicity, convexity) into Gaussian processes (GPs) can lead to more realistic stochastic emulators. Due to the truncated Gaussianity of the posterior, its distribution has to be…

This paper studies MMSE estimation on the basis of quantized noisy observations. It presents nonasymptotic bounds on MMSE regret due to quantization for two settings: (1) estimation of a scalar random variable given a quantized vector of…

Information Theory · Computer Science 2015-04-24 Jaeho Lee , Maxim Raginsky , Pierre Moulin

Baseband processing algorithms often require knowledge of the noise power, signal power, or signal-to-noise ratio (SNR). In practice, these parameters are typically unknown and must be estimated. Furthermore, the mean-square error (MSE) is…

Signal Processing · Electrical Eng. & Systems 2023-03-28 Alexandra Gallyas-Sanhueza , Christoph Studer

We consider minimax signal detection in the sequence model. Working with certain ellipsoids in the space of square-summable sequences of real numbers, with a ball of positive radius removed, we obtain upper and lower bounds for the minimax…

Statistics Theory · Mathematics 2017-12-27 Clement Marteau , Theofanis Sapatinas

In this article we have suggested an improved estimator for estimating the population mean in simple random sampling using auxiliary information under the presence of measurement errors. The mean square error (MSE) of the proposed estimator…

Applications · Statistics 2013-12-05 Sachin Malik , Jayant Singh , Rajesh Singh

Weak lensing experiments are a powerful probe of cosmology through their measurement of the mass distribution of the universe. A challenge for this technique is to control systematic errors that occur when measuring the shapes of distant…

Cosmology and Nongalactic Astrophysics · Physics 2015-06-04 Alexandre Refregier , Tomasz Kacprzak , Adam Amara , Sarah Bridle , Barnaby Rowe

We consider a channel $Y=X+N$ where $X$ is a random variable satisfying $\mathbb{E}[|X|]<\infty$ and $N$ is an independent standard normal random variable. We show that the minimum mean-square error estimator of $X$ from $Y,$ which is given…

Information Theory · Computer Science 2021-02-12 Wael Alghamdi , Flavio P. Calmon

We consider the problem of mean estimation assuming only finite variance. We study a new class of mean estimators constructed by integrating over random noise applied to a soft-truncated empirical mean estimator. For appropriate choices of…

Statistics Theory · Mathematics 2019-06-26 Matthew J. Holland

This paper proposes a novel Bayesian reciprocity calibration method that consistently ensures uplink and downlink channel reciprocity in repeater-assisted multiple-input multiple-output (MIMO) systems. The proposed algorithm is formulated…

Signal Processing · Electrical Eng. & Systems 2026-02-06 Shoma Hara , Takumi Takahashi , Hiroki Iimori , Hideki Ochiai , Erik G. Larsson

In this work, we consider the deterministic optimization using random projections as a statistical estimation problem, where the squared distance between the predictions from the estimator and the true solution is the error metric. In…

Optimization and Control · Mathematics 2020-06-16 Srivatsan Sridhar , Mert Pilanci , Ayfer Özgür

Error mitigation is essential for extracting reliable results from quantum computations performed on noisy intermediate-scale quantum hardware. Here we introduce Noise-Robust Estimation (NRE), a noise-agnostic framework that suppresses…

We consider the minimum error entropy (MEE) criterion and an empirical risk minimization learning algorithm in a regression setting. A learning theory approach is presented for this MEE algorithm and explicit error bounds are provided in…

Machine Learning · Computer Science 2013-02-26 Ting Hu , Jun Fan , Qiang Wu , Ding-Xuan Zhou

Joint equalization and decoding schemes are described for two-dimensional intersymbol interference (ISI) channels. Equalization is performed using the minimum mean-square-error (MMSE) criterion. Low-density parity-check codes are used for…

Information Theory · Computer Science 2016-11-18 N. Singla , J. A. O'Sullivan

We present a theoretical framework for characterizing incremental stability of nonlinear stochastic systems perturbed by compound Poisson shot noise and finite-measure L\'{e}vy noise. For each noise type, we compare trajectories of the…

Systems and Control · Electrical Eng. & Systems 2022-06-13 SooJean Han , Soon-Jo Chung

The performance of Neyman-Pearson detection of correlated stochastic signals using noisy observations is investigated via the error exponent for the miss probability with a fixed level. Using the state-space structure of the signal and…

Information Theory · Computer Science 2016-11-17 Youngchul Sung , Lang Tong , H. Vincent Poor