English
Related papers

Related papers: Minimum Mean Square Error Estimation Under Gaussia…

200 papers

In this paper we have proposed a general class of modified regression type estimator in systematic sampling under non-response to estimate the population mean using auxiliary information. The expressions of bias and mean square error (MSE)…

Methodology · Statistics 2013-06-27 Hemant Verma , R. D. Singh , Rajesh Singh

We compare the latest results from CMB experiments at scales around $l_e \sim 150$ over different parts of the sky to test the hypothesis that they are drawn from a Gaussian distribution, as is usually assumed. Using both the diagonal and…

Astrophysics · Physics 2009-10-30 E. Gaztanaga , P. Fosalba , E. Elizalde

We study schemes and lower bounds for distributed minimax statistical estimation over a Gaussian multiple-access channel (MAC) under squared error loss, in a framework combining statistical estimation and wireless communication. First, we…

Information Theory · Computer Science 2021-03-09 Chuan-Zheng Lee , Leighton Pate Barnes , Ayfer Ozgur

In this paper we have considered the problem of estimating the population mean in systematic sampling using information on an auxiliary variable in presence of non response. Some modified ratio, product and difference type estimators in…

Methodology · Statistics 2014-03-06 Hemant K. Verma , R. D. Singh , Rajesh Singh

This paper gives a replica analysis for the minimum mean square error (MSE) of a massive multiple-input multiple-output (MIMO) system by using Bayesian inference. The Bayes-optimal estimator is adopted to estimate the data symbols and the…

Information Theory · Computer Science 2016-11-15 Chao-Kai Wen , Yongpeng Wu , Kai-Kit Wong , Robert Schober , Pangan Ting

We revisit the problem of Gaussian mean testing in a distributed, communication constrained setting, where each of $n$ users independently observes samples from an unknown $d$-dimensional spherical Gaussian distribution…

Data Structures and Algorithms · Computer Science 2026-05-29 Clément L. Canonne , Nimitt

In this work, we use real-world data in order to evaluate and validate a machine learning (ML)-based algorithm for physical layer functionalities. Specifically, we apply a recently introduced Gaussian mixture model (GMM)-based algorithm in…

Information Theory · Computer Science 2022-07-29 Nurettin Turan , Benedikt Fesl , Moritz Grundei , Michael Koller , Wolfgang Utschick

In this paper, we study the problem of learning one-dimensional Gaussian mixture models (GMMs) with a specific focus on estimating both the model order and the mixing distribution from independent and identically distributed (i.i.d.)…

Machine Learning · Statistics 2026-02-24 Xinyu Liu , Hai Zhang

We describe a general technique that yields the first {\em Statistical Query lower bounds} for a range of fundamental high-dimensional learning problems involving Gaussian distributions. Our main results are for the problems of (1) learning…

Machine Learning · Computer Science 2017-05-18 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

We present the derivation of post-processing SNR for Minimum-Mean-Squared-Error (MMSE) receivers with imperfect channel estimates, and show that it is an accurate indicator of the error rate performance of MIMO systems in the presence of…

Performance · Computer Science 2016-11-15 Eren Eraslan , Babak Daneshrad , Chung-Yu Lou

Best linear unbiased prediction is well known for its wide range of applications including small area estimation. While the theory is well established for mixed linear models and under normality of the error and mixing distributions, the…

Statistics Theory · Mathematics 2007-06-13 Soumendra N. Lahiri , Tapabrata Maiti , Myron Katzoff , Van Parsons

We consider a channel $Y=X+N$ where $X$ is a random variable satisfying $\mathbb{E}[|X|]<\infty$ and $N$ is an independent standard normal random variable. We show that the minimum mean-square error estimator of $X$ from $Y,$ which is given…

Information Theory · Computer Science 2021-02-12 Wael Alghamdi , Flavio P. Calmon

The James-Stein estimator's dominance over maximum likelihood in terms of mean square error (MSE) has been one of the most celebrated results in modern statistics, suggesting that biased estimators can systematically outperform unbiased…

Statistics Theory · Mathematics 2025-08-12 Paul W. Vos

The term ``empirical predictor'' refers to a two-stage predictor of a linear combination of fixed and random effects. In the first stage, a predictor is obtained but it involves unknown parameters; thus, in the second stage, the unknown…

Statistics Theory · Mathematics 2007-06-13 Kalyan Das , Jiming Jiang , J. N. K. Rao

For optimization on large-scale data, exactly calculating its solution may be computationally difficulty because of the large size of the data. In this paper we consider subsampled optimization for fast approximating the exact solution. In…

Machine Learning · Statistics 2018-04-11 Rong Zhu , Jiming Jiang

We consider generalized linear models in regimes where the number of nonzero components of the signal and accessible data points are sublinear with respect to the size of the signal. We prove a variational formula for the asymptotic mutual…

Information Theory · Computer Science 2020-10-29 Clément Luneau , Jean Barbier , Nicolas Macris

This article presents the formulation and steady-state analysis of the distributed estimation algorithms based on the diffusion cooperation scheme in the presence of errors due to the unreliable data transfer among nodes. In particular, we…

Systems and Control · Computer Science 2013-10-29 Saeed Ghazanfari-Rad , Fabrice Labeau

We study the estimation error of constrained M-estimators, and derive explicit upper bounds on the expected estimation error determined by the Gaussian width of the constraint set. Both of the cases where the true parameter is on the…

Statistics Theory · Mathematics 2015-06-29 Yen-Huan Li , Ya-Ping Hsieh , Nissim Zerbib , Volkan Cevher

Robust diffusion adaptive estimation algorithms based on the maximum correntropy criterion (MCC), including adaptation to combination MCC and combination to adaptation MCC, are developed to deal with the distributed estimation over network…

Machine Learning · Statistics 2016-02-04 Wentao Ma , Badong Chen , Jiandong Duan , Haiquan Zhao

Graphical models are a framework for representing and exploiting prior conditional independence structures within distributions using graphs. In the Gaussian case, these models are directly related to the sparsity of the inverse covariance…

Statistics Theory · Mathematics 2015-10-28 Ami Wiesel , Yonina C. Eldar , Alfred O. Hero