English
Related papers

Related papers: An MSE Based Ttransfer Chart to Analyze Iterative …

200 papers

This paper focuses on the problem of separately modulating and jointly estimating two independent continuous-valued parameters sent over a Gaussian multiple-access channel (MAC) under the mean square error (MSE) criterion. To this end, we…

Information Theory · Computer Science 2016-09-28 Ayse Unsal , Raymond Knopp , Neri Merhav

In this paper, we show that the soft-decision input to the main decoder in an SST Viterbi decoder is regarded as the innovation as well from the viewpoint of mutual information and mean-square error. It is assumed that a code sequence is…

Information Theory · Computer Science 2021-02-16 Masato Tajima

This paper considers the problem of symbol detection in massive multiple-input multiple-output (MIMO) wireless communication systems. We consider hard-thresholding preceeded by two variants of the regularized least squares (RLS) decoder;…

Information Theory · Computer Science 2023-08-11 Ayed M. Alrashdi , Abla Kammoun , Ali H. Muqaibel , Tareq Y. Al-Naffouri

Motivated by emerging technologies for energy efficient analog computing and continuous-time processing, this paper proposes continuous-time minimum mean squared error estimation for multiple-input multiple-output (MIMO) systems based on an…

Information Theory · Computer Science 2022-09-05 Ayano Nakai-Kasai , Tadashi Wadayama

We consider the transmission of a Gaussian vector source over a multi-dimensional Gaussian channel where a random or a fixed subset of the channel outputs are erased. Within the setup where the only encoding operation allowed is a linear…

Information Theory · Computer Science 2015-03-19 Ayça Özçelikkale , Serdar Yüksel , Haldun M. Ozaktas

The minimum mean square error of the estimation of a non Gaussian signal where observed from an additive white Gaussian noise channel's output, is analyzed. First, a quite general time-continuous channel model is assumed for which the…

Information Theory · Computer Science 2010-02-04 Jacob Binia

The Mean Square Error (MSE) has shown its strength when applied in deep generative models such as Auto-Encoders to model reconstruction loss. However, in image domain especially, the limitation of MSE is obvious: it assumes pixel…

Computer Vision and Pattern Recognition · Computer Science 2019-05-01 Yingjing Lu

Mutual information (MI) is one of the most general ways to measure relationships between random variables, but estimating this quantity for complex systems is challenging. Denoising diffusion models have recently set a new bar for density…

Machine Learning · Computer Science 2025-11-20 Longxuan Yu , Xing Shi , Xianghao Kong , Tong Jia , Greg Ver Steeg

We analyze the mean-squared error (MSE) performance of widely linear (WL) and conventional subspace-based channel estimation for single-input multiple-output (SIMO) flat-fading channels employing binary phase-shift-keying (BPSK) modulation…

Information Theory · Computer Science 2015-05-28 Saeed Abdallah , Ioannis N. Psaromiligkos

We consider a general stochastic input-output dynamical system with output evolving in time as the solution to a functional coefficients, It\^{o}'s stochastic differential equation, excited by an input process. This general class of…

Information Theory · Computer Science 2007-10-08 Francisco J. Piera , Patricio Parada

Suppose a linear model y = Hx + n, where inputs x, n are independent Gaussian mixtures. The problem is to design the transfer matrix H so as to minimize the mean square error (MSE) when estimating x from y. This problem has important…

Optimization and Control · Mathematics 2015-06-11 John T. Flåm , Dave Zachariah , Mikko Vehkaperä , Saikat Chatterjee

Despite the simplicity and intuitive interpretation of Minimum Mean Squared Error (MMSE) estimators, their effectiveness in certain scenarios is questionable. Indeed, minimizing squared errors on average does not provide any form of…

Optimization and Control · Mathematics 2019-12-09 Dionysios S. Kalogerias , Luiz F. O. Chamon , George J. Pappas , Alejandro Ribeiro

The paper focuses on minimum mean square error (MMSE) Bayesian estimation for a Gaussian source impaired by additive Middleton's Class-A impulsive noise. In addition to the optimal Bayesian estimator, the paper considers also the…

Information Theory · Computer Science 2016-11-17 Paolo Banelli

The mean square error (MSE)-optimal estimator is known to be the conditional mean estimator (CME). This paper introduces a parametric channel estimation technique based on Bayesian estimation. This technique uses the estimated channel…

Signal Processing · Electrical Eng. & Systems 2025-11-24 Franz Weißer , Wolfgang Utschick

This letter introduces a novel channel coding design framework for short-length codewords that permits balancing the tradeoff between the bit error rate floor and waterfall region by modifying a single real-valued parameter. The proposed…

Information Theory · Computer Science 2016-11-17 Mikel Hernaez , Pedro M. crespo , Javier Del Ser

This note examines the behavior of generalization capabilities - as defined by out-of-sample mean squared error (MSE) - of Linear Gaussian (with a fixed design matrix) and Linear Least Squares regression. Particularly, we consider a…

Statistics Theory · Mathematics 2021-09-21 Karthik Duraisamy

In this paper, we derive new closed-form expressions for the gradient of the mutual information with respect to arbitrary parameters of the two-user multiple access channel (MAC). The derived relations generalize the fundamental relation…

Information Theory · Computer Science 2014-11-07 Samah A. M. Ghanem

The problem of estimating an arbitrary random vector from its observation corrupted by additive white Gaussian noise, where the cost function is taken to be the Minimum Mean $p$-th Error (MMPE), is considered. The classical Minimum Mean…

Information Theory · Computer Science 2016-07-07 Alex Dytso , Ronit Bustin , Daniela Tuninetti , Natasha Devroye , H. Vincent Poor , Shlomo Shamai

Integrated sensing and communication is regarded as a key enabler for next-generation wireless networks. To optimize the transmitted waveform for both sensing and communication, various performance metrics must be considered. This work…

Sparse coding refers to the pursuit of the sparsest representation of a signal in a typically overcomplete dictionary. From a Bayesian perspective, sparse coding provides a Maximum a Posteriori (MAP) estimate of the unknown vector under a…

Signal Processing · Electrical Eng. & Systems 2019-09-04 Dror Simon , Jeremias Sulam , Yaniv Romano , Yue M. Lu , Michael Elad