English
Related papers

Related papers: Some Relations between Divergence Derivatives and …

200 papers

We consider least squares estimation in a general nonparametric regression model. The rate of convergence of the least squares estimator (LSE) for the unknown regression function is well studied when the errors are sub-Gaussian. We find…

Statistics Theory · Mathematics 2021-04-12 Arun K. Kuchibhotla , Rohit K. Patra

Many of the classical and recent relations between information and estimation in the presence of Gaussian noise can be viewed as identities between expectations of random quantities. These include the I-MMSE relationship of Guo et al.; the…

Information Theory · Computer Science 2012-05-02 Kartik Venkat , Tsachy Weissman

Minimum mean square error (MMSE) estimation of block sparse signals from noisy linear measurements is considered. Unlike in the standard compressive sensing setup where the non-zero entries of the signal are independently and uniformly…

Information Theory · Computer Science 2012-04-26 Mikko Vehkaperä , Saikat Chatterjee , Mikael Skoglund

We introduce a model of non-Gaussian quantum channel that stems from the combination of two physically relevant processes occurring in open quantum systems, namely amplitude damping and dephasing. For it we find input states approaching…

Quantum Physics · Physics 2016-09-07 Laleh Memarzadeh , Stefano Mancini

The sampling, quantization, and estimation of a bounded dynamic-range bandlimited signal affected by additive independent Gaussian noise is studied in this work. For bandlimited signals, the distortion due to additive independent Gaussian…

Information Theory · Computer Science 2012-11-29 Animesh Kumar , Vinod M. Prabhakaran

Suppose a linear model y = Hx + n, where inputs x, n are independent Gaussian mixtures. The problem is to design the transfer matrix H so as to minimize the mean square error (MSE) when estimating x from y. This problem has important…

Optimization and Control · Mathematics 2015-06-11 John T. Flåm , Dave Zachariah , Mikko Vehkaperä , Saikat Chatterjee

The conditional mean is a fundamental and important quantity whose applications include the theories of estimation and rate-distortion. It is also notoriously difficult to work with. This paper establishes novel bounds on the differential…

Information Theory · Computer Science 2022-11-23 Arda Atalik , Alper Köse , Michael Gastpar

Estimation of a deterministic quantity observed in non-Gaussian additive noise is explored via order statistics approach. More specifically, we study the estimation problem when measurement noises either have positive supports or follow a…

Signal Processing · Electrical Eng. & Systems 2020-07-15 Kamiar Radnosrati , Gustaf Hendeby , Fredrik Gustafsson

The feedback capacity of the stationary Gaussian additive noise channel has been open, except for the case where the noise is white. Here we find the feedback capacity of the stationary first-order moving average additive Gaussian noise…

Information Theory · Computer Science 2007-07-16 Young-Han Kim

We present a method for estimating conditionally Gaussian random vectors with random covariance matrices, which uses techniques from the field of machine learning. Such models are typical in communication systems, where the covariance…

Information Theory · Computer Science 2018-02-07 David Neumann , Thomas Wiese , Wolfgang Utschick

Signal processing in non-Gaussian noise environment is addressed in this paper. For many real-life situations, the additive noise process present in the system is found to be dominantly non-Gaussian. The problem of detection and estimation…

Statistics Theory · Mathematics 2014-01-23 Jugalkishore K. Banoth , Pradip Sircar

We consider a channel $Y=X+N$ where $X$ is a random variable satisfying $\mathbb{E}[|X|]<\infty$ and $N$ is an independent standard normal random variable. We show that the minimum mean-square error estimator of $X$ from $Y,$ which is given…

Information Theory · Computer Science 2021-02-12 Wael Alghamdi , Flavio P. Calmon

The long-standing conjectures of the optimality of Gaussian inputs for Gaussian channel and Gaussian additivity are solved for a broad class of covariant or contravariant Bosonic Gaussian channels (which includes in particular thermal,…

Quantum Physics · Physics 2015-03-04 V. Giovannetti , A. S. Holevo , R. Garcia-Patron

For a quantum channel of additive Gaussian noise with loss, in the general case of $n$ copies input, we show that up to first order perturbation, any non-Gaussian perturbation to the product thermal state input has a less quantum…

Quantum Physics · Physics 2007-10-03 Xiao-yu Chen

In this work, we propose variations of a Gaussian mixture model (GMM) based channel estimator that was recently proven to be asymptotically optimal in the minimum mean square error (MMSE) sense. We account for the need of low computational…

Information Theory · Computer Science 2023-06-06 Benedikt Fesl , Michael Joham , Sha Hu , Michael Koller , Nurettin Turan , Wolfgang Utschick

So far, there have been plenty of literatures on the metric in the space of probability distributions and quantum states. As for channels, however, only a little had been known. In this paper, we impose monotonicity by concatenation of…

Quantum Physics · Physics 2010-06-03 Keiji Matsumoto

A continuous-time regression model with a jointly strictly sub-Gaussian random noise is considered in the paper. Upper exponential bounds for probabilities of large deviations of the least squares estimator for the regression parameter are…

Probability · Mathematics 2018-06-12 Alexander V. Ivanov , Igor V. Orlovskyi

We show that the minimum von-Neumann entropy output of a quantum channel is locally additive. Hasting's counterexample for the additivity conjecture, makes this result quite surprising. In particular, it indicates that the non-additivity of…

Quantum Physics · Physics 2012-10-03 Gilad Gour , Shmuel Friedland

Gaussian quantum channels are relevant operations in continuous variable systems. In general, given an arbitrary state, the action on it is well-known provided that the quantum channels are completely characterized. In this work, we…

Quantum Physics · Physics 2025-05-20 Jonas F. G. Santos , Carlos H. S. Vieira , Wilder R. Cardoso

Fundamental relations between information and estimation have been established in the literature for the continuous-time Gaussian and Poisson channels, in a long line of work starting from the classical representation theorems by Duncan and…

Information Theory · Computer Science 2017-04-19 Jiantao Jiao , Kartik Venkat , Tsachy Weissman