English
Related papers

Related papers: The Cramer-Rao Bound for Sparse Estimation

200 papers

Target parameter estimation performance is investigated for a radar employing a set of widely separated transmitting and receiving antenna arrays. Cases with multiple extended targets are considered under two signal model assumptions:…

Information Theory · Computer Science 2018-08-02 Peter Khomchuk , Igal Bilik , Rick S. Blum

The goal of predictive sparse coding is to learn a representation of examples as sparse linear combinations of elements from a dictionary, such that a learned hypothesis linear in the new representation performs well on a predictive task.…

Machine Learning · Computer Science 2012-10-09 Nishant A. Mehta , Alexander G. Gray

Learning low-dimensional latent representations is a central topic in statistics and machine learning, and rotation methods have long been used to obtain sparse and interpretable representations. Despite nearly a century of widespread use…

Methodology · Statistics 2026-02-27 Chengyu Cui , Yunxiao Chen , Jing Ouyang , Gongjun Xu

The minimum mean-square error (MMSE) achievable by optimal estimation of a random variable $Y\in\mathbb{R}$ given another random variable $X\in\mathbb{R}^{d}$ is of much interest in a variety of statistical settings. In the context of…

Information Theory · Computer Science 2022-07-12 Mario Diaz , Peter Kairouz , Lalitha Sankar

Already since the work by Abbe and Rayleigh the difficulty of super resolution where one wants to recover a collection of point sources from low-resolved microscopy measurements is thought to be dependent on whether the distance between the…

Numerical Analysis · Mathematics 2023-11-07 Mathias Hockmann

Recently, several high-resolution parameter estimation algorithms have been developed to exploit the structure of strictly second-order (SO) non-circular (NC) signals. They achieve a higher estimation accuracy and can resolve up to twice as…

Information Theory · Computer Science 2016-08-24 Jens Steinwandt , Florian Roemer , Martin Haardt , Giovanni Del Galdo

Threshold and ambiguity phenomena are studied in Part 1 of this work where approximations for the mean-squared-error (MSE) of the maximum likelihood estimator are proposed using the method of interval estimation (MIE), and where approximate…

Applications · Statistics 2015-06-19 Achraf Mallat , Sinan Gezici , Davide Dardari , Luc Vandendorpe

Sparse modeling has been widely and successfully used in many applications such as computer vision, machine learning, and pattern recognition. Accompanied with those applications, significant research has studied the theoretical limits and…

Information Theory · Computer Science 2016-10-04 Yuki Itoh , Marco F. Duarte , Mario Parente

The performance of near-field sensing (NISE) in a legacy wideband multiple-input multiple-output (MIMO) orthogonal frequency-division multiplexing (OFDM) communication system is analyzed. The maximum likelihood estimates (MLE) for the…

Information Theory · Computer Science 2025-06-13 Zhaolin Wang , Xidong Mu , Yuanwei Liu

The sparse signal processing literature often uses random sensing matrices to obtain performance guarantees. Unfortunately, in the real world, sensing matrices do not always come from random processes. It is therefore desirable to evaluate…

Functional Analysis · Mathematics 2018-03-06 Dustin G. Mixon , Waheed U. Bajwa , Robert Calderbank

This paper addresses the fundamental performance limits of Integrated Sensing and Communication (ISAC) systems by introducing a novel converse bound based on rate-distortion theory. This rate-distortion bound (RDB) overcomes the restrictive…

Information Theory · Computer Science 2025-10-10 Mohammadreza Bakhshizadeh Mohajer , Alex Dytso , Daniela Tuninetti , Luca Barletta

We determine the bound to the maximum achievable sensitivity in the estimation of a scalar parameter from the information contained in an optical image in the presence of quantum noise. This limit, based on the Cramer-Rao bound, is valid…

Quantum Physics · Physics 2016-08-16 Vincent Delaubert , Nicolas Treps , Claude Fabre , Hans A. Bachor , Philippe Réfrégier

Recently there has been a great deal of interest surrounding the calibration of quantum sensors using machine learning techniques. In this work, we explore the use of regression to infer a machine-learned point estimate of an unknown…

Quantum Physics · Physics 2024-06-19 Samuel P. Nolan , Luca Pezzè , Augusto Smerzi

A sparse or compressible signal can be recovered from a certain number of noisy random projections, smaller than what dictated by classic Shannon/Nyquist theory. In this paper, we derive the closed-form expression of the mean square error…

Information Theory · Computer Science 2014-03-10 Giulio Coluccia , Aline Roumy , Enrico Magli

This work examines risk bounds for nonparametric distributional regression estimators. For convex-constrained distributional regression, general upper bounds are established for the continuous ranked probability score (CRPS) and the…

This paper considers estimation of sparse covariance matrices and establishes the optimal rate of convergence under a range of matrix operator norm and Bregman divergence losses. A major focus is on the derivation of a rate sharp minimax…

Statistics Theory · Mathematics 2013-02-14 T. Tony Cai , Harrison H. Zhou

Estimating covariance matrices with high-dimensional complex data presents significant challenges, particularly concerning positive definiteness, sparsity, and numerical stability. Existing robust sparse estimators often fail to guarantee…

Methodology · Statistics 2025-12-30 Shaoxin Wang , Ziyun Ma

The paper derives the theoretical Cramer-Rao lower bound for parameter estimation of a source (of emitting energy, gas, aerosol), monitored by a network of sensors providing binary measurements. The theoretical bound is studied in the…

Applications · Statistics 2014-05-30 Branko Ristic , Ajith Gunatilaka , Ralph Gailis

In order to provide a guaranteed precision and a more accurate judgement about the true value of the Cram\'{e}r-Rao bound and its scaling behavior, an upper bound (equivalently a lower bound on the quantum Fisher information) for precision…

Quantum Physics · Physics 2017-05-04 R. Yousefjani , S. Salimi , A. S. Khorashad

The problem of distributed estimation of a parametric physical field is stated as a maximum likelihood estimation problem. Sensor observations are distorted by additive white Gaussian noise. Prior to data transmission, each sensor quantizes…

Information Theory · Computer Science 2012-09-21 Natalia A. Schmid , Marwan Alkhweldi , Matthew C. Valenti