English

Computing Constrained Cramer Rao Bounds

Information Theory 2015-06-04 v1 Data Structures and Algorithms math.IT

Abstract

We revisit the problem of computing submatrices of the Cram\'er-Rao bound (CRB), which lower bounds the variance of any unbiased estimator of a vector parameter \vth\vth. We explore iterative methods that avoid direct inversion of the Fisher information matrix, which can be computationally expensive when the dimension of \vth\vth is large. The computation of the bound is related to the quadratic matrix program, where there are highly efficient methods for solving it. We present several methods, and show that algorithms in prior work are special instances of existing optimization algorithms. Some of these methods converge to the bound monotonically, but in particular, algorithms converging non-monotonically are much faster. We then extend the work to encompass the computation of the CRB when the Fisher information matrix is singular and when the parameter \vth\vth is subject to constraints. As an application, we consider the design of a data streaming algorithm for network measurement.

Keywords

Cite

@article{arxiv.1204.2033,
  title  = {Computing Constrained Cramer Rao Bounds},
  author = {Paul Tune},
  journal= {arXiv preprint arXiv:1204.2033},
  year   = {2015}
}

Comments

Tech report version. Journal version was submitted to IEEE Transactions on Signal Processing. This version includes derivation of the iterations of the constrained majorization-minimization algoirthm, subject to parameter equality constraints. 3 figures

R2 v1 2026-06-21T20:47:01.161Z