English
Related papers

Related papers: Cramer-Rao Bound for Estimation After Model Select…

200 papers

The posterior Cram\'er-Rao lower bound (PCRLB) derived in Tichavsk\'y et al., 1998, provides a bound on the mean square error (MSE) obtained with any non-linear state filter. Computing the PCRLB involves solving complex, multi-dimensional…

Computation · Statistics 2013-07-15 Aditya Tulsyan , Biao Huang , R. Bhushan Gopaluni , J. Fraser Forbes

An approximate mean square error (MSE) expression for the performance analysis of implicitly defined estimators of non-random parameters is proposed. An implicitly defined estimator (IDE) declares the minimizer/maximizer of a selected…

Signal Processing · Electrical Eng. & Systems 2025-12-02 Erdal Mehmetcik , Umut Orguner , Çağatay Candan

This paper aims at providing a fresh look at semiparametric estimation theory and, in particular, at the Semiparametric Cram\'{e}r-Rao Bound (SCRB). Semiparametric models are characterized by a finite-dimensional parameter vector of…

Signal Processing · Electrical Eng. & Systems 2018-03-02 Stefano Fortunati , Fulvio Gini , Maria S. Greco , Abdelhak M. Zoubir , Muralidhar Rangaswamy

We consider the problem of estimating a random state vector when there is information about the maximum distances between its subvectors. The estimation problem is posed in a Bayesian framework in which the minimum mean square error (MMSE)…

Statistics Theory · Mathematics 2012-10-30 Dave Zachariah , Isaac Skog , Magnus Jansson , Peter Händel

In this paper, we derive the Cramer-Rao bound (CRB) for blind channel estimation in redundant block transmission systems, a lower bound for the mean squared error of any blind channel estimators. The derived CRB is valid for any full-rank…

Information Theory · Computer Science 2011-02-08 Yen-Huan Li , Borching Su , Ping-Cheng Yeh

In this paper, the Cram\'{e}r-Rao Bounds (CRB) for the simultaneous estimation of power system electromechanical modes and forced oscillations (FO) are derived. Two cases are considered; in the first case only the steady-state response to…

Signal Processing · Electrical Eng. & Systems 2025-11-21 Luke Dosiek

In statistical classification and machine learning, classification error is an important performance measure, which is minimized by the Bayes decision rule. In practice, the unknown true distribution is usually replaced with a model…

Machine Learning · Computer Science 2025-01-28 Zijian Yang , Vahe Eminyan , Ralf Schlüter , Hermann Ney

For regression model selection via maximum likelihood estimation, we adopt a vector representation of candidate models and study the likelihood ratio confidence region for the regression parameter vector of a full model. We show that when…

Statistics Theory · Mathematics 2024-04-09 Min Tsao

Context. The best precision that can be achieved to estimate the location of a stellar-like object is a topic of permanent interest in the astrometric community. Aims. We analyse bounds for the best position estimation of a stellar-like…

Instrumentation and Methods for Astrophysics · Physics 2016-10-26 Alex Echeverria , Jorge F. Silva , Rene A. Mendez , Marcos Orchard

The widely used quantum Cramer-Rao bound (QCRB) sets a lower bound for the mean square error of unbiased estimators in quantum parameter estimation, however, in general QCRB is only tight in the asymptotical limit. With a limited number of…

Quantum Physics · Physics 2016-09-07 Jing Liu , Haidong Yuan

Non-data-aided (NDA) parameter estimation is considered for binary-phase-shift-keying transmission in an additive white Gaussian noise channel. Cramer-Rao lower bounds (CRLBs) for signal amplitude, noise variance, channel reliability…

Information Theory · Computer Science 2007-07-13 Fredrik Brannstrom , Lars K. Rasmussen

Several problems in statistics involve the combination of high-variance unbiased estimators with low-variance estimators that are only unbiased under strong assumptions. A notable example is the estimation of causal effects while combining…

Methodology · Statistics 2023-05-25 Michael Oberst , Alexander D'Amour , Minmin Chen , Yuyan Wang , David Sontag , Steve Yadlowsky

Seeking the available precision limit of unknown parameters is a significant task in quantum parameter estimation. One often resorts to the widely utilized quantum Cramer-Rao bound (QCRB) based on unbiased estimators to finish this task.…

Quantum Physics · Physics 2023-09-12 Shoukang Chang , Wei Ye , Xuan Rao , Huan Zhang , Liqing Huang , Mengmeng Luo , Yuetao Chen , Qiang Ma , Shaoyan Gao

We consider Bayesian variable selection for binary outcomes under a probit link with a spike-and-slab prior on the regression coefficients. Motivated by the computational challenges encountered by Markov chain Monte Carlo (MCMC) samplers in…

Computation · Statistics 2026-05-18 Augusto Fasano , Giovanni Rebaudo

We consider unbiased estimation of a sparse nonrandom vector corrupted by additive white Gaussian noise. We show that while there are infinitely many unbiased estimators for this problem, none of them has uniformly minimum variance.…

Statistics Theory · Mathematics 2010-06-02 Alexander Jung , Zvika Ben-Haim , Franz Hlawatsch , Yonina C. Eldar

Many results in the quantum metrology literature use the Cram\'er-Rao bound and the Fisher information to compare different quantum estimation strategies. However, there are several assumptions that go into the construction of these tools,…

Quantum Physics · Physics 2018-01-31 Jesús Rubio , Paul Knott , Jacob Dunningham

In some estimation problems, not all the parameters can be identified, which results in singularity of the Fisher Information Matrix (FIM). The Cram\'er-Rao Bound (CRB), which is the inverse of the FIM, is then not defined. To regularize…

Information Theory · Computer Science 2018-07-24 Elisabeth de Carvalho , Dirk Slock

A lower bound on the minimum mean-squared error (MSE) in a Bayesian estimation problem is proposed in this paper. This bound utilizes a well-known connection to the deterministic estimation setting. Using the prior distribution, the bias…

Information Theory · Computer Science 2009-05-27 Zvika Ben-Haim , Yonina C. Eldar

In many contemporary applications, large amounts of unlabeled data are readily available while labeled examples are limited. There has been substantial interest in semi-supervised learning (SSL) which aims to leverage unlabeled data to…

Machine Learning · Statistics 2021-09-28 Jessica Gronsbell , Molei Liu , Lu Tian , Tianxi Cai

Systematic errors affecting center-of-gravity (CoG) measurements may occur from coarse sampling of the point-spread-function (PSF) or from signal truncation at the boundaries of the region-of-interest (ROI). For small ROI and PSF widths,…

Instrumentation and Detectors · Physics 2023-12-21 Gerald Hechenblaikner