English
Related papers

Related papers: A Generalized Cram\'er-Rao Bound Using Information…

200 papers

Information geometry describes a framework where probability densities can be viewed as differential geometry structures. This approach has shown that the geometry in the space of probability distributions that are parameterized by their…

Information Theory · Computer Science 2018-01-16 M. Ashok Kumar , Kumar Vijay Mishra

We examine the role of information geometry in the context of classical Cram\'er-Rao (CR) type inequalities. In particular, we focus on Eguchi's theory of obtaining dualistic geometric structures from a divergence function and then applying…

Information Theory · Computer Science 2021-08-24 Kumar Vijay Mishra , M. Ashok Kumar

We study the geometry of probability distributions with respect to a generalized family of Csisz\'ar $f$-divergences. A member of this family is the relative $\alpha$-entropy which is also a R\'enyi analog of relative entropy in information…

Information Theory · Computer Science 2020-05-26 M. Ashok Kumar , Kumar Vijay Mishra

When dealing with a parametric statistical model, a Riemannian manifold can naturally appear by endowing the parameter space with the Fisher information metric. The geometry induced on the parameters by this metric is then referred to as…

Machine Learning · Statistics 2023-10-03 Florent Bouchard , Arnaud Breloy , Antoine Collas , Alexandre Renaux , Guillaume Ginolhac

The Cram\'er-Rao bound (CRB), a well-known lower bound on the performance of any unbiased parameter estimator, has been used to study a wide variety of problems. However, to obtain the CRB, requires an analytical expression for the…

Machine Learning · Computer Science 2022-10-11 Hai Victor Habi , Hagit Messer , Yoram Bresler

The Fisher Information Metric (FIM) and the associated Cram\'er-Rao Bound (CRB) are fundamental tools in statistical signal processing, which inform the efficient design of experiments and algorithms for estimating the underlying…

Signal Processing · Electrical Eng. & Systems 2025-05-20 Shiraz Khan , Gregory S. Chirikjian

We propose the generalised Fisher information or the one-parameter extended class of the Fisher information for the case of one random variable. This new form of the Fisher information is obtained from the intriguing connection between the…

Statistics Theory · Mathematics 2022-08-25 Worachet Bukaew , Sikarin Yoo-Kong

This work presents a geometric refinement of the classical Cram\'er--Rao bound (CRB) in the non-asymptotic regime by incorporating curvature-aware corrections based on the second fundamental form associated with the statistical model…

Statistics Theory · Mathematics 2026-03-11 Sunder Ram Krishnan

The relative $\alpha$-entropy is the R\'enyi analog of relative entropy and arises prominently in information-theoretic problems. Recent information geometric investigations on this quantity have enabled the generalization of the…

Information Theory · Computer Science 2020-02-13 Kumar Vijay Mishra , M. Ashok Kumar

The Bayesian Cram\'er-Rao bound (CRB) provides a lower bound on the mean square error of any Bayesian estimator under mild regularity conditions. It can be used to benchmark the performance of statistical estimators, and provides a…

Machine Learning · Statistics 2024-09-09 Evan Scope Crafts , Xianyang Zhang , Bo Zhao

In optimization, the natural gradient method is well-known for likelihood maximization. The method uses the Kullback-Leibler divergence, corresponding infinitesimally to the Fisher-Rao metric, which is pulled back to the parameter space of…

Machine Learning · Statistics 2019-02-26 Anton Mallasto , Tom Dela Haije , Aasa Feragen

Measurement estimation bounds for local quantum multiparameter estimation, which provide lower bounds on possible measurement uncertainties, have so far been formulated in two ways: by extending the classical Cram\'er--Rao bound (e.g., the…

Quantum Physics · Physics 2024-09-23 Simon K. Yung , Lorcan O. Conlon , Jie Zhao , Ping Koy Lam , Syed M. Assad

We discuss the recently proposed description of Kuramoto model in terms of hyperbolic space and relate it to the information geometry. In particular the dynamical equation in Kuramoto all-to-all model is identified with the gradient flow of…

Statistical Mechanics · Physics 2023-05-03 Artem Alexandrov , Alexander Gorsky

This paper presents a Cramer-Rao bound (CRB) for the estimation of parameters confined to an arbitrary set. Unlike existing results that rely on equality or inequality constraints, manifold structures, or the nonsingularity of the Fisher…

Signal Processing · Electrical Eng. & Systems 2026-01-28 Heedong Do , Angel Lozano

A general class of Bayesian lower bounds when the underlying loss function is a Bregman divergence is demonstrated. This class can be considered as an extension of the Weinstein--Weiss family of bounds for the mean squared error and relies…

Information Theory · Computer Science 2020-06-17 Alex Dytso , Michael Fauß , H. Vincent Poor

Many results in the quantum metrology literature use the Cram\'er-Rao bound and the Fisher information to compare different quantum estimation strategies. However, there are several assumptions that go into the construction of these tools,…

Quantum Physics · Physics 2018-01-31 Jesús Rubio , Paul Knott , Jacob Dunningham

The Fisher information metric or the Fisher-Rao metric corresponds to a natural Riemannian metric defined on a parameterized family of probability density functions. As in the case of Riemannian geometry, we can define a distance in terms…

Differential Geometry · Mathematics 2024-05-30 Emmanuel Gnandi

This paper presents a new performance bound for estimation problems where the parameter to estimate lies in a Riemannian manifold (a smooth manifold endowed with a Riemannian metric) and follows a given prior distribution. In this setup,…

Statistics Theory · Mathematics 2024-09-10 Florent Bouchard , Alexandre Renaux , Guillaume Ginolhac , Arnaud Breloy

In his 2005 paper, S.T. Smith proposed an intrinsic Cram\'er-Rao bound on the variance of estimators of a parameter defined on a Riemannian manifold. In the present technical note, we consider the special case where the parameter lives in a…

Systems and Control · Computer Science 2015-09-17 Silvère Bonnabel , Axel Barrau

The classical Cram\'er-Rao inequality gives a lower bound for the variance of a unbiased estimator of an unknown parameter, in some statistical model of a random process. In this note we rewrite the statment and proof of the bound using…

Other Statistics · Statistics 2017-10-27 Anthony D. Blaom
‹ Prev 1 2 3 10 Next ›