Related papers: A Generalized Cram\'er-Rao Bound Using Information…
The variance and the entropy power of a continuous random variable are bounded from below by the reciprocal of its Fisher information through the Cram\'{e}r-Rao bound and the Stam's inequality respectively. In this note, we introduce the…
We examine the total mixed scalar curvature of a fixed distribution as a functional of a pseudo-Riemannian metric. We develop variational formulas for quantities of extrinsic geometry of the distribution to find the critical points of this…
We develop an advanced approach for extending Gaussian Differential Privacy (GDP) to general Riemannian manifolds. The concept of GDP stands out as a prominent privacy definition that strongly warrants extension to manifold settings, due to…
Sampling a target probability distribution with an unknown normalization constant is a fundamental challenge in computational science and engineering. Recent work shows that algorithms derived by considering gradient flows in the space of…
We discuss a Lie algebraic and differential geometry construction of solutions to some multidimensional nonlinear integrable systems describing diagonal metrics on Riemannian manifolds, in particular those of zero and constant curvature.…
This paper presents a distributed estimator for a deterministic parametric physical field sensed by a homogeneous sensor network and develops a new transformed expression for the Cramer-Rao lower bound (CRLB) on the variance of distributed…
We show how Fisher's information already known particular character as the fundamental information geometric object which plays the role of a metric tensor for a statistical differential manifold, can be derived in a relatively easy manner…
This work presents an explicit description of the Fisher-Rao Riemannian metric on the Hilbert manifold of equivalent centered Gaussian measures on an infinite-dimensional Hilbert space. We show that the corresponding quantities from the…
Being infinite dimensional, non-parametric information geometry has long faced an "intractability barrier" due to the fact that the Fisher-Rao metric is now a functional incurring difficulties in defining its inverse. This paper introduces…
We give a new geometric interpretation of the Amari-Cencov $\alpha$-connections $\nabla^{(\alpha)}$ from information geometry: On the space of densities $\operatorname{Dens}_+(M)$, we show that there exist Riemannian metrics $G^\alpha$,…
We present a new proof of the quantum Cramer-Rao bound for precision parameter estimation [1-3] and extend it to a more general class of measurement procedures. We analyze a generalized framework for parameter estimation that covers most…
Variance and Fisher information are ingredients of the Cramer-Rao inequality. We regard Fisher information as a Riemannian metric on a quantum statistical manifold and choose monotonicity under coarse graining as the fundamental property of…
We derive information theoretic generalization bounds for supervised learning algorithms based on a new measure of leave-one-out conditional mutual information (loo-CMI). Contrary to other CMI bounds, which are black-box bounds that do not…
Statistical inference more often than not involves models which are non-linear in the parameters thus leading to non-Gaussian posteriors. Many computational and analytical tools exist that can deal with non-Gaussian distributions, and…
The quantity of interest in the classical Cram\'er-Rao theory of unbiased estimation (e.g., the Cram\'er-Rao lower bound, its exact attainment for exponential families, and asymptotic efficiency of maximum likelihood estimation) is the…
We prove risk bounds for binary classification in high-dimensional settings when the sample size is allowed to be smaller than the dimensionality of the training set observations. In particular, we prove upper bounds for both 'compressive…
We provide an experimentally measurable local gauge $U(1)$ invariant Fubini-Study (FS) metric for mixed states. Like the FS metric for pure states, it also captures only the quantum part of the uncertainty in the evolution Hamiltonian. We…
This is a review of the ideas behind the Fisher--Rao metric on classical probability distributions, and how they generalize to metrics on density matrices. As is well known, the unique Fisher--Rao metric then becomes a large family of…
Let $M^n$ be an $n$-dimensional Riemannian manifold with boundary $\partial M$. Assume that Ricci curvature is bounded from below by $(n-1)k$, for $k\in \RR$, we give a sharp estimate of the upper bound of $\rho(x)=\dis(x, \partial M)$, in…
We generalize the approach by Braunstein and Caves [Phys. Rev. Lett. 72, 3439 (1994)] to quantum multi-parameter estimation with general states. We derive a matrix bound of the classical Fisher information matrix due to each measurement…