Related papers: Full metastable asymptotic of the Fisher informati…
Motivated by the information bound for the asymptotic variance of M-estimates for scale, we define Fisher information of scale of any distribution function F on the real line as a suitable supremum. In addition, we enforce equivariance by a…
This paper studies the asymptotic behavior of the Fisher information for a Levy process discretely sampled at an increasing frequency. We show that it is possible to distinguish not only the continuous part of the process from its jumps…
We consider the processing of statistical samples $X\sim P_\theta$ by a channel $p(y|x)$, and characterize how the statistical information from the samples for estimating the parameter $\theta\in\mathbb{R}^d$ can scale with the mutual…
We investigate behavior of the Fisher information matrix of general stable distributions. DuMouchel (1975, 1983) proved that the Fisher information of characteristic exponent \alpha diverges to infinity as \alpha approaches 2. Nagaev and…
Mimicking the maximum likelihood estimator, we construct first order Cramer-Rao efficient and explicitly computable estimators for the scale parameter $\sigma^2$ in the model $Z_{i,n}=\sigma n^{-\beta}X_i+Y_i,i=1,\ldots,n,\beta>0$ with…
Fisher information, lies at the heart of parameter estimation theory, was recently found to have a close relation with multipartite entanglement (Pezz\'{e} and Smerzi, Phys. Rev. Lett. 102, 100401). We use Fisher information to distinguish…
This paper deals with the problem of estimating the coupling constant $\theta$ of a mixing quantum Markov chain. For a repeated measurement on the chain's output we show that the outcomes' time average has an asymptotically normal…
We address the fundamental limits of learning unknown parameters of any stochastic process from time-series data, and discover exact closed-form expressions for how optimal inference scales with observation length. Given a parametrized…
We present a unifying framework that bridges Bayesian asymptotics and information theory to analyze the asymptotic Shannon capacity of general large-scale MIMO channels including ones with nonlinearities or imperfect hardware. We derive…
We present two extended forms of Fisher information that fit well in the context of nonextensive thermostatistics. We show that there exists an interplay between these generalized Fisher information, the generalized $q$-Gaussian…
The mean of an unknown variance-$\sigma^2$ distribution $f$ can be estimated from $n$ samples with variance $\frac{\sigma^2}{n}$ and nearly corresponding subgaussian rate. When $f$ is known up to translation, this can be improved…
We prove lower bounds on the error of any estimator for the mean of a real probability distribution under the knowledge that the distribution belongs to a given set. We apply these lower bounds both to parametric and nonparametric…
The coefficients of elastic and dissipative operators in a linear hyperbolic SPDE are jointly estimated using multiple spatially localised measurements. As the resolution level of the observations tends to zero, we establish the asymptotic…
Hierarchical parametric models consisting of observable and latent variables are widely used for unsupervised learning tasks. For example, a mixture model is a representative hierarchical model for clustering. From the statistical point of…
An Edgeworth-type expansion is established for the relative Fisher information distance to the class of normal distributions of sums of i.i.d. random variables, satisfying moment conditions. The validity of the central limit theorem is…
Asymptotics of maximum likelihood estimation for $\alpha$-stable law are analytically investigated with a continuous parameterization. The consistency and asymptotic normality are shown on the interior of the whole parameter space. Although…
We prove that the (square root) Fisher information functional is a strong Wasserstein upper gradient of the entropy on non-convex Riemannian domains. This fills a gap in the literature by allowing one to completely dispense from…
The Fisher information matrix (FIM) plays an important role in the analysis of parameter inference and system design problems. In a number of cases, however, the statistical data distribution and its associated information matrix are either…
New inequalities are proved for the variance of the Pitman estimators (minimum variance equivariant estimators) of \theta constructed from samples of fixed size from populations F(x-\theta). The inequalities are closely related to the…
We introduce the Fisher information in the basis of decay modes of Markovian dynamics, arguing that it encodes important information about the behavior of nonequilibrium systems. In particular we generalize an orthonormality relation…