Related papers: Fisher Information in Group-Type Models

Motivated by the information bound for the asymptotic variance of M-estimates for scale, we define Fisher information of scale of any distribution function F on the real line as a suitable supremum. In addition, we enforce equivariance by a…

We investigate behavior of the Fisher information matrix of general stable distributions. DuMouchel (1975, 1983) proved that the Fisher information of characteristic exponent \alpha diverges to infinity as \alpha approaches 2. Nagaev and…

An Edgeworth-type expansion is established for the relative Fisher information distance to the class of normal distributions of sums of i.i.d. random variables, satisfying moment conditions. The validity of the central limit theorem is…

We prove lower bounds on the error of any estimator for the mean of a real probability distribution under the knowledge that the distribution belongs to a given set. We apply these lower bounds both to parametric and nonparametric…

We give conditions for an O(1/n) rate of convergence of Fisher information and relative entropy in the Central Limit Theorem. We use the theory of projections in L2 spaces and Poincare inequalities, to provide a better understanding of the…

This paper proposes an alternative approach for constructing invariant Jeffreys prior distributions tailored for hierarchical or multilevel models. In particular, our proposal is based on a flexible decomposition of the Fisher information…

In this brief note we compute the Fisher information of a family of generalized normal distributions. Fisher information is usually defined for regular distributions, i.e. continuously differentiable (log) density functions whose support…

These notes review the theory of Fisher information, especially its use in kinetic theory of gases and plasmas. The recent monotonicity theorem by Guillen--Silvestre for the Landau--Coulomb equation is put in perspective and generalised.…

This paper studies semiparametric Fisher information in models parametrized by general normed spaces. The main contribution is to establish that positive semiparametric Fisher information is equivalent to the gradient of the parameter of…

We establish an expansion by Gamma-convergence of the Fisher information relative to the reference measure exp(-beta V), where V is a generic multiwell potential and beta goes to infinity. The expansion reveals a hierarchy of multiple…

Hierarchical parametric models consisting of observable and latent variables are widely used for unsupervised learning tasks. For example, a mixture model is a representative hierarchical model for clustering. From the statistical point of…

In this paper, we first establish general bounds on the Fisher information distance to the class of normal distributions of Malliavin differentiable random variables. We then study the rate of Fisher information convergence in the central…

A robust prediction model invoking the Takens embedding theorem, whose \textit{working hypothesis} is obtained via an inference procedure based on the minimum Fisher information principle, is presented. The coefficients of the ansatz,…

The two principal/immediate influences -- which we seek to interrelate here -- upon the undertaking of this study are papers of Zyczkowski and Slomczy\'nski (J. Phys. A 34, 6689 [2001]) and of Petz and Sudar (J. Math. Phys. 37, 2262…

We present two extended forms of Fisher information that fit well in the context of nonextensive thermostatistics. We show that there exists an interplay between these generalized Fisher information, the generalized $q$-Gaussian…

Skew-symmetric densities recently received much attention in the literature, giving rise to increasingly general families of univariate and multivariate skewed densities. Most of those families, however, suffer from the inferential drawback…

The minimization of Fisher's information (MFI) approach of Frieden et al. [Phys. Rev. E {\bf 60} 48 (1999)] is applied to the study of size distributions in social groups on the basis of a recently established analogy between scale…

To characterize the Kullback-Leibler divergence and Fisher information in general parametrized hidden Markov models, in this paper, we first show that the log likelihood and its derivatives can be represented as an additive functional of a…

We establish an a priori estimate for the dissipation of the Fisher information for the space-homogeneous Landau equation with very soft potentials. This work is motivated by the recent breakthrough by Guillen and Silvestre, which proves…

Fisher information, lies at the heart of parameter estimation theory, was recently found to have a close relation with multipartite entanglement (Pezz\'{e} and Smerzi, Phys. Rev. Lett. 102, 100401). We use Fisher information to distinguish…