Related papers: Fisher information and the central limit theorem
The Fisher information matrix summarizes the amount of information in a set of data relative to the quantities of interest. There are many applications of the information matrix in statistical modeling, system identification and parameter…
We present a new method for proving sharp local propagation of chaos in Fisher Information for particles with smooth interaction and drift. We rely on a new Lemma computing the Fisher Information of two diffusion processes with smooth…
The Rotar central limit theorem is a remarkable theorem in the non-classical version since it does not use the condition of asymptotic infinitesimality for the independent individual summands, unlike the theorems named Lindeberg's and…
We show that using the most parsimonious version of Frieden and Soffer's extreme information principle (EPI) with a Fisher measure constructed with escort probabilities, the concomitant solutions obey a type of Naudts' duality for…
Skewed distributions are fundamental in modelling asymmetric data on the d-dimensional torus. In this context, asymmetry is introduced through the sine-skewing mechanism, which is the only skewing mechanism that has been proposed on the…
This paper provides a finite sample bound for the error term in the Edgeworth expansion for a sum of independent, potentially discrete, nonlattice random vectors, using a uniform-in-$P$ version of the weaker Cram\'{e}r condition in Angst…
We study higher order expansions both in the Berry-Ess\'een estimate (Edgeworth expansions) and in the local limit theorems for Birkhoff sums of chaotic probability preserving dynamical systems. We establish general results under technical…
The following problem is considered: given a joint distribution $P_{XY}$ and an event $E$, bound $P_{XY}(E)$ in terms of $P_XP_Y(E)$ (where $P_XP_Y$ is the product of the marginals of $P_{XY}$) and a measure of dependence of $X$ and $Y$.…
We formulate and prove an axiomatic characterization of conditional information geometry, for both the normalized and the nonnormalized cases. This characterization extends the axiomatic derivation of the Fisher geometry by Cencov and…
We provide a new perspective on Stein's so-called density approach by introducing a new operator and characterizing class which are valid for a much wider family of probability distributions on the real line. We prove an elementary…
The Generalized Central Limit Theorem is a remarkable generalization of the Central Limit Theorem, showing that the sum of a large number of independent, identically-distributed (i.i.d) random variables with infinite variance may converge…
Consider the centered Gaussian vector $X$ in $\R^n$ with covariance matrix $ \Sigma.$ Randomize $\Sigma$ such that $ \Sigma^{-1}$ has a Wishart distribution with shape parameter $p>(n-1)/2$ and mean $p\sigma.$ We compute the density…
For a given metric $g_{\mu\nu}$, which is identified as Fisher information metric, we generate new constraints for the probability distributions for physical systems. We postulate the existence of intrinsic probability distributions for…
Limit theorems of strong law of large numbers and central limit theorem types are obtained for the compositions of independent identically distributed random unitary channels.
In this paper we establish lower bounds on information divergence of a distribution on the integers from a Poisson distribution. These lower bounds are tight and in the cases where a rate of convergence in the Law of Thin Numbers can be…
A simple proof is given for the monotonicity of entropy and Fisher information associated to sums of i.i.d. random variables. The proof relies on a characterization of maximal correlation for partial sums due to Dembo, Kagan and Shepp.
We consider a random interval splitting process, in which the splitting rule depends on the empirical distribution of interval lengths. We show that this empirical distribution converges to a limit almost surely as the number of intervals…
We derive upper bounds on the quantum Fisher information in interferometry with $N$ subsystems, e.g. two-level atoms or Gaussian modes, in the presence of arbitrarily correlated Gaussian dephasing including independent and collective…
We consider the problem of estimating an arbitrary dynamical parameter of an quantum open system in the input-output formalism. For irreducible Markov processes, we show that in the limit of large times the system-output state can be…
A central limit theorem is proved for some strictly stationary sequences of random variables that satisfy certain mixing conditions and are subjected to the "shrinking operators" $U_r(x):=[\max\{|x|-r,0\}]\cdot x/|x|,\ r \ge 0$. For…