English
Related papers

Related papers: Fisher information and the central limit theorem

200 papers

We prove two lower bounds for the complexity of non-log-concave sampling within the framework of Balasubramanian et al. (2022), who introduced the use of Fisher information (FI) bounds as a notion of approximate first-order stationarity in…

Machine Learning · Statistics 2022-10-07 Sinho Chewi , Patrik Gerber , Holden Lee , Chen Lu

Two new proofs of the Fisher information inequality (FII) using data processing inequalities for mutual information and conditional variance are presented.

Information Theory · Computer Science 2007-07-13 Tie Liu , Pramod Viswanath

The Fisher information matrix (FIM) has long been of interest in statistics and other areas. It is widely used to measure the amount of information and calculate the lower bound for the variance for maximum likelihood estimation (MLE). In…

Information Theory · Computer Science 2015-06-19 Shenghan Guo

We consider natural and general exponential families $(Q_m)_{m\in M}$ on $\mathbb{R}^d$ parametrized by the means. We study the submodels $(Q_{\theta m_1+(1-\theta)m_2})_{\theta\in[0,1]}$ parametrized by a segment in the means domain,…

Probability · Mathematics 2014-02-07 Piotr Graczyk , Salha Mamane

Relative Fisher information (IR), which is a measure of correlative fluctuation between two probability densities, has been pursued for a number of quantum systems, such as, 1D quantum harmonic oscillator (QHO) and a few central potentials…

Quantum Physics · Physics 2019-04-05 Neetik Mukherjee , Amlan K. Roy

The "typical" asymptotic behavior of the weighted sums of independent, identically distibuted random vectors in k-dimensional space is considered. It is shown that under finitnes of fifth absolute moment of an individual term the rate of…

Probability · Mathematics 2023-12-25 Sagak Ayvazyan

Fisher-information inequalities have recently been used as operational witnesses of nonclassical metrological behavior, but their physical meaning is often tied to a particular narrative, such as, segmented dynamics or discrete…

Quantum Physics · Physics 2026-05-20 Jeongho Bang , Su-Yong Lee

Frequentists' inference often delivers point estimators associated with confidence intervals or sets for parameters of interest. Constructing the confidence intervals or sets requires understanding the sampling distributions of the point…

Statistics Theory · Mathematics 2016-10-18 Xinran Li , Peng Ding

Variance and Fisher information are ingredients of the Cramer-Rao inequality. We regard Fisher information as a Riemannian metric on a quantum statistical manifold and choose monotonicity under coarse graining as the fundamental property of…

Quantum Physics · Physics 2009-11-07 Denes Petz

A strengthened version of the central limit theorem for discrete random variables is established, relying only on information-theoretic tools and elementary arguments. It is shown that the relative entropy between the standardised sum of…

Probability · Mathematics 2021-06-02 Lampros Gavalakis , Ioannis Kontoyiannis

We discuss sufficient conditions that guarantee the existence of asymptotic expansions for the Central Limit Theorem for weakly dependent random variables including observations arising from sufficiently chaotic dynamical systems like…

Probability · Mathematics 2021-04-06 Kasun Fernando , Carlangelo Liverani

We consider the Fisher-Snedecor diffusion; that is, the Kolmogorov-Pearson diffusion with the Fisher-Snedecor invariant distribution. In the nonstationary setting, we give explicit quantitative rates for the convergence rate of respective…

Statistics Theory · Mathematics 2013-12-18 A. M. Kulik , N. N. Leonenko

We establish several convexity properties for the entropy and Fisher information of mixtures of centered Gaussian distributions. First, we prove that if $X_1, X_2$ are independent scalar Gaussian mixtures, then the entropy of $\sqrt{t}X_1 +…

Information Theory · Computer Science 2024-02-19 Alexandros Eskenazis , Lampros Gavalakis

We prove a central limit theorem for a sequence of random variables whose means are ambiguous and vary in an unstructured way. Their joint distribution is described by a set of measures. The limit is (not the normal distribution and is)…

Probability · Mathematics 2020-07-01 Zengjing Chen , Larry G. Epstein

Edgeworth expansions of first and second order are established for general linear rank statistics under the null hypothesis with asymptotically ''sufficiently'' small remainder terms. The methods used are the Stein method combined with an…

Statistics Theory · Mathematics 2025-11-18 Walter Schneller

Edgeworth expansions for random walks on covering graphs with groups of polynomial volume growths are obtained under a few natural assumptions. The coefficients appearing in this expansion depends on not only geometric features of the…

Probability · Mathematics 2023-06-05 Ryuya Namba

In the present paper, we would like to draw attention to a possible generalized Fisher information that fits well in the formalism of nonextensive thermostatistics. This generalized Fisher information is defined for densities on…

Mathematical Physics · Physics 2013-01-18 J. -F. Bercher

We reformulate models in epidemiology and population dynamics in terms of probability distributions. This allows us to construct the Fisher information, which we interpret as the metric of a one-dimensional differentiable manifold. For…

Populations and Evolution · Quantitative Biology 2024-02-27 Baptiste Filoche , Stefan Hohenegger , Francesco Sannino

We give an online algorithm that keeps a symmetric random walk inside a convex body by discarding some of its steps. The expected number of discarded steps is controlled by a Fisher-information-type quantity associated with the body. For…

Probability · Mathematics 2026-05-14 Gleb Smirnov , Roman Vershynin

Relativistic quantum metrology studies the maximal achievable precision for estimating a physical quantity when both quantum and relativistic effects are taken into account. We study the relativistic quantum metrology of temperature in…

High Energy Physics - Theory · Physics 2021-06-02 Haoxing Du , Robert B. Mann