English
Related papers

Related papers: Fisher information and the central limit theorem

200 papers

An information-theoretic development is given for the problem of compound Poisson approximation, which parallels earlier treatments for Gaussian and Poisson approximation. Let $P_{S_n}$ be the distribution of a sum $S_n=\Sumn Y_i$ of…

Probability · Mathematics 2019-06-05 A. D. Barbour , Oliver Johnson , Ioannis Kontoyiannis , Mokshay Madiman

We establish lower bounds on the volume and the surface area of a geometric body using the size of its slices along different directions. In the first part of the paper, we derive volume bounds for convex bodies using generalized…

Information Theory · Computer Science 2019-10-02 Jing Hao , Varun Jog

Choosing the Fisher information as the metric tensor for a Riemannian manifold provides a powerful yet fundamental way to understand statistical distribution families. Distances along this manifold become a compelling measure of statistical…

Statistics Theory · Mathematics 2023-06-05 Brodie A. J. Lawson , Kevin Burrage , Kerrie Mengersen , Rodrigo Weber dos Santos

Training-free conditional diffusion models have received great attention in conditional image generation tasks. However, they require a computationally expensive conditional score estimator to let the intermediate results of each step in…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Kaiyu Song , Hanjiang Lai

In this paper, under mild assumptions, we derive a law of large numbers, a central limit theorem with an error estimate, an almost sure invariance principle and a variant of Chernoff bound in finite-state hidden Markov models. These limit…

Information Theory · Computer Science 2012-04-13 Guangyue Han

Critical quantum metrology aims to harness critical properties near quantum phase transitions to enhance parameter estimation precision. However, critical slowing down inherently limits the achievable precision within a finite evolution…

Quantum Physics · Physics 2025-06-25 Ju-Yeon Gyhm , Hyukjoon Kwon , Myung-Joong Hwang

In this note we prove that, under some minimal regularity assumptions on the initial datum, solutions to the spatially homogenous Boltzmann and Landau equations for hard potentials uniformly propagate the Fisher information. The proof of…

Analysis of PDEs · Mathematics 2019-02-13 Ricardo J. Alonso , Véronique Bagland , Bertrand Lods

We refine the classical Lindeberg-Feller central limit theorem by obtaining asymptotic bounds on the Kolmogorov distance, the Wasserstein distance, and the parametrized Prokhorov distances in terms of a Lindeberg index. We thus obtain more…

Probability · Mathematics 2016-12-26 Ben Berckmoes , Geert Molenberghs

We introduce new classes of informational functionals, called \emph{upper moments}, respectively \emph{down-Fisher measures}, obtained by applying classical functionals such as $p$-moments and the Fisher information to the recently…

Mathematical Physics · Physics 2025-05-28 Razvan Gabriel Iagar , David Puertas-Centeno

The random vector of frequencies in a generalized urn model is viewed as conditionally independent random variables, given their sum. Such a representation is exploited to derive Edgeworth expansions for a sum of functions of such…

Probability · Mathematics 2014-01-20 Sh. M. Mirakhmedov , S. Rao Jammalamadaka , Ibrahim B. Mohamed

We make use of an entropic property to establish a convergence theorem (Main Theorem), which reveals that the conditional entropy measures the asymptotic Gaussianity. As an application, we establish the {\it entropic conditional central…

Probability · Mathematics 2024-07-17 Zhi-Ming Ma , Liu-Quan Yao , Shuai Yuan , Hua-Zi Zhang

This note discusses the problem of choosing between hypotheses in a situation with many, correlated non-normal variables. A new method is introduced to shrink the many variables into a smaller subset of variables with zero mean, unit…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Byron P. Roe

A robust prediction model invoking the Takens embedding theorem, whose \textit{working hypothesis} is obtained via an inference procedure based on the minimum Fisher information principle, is presented. The coefficients of the ansatz,…

Methodology · Statistics 2017-04-26 R. C. Venkatesan , A. Plastino

For a given homogeneous Poisson point process in $\mathbb{R}^d$ two points are connected by an edge if their distance is bounded by a prescribed distance parameter. The behaviour of the resulting random graph, the Gilbert graph or random…

Probability · Mathematics 2017-11-06 Matthias Reitzner , Matthias Schulte , Christoph Thaele

In this paper, we derive a valid Edgeworth expansions for the Bessel corrected empirical variance when data are generated by a strongly mixing process whose distribution can be arbitrarily. The constraint of strongly mixing process makes…

Statistics Theory · Mathematics 2018-09-19 Eric Benhamou

Variational extremization of the relative Fisher information (RFI, hereafter) is performed. Reciprocity relations, akin to those of thermodynamics are derived, employing the extremal results of the RFI expressed in terms of probability…

Statistical Mechanics · Physics 2015-06-18 R. C. Venkatesan , A. Plastino

Ecological and evolutionary processes show various population dynamics depending on internal interactions and environmental changes. While crucial in predicting biological processes, discovering general relations for such nonlinear dynamics…

Biological Physics · Physics 2022-06-23 Kyosuke Adachi , Ryosuke Iritani , Ryusuke Hamazaki

We prove Edgeworth type expansions for distribution functions of sums of free random variables under minimal moment conditions. The proofs are based on the analytic definition of free convolution. We apply these results to the expansion of…

Probability · Mathematics 2011-12-22 G. P. Chistyakov , F. Götze

Closed-form expressions for the distributions of the order statistics on the spacings between order statistics for the uniform distribution are obtained. This generalizes a result by Fisher concerning tests of significance in the harmonic…

Statistics Theory · Mathematics 2019-09-17 Iosif Pinelis

We consider a drift-diffusion process of $N$ stochastic particles and show that its empirical measure converges, as $N\rightarrow \infty$, to the solution of the Landau equation. We work in the regime of very soft and Coulomb potentials…

Analysis of PDEs · Mathematics 2026-01-06 Côme Tabary