English
Related papers

Related papers: A Tutorial on Fisher Information

200 papers

Bayesian methods are increasingly applied in these days in the theory and practice of statistics. Any Bayesian inference depends on a likelihood and a prior. Ideally one would like to elicit a prior from related sources of information or…

Methodology · Statistics 2011-08-11 Malay Ghosh

We study the problem of parameter estimation in time series stemming from general stochastic processes, where the outcomes may exhibit arbitrary temporal correlations. In particular, we address the question of how much Fisher information is…

Statistical Mechanics · Physics 2023-09-06 Joseph A. Smiga , Marco Radaelli , Felix C. Binder , Gabriel T. Landi

We study the problem of estimating a continuous ability parameter from sequential binary responses by actively asking questions with varying difficulties, a setting that arises naturally in adaptive testing and online preference learning.…

Machine Learning · Statistics 2025-10-10 Sanghwa Kim , Dohyun Ahn , Seungki Min

The Fisher information matrix provides a way to measure the amount of information given observed data based on parameters of interest. Many applications of the FIM exist in statistical modeling, system identification, and parameter…

Computation · Statistics 2021-04-16 Xuan Wu

Alternative proofs for the superadditivity and the affinity (in the large system limit) of the usual and some fractional Fisher informations of a probability density of many variables are provided. They are consequences of the fact that…

Analysis of PDEs · Mathematics 2020-08-26 Nicolas Rougerie

We derive a Fisher matrix for the parameters characterising a population of gravitational-wave events. This provides a guide to the precision with which population parameters can be estimated with multiple observations, which becomes…

General Relativity and Quantum Cosmology · Physics 2022-12-14 Jonathan R. Gair , Andrea Antonelli , Riccardo Barbieri

In this brief paper we revisit the Fisher information content of cosmological power spectra or two-point functions of Gaussian fields in order to comment on the assumption of Gaussian estimators and the use of parameter-dependent covariance…

Cosmology and Nongalactic Astrophysics · Physics 2013-04-19 Julien Carron

Bayesian and frequentist methods differ in many aspects, but share some basic optimality properties. In practice, there are situations in which one of the methods is more preferred by some criteria. We consider the case of inference about a…

Statistics Theory · Mathematics 2009-08-25 Ao Yuan

We prove that two well-known measures of information are interrelated in interesting and useful ways when applied to nonequilibrium circumstances. A nontrivial form of the lower bound for the Fisher information measure is derived in…

Statistical Mechanics · Physics 2012-04-06 Takuya Yamano

This paper considers the problem of estimation of the Fisher information for location from a random sample of size $n$. First, an estimator proposed by Bhattacharya is revisited and improved convergence rates are derived. Second, a new…

Information Theory · Computer Science 2020-05-08 Wei Cao , Alex Dytso , Michael Fauß , H. Vincent Poor , Gang Feng

A common concern with Bayesian methodology in scientific contexts is that inferences can be heavily influenced by subjective biases. As presented here, there are two types of bias for some quantity of interest: bias against and bias in…

Statistics Theory · Mathematics 2019-03-06 Michael Evans , Yang Guo

We present two extended forms of Fisher information that fit well in the context of nonextensive thermostatistics. We show that there exists an interplay between these generalized Fisher information, the generalized $q$-Gaussian…

Mathematical Physics · Physics 2013-06-05 Jean-François Bercher

Markov Random Field models are powerful tools for the study of complex systems. However, little is known about how the interactions between the elements of such systems are encoded, especially from an information-theoretic perspective. In…

Information Theory · Computer Science 2015-03-19 Alexandre L. M. Levada

There are three principle paradigms of statistical inference: (i) Bayesian, (ii) information-based and (iii) frequentist inference. We describe an objective prior (the weighting or $w$-prior) which unifies objective Bayes and…

Machine Learning · Statistics 2015-06-26 Colin H. LaMont , Paul A. Wiggins

Fisher's exact test is often a preferred method to estimate the significance of statistical dependence. However, in large data sets the test is usually too worksome to be applied, especially in an exhaustive search (data mining). The…

Computation · Statistics 2014-05-07 Wilhelmiina Hämäläinen

Current experimental design techniques for dynamical systems often only incorporate measurement noise, while dynamical systems also involve process noise. To construct experimental designs we need to quantify their information content. The…

Methodology · Statistics 2026-03-24 Arno Strouwen , Bart M. Nicolaï , Peter Goos

In many hypothesis testing applications, we have mixed priors, with well-motivated informative priors for some parameters but not for others. The Bayesian methodology uses the Bayes factor and is helpful for the informative priors, as it…

Data Analysis, Statistics and Probability · Physics 2022-10-05 Jakob Robnik , Uroš Seljak

We study the frequentist properties of confidence intervals computed by the method known to statisticians as the Profile Likelihood. It is seen that the coverage of these intervals is surprisingly good over a wide range of possible…

Data Analysis, Statistics and Probability · Physics 2009-11-10 Wolfgang A. Rolke , Angel M. Lopez , Jan Conrad

In quantum metrology, the parameter estimation accuracy is bounded by quantum Fisher information. In this paper, we present coherence measures in terms of (quantum) Fisher information by directly considering the post-selective non-unitary…

Quantum Physics · Physics 2023-07-06 Deng-hui Yu , Chang-shui Yu

Fisher-information inequalities have recently been used as operational witnesses of nonclassical metrological behavior, but their physical meaning is often tied to a particular narrative, such as, segmented dynamics or discrete…

Quantum Physics · Physics 2026-05-20 Jeongho Bang , Su-Yong Lee