English
Related papers

Related papers: Adaptive Designs for Optimal Observed Fisher Infor…

200 papers

Fisher information is a lower bound on the uncertainty in the statistical estimation of classical and quantum mechanical parameters. While some deterministic dynamical systems are not subject to random fluctuations, they do still have a…

Classical Physics · Physics 2023-10-06 Mohamed Sahbani , Swetamber Das , Jason R. Green

One of the most popular methods for continual learning with deep neural networks is Elastic Weight Consolidation (EWC), which involves computing the Fisher Information. The exact way in which the Fisher Information is computed is however…

Machine Learning · Computer Science 2025-02-18 Gido M. van de Ven

Quantum Fisher information, as an intrinsic quantity for quantum states, is a central concept in quantum detection and estimation. When quantum measurements are performed on quantum states, classical probability distributions arise, which…

Quantum Physics · Physics 2012-09-04 Xiao-Ming Lu , Shunlong Luo , C. H. Oh

Maximum likelihood estimates and corresponding confidence regions of the estimates are commonly used in statistical inference. In practice, people often construct approximate confidence regions with the Fisher information at given sample…

Statistics Theory · Mathematics 2021-07-13 Sihang Jiang

Consider two forms of sampling from a population: (i) drawing $s$ samples of $n$ elements with replacement and (ii) drawing a single sample of $ns$ elements. In this paper, under the setting where the descending order population frequency…

Statistics Theory · Mathematics 2018-02-05 Koji Tsukuda , Shuhei Mano

The Fisher matrix approach (Fisher 1935) allows one to calculate in advance how well a given experiment will be able to estimate model parameters, and has been an invaluable tool in experimental design. In the same spirit, we present here a…

Astrophysics · Physics 2009-01-22 A. F. Heavens , T. D. Kitching , L. Verde

In biology, information flows from the environment to the genome by the process of natural selection. But it has not been clear precisely what sort of information metric properly describes natural selection. Here, I show that Fisher…

Populations and Evolution · Quantitative Biology 2009-06-18 Steven A. Frank

Optimum designs for parameter estimation in generalized regression models are standardly based on the Fisher information matrix (cf. Atkinson et al (2014) for a recent exposition). The corresponding optimality criteria are related to the…

Statistics Theory · Mathematics 2015-07-28 Katarína Burclová , Andrej Pázman

In order to make better use of deep reinforcement learning in the creation of sensing policies for resource-constrained IoT devices, we present and study a novel reward function based on the Fisher information value. This reward function…

Machine Learning · Computer Science 2020-10-09 Abdulmajid Murad , Frank Alexander Kraemer , Kerstin Bach , Gavin Taylor

The increasing availability of passively observed data has yielded a growing methodological interest in "data fusion." These methods involve merging data from observational and experimental sources to draw causal conclusions -- and they…

Methodology · Statistics 2021-12-15 Evan Rosenman , Art B. Owen

The Fisher Information matrix is a widely used measure for applications ranging from statistical inference, information geometry, experiment design, to the study of criticality in biological systems. Yet there is no commonly accepted…

Computation · Statistics 2016-02-17 Omri Har Shemesh , Rick Quax , Borja Miñano , Alfons G. Hoekstra , Peter M. A. Sloot

We introduce Fisher consistency in the sense of unbiasedness as a desirable property for estimators of class prior probabilities. Lack of Fisher consistency could be used as a criterion to dismiss estimators that are unlikely to deliver…

Machine Learning · Statistics 2019-07-23 Dirk Tasche

Modern applications of Bayesian inference involve models that are sufficiently complex that the corresponding posterior distributions are intractable and must be approximated. The most common approximation is based on Markov chain Monte…

Machine Learning · Statistics 2019-05-15 Yue Yang , Ryan Martin , Howard Bondell

Informative interim adaptations lead to random sample sizes. The random sample size becomes a component of the sufficient statistic and estimation based solely on observed samples or on the likelihood function does not use all available…

Methodology · Statistics 2022-10-25 Sergey Tarima , Nancy Flournoy

The selection of optimal designs for generalized linear mixed models is complicated by the fact that the Fisher information matrix, on which most optimality criteria depend, is computationally expensive to evaluate. Our focus is on the…

Methodology · Statistics 2015-09-22 Timothy W. Waite , David C. Woods

Inverse classification, the process of making meaningful perturbations to a test point such that it is more likely to have a desired classification, has previously been addressed using data from a single static point in time. Such an…

Machine Learning · Computer Science 2016-11-15 Michael T. Lash , W. Nick Street

The subjects of the paper are the likelihood method (LM) and the expected Fisher information (FI) considered from the point od view of the construction of the physical models which originate in the statistical description of phenomena. The…

Data Analysis, Statistics and Probability · Physics 2013-10-08 E. W. Piotrowski , J. Sladkowski , J. Syska , S. Zajac

We introduce a positive Hermitian operator, the Fisher operator, and use it to examine a measurement process incorporating unitary dynamics and complete measurements. We develop the idea of information complement, the minimization of which…

Quantum Physics · Physics 2009-02-20 Gabriel A. Durkin

Alternative proofs for the superadditivity and the affinity (in the large system limit) of the usual and some fractional Fisher informations of a probability density of many variables are provided. They are consequences of the fact that…

Analysis of PDEs · Mathematics 2020-08-26 Nicolas Rougerie

This paper is a strongly geometrical approach to the Fisher distance, which is a measure of dissimilarity between two probability distribution functions. The Fisher distance, as well as other divergence measures, are also used in many…

Methodology · Statistics 2014-01-13 Sueli I. R. Costa , Sandra A. Santos , João E. Strapasson