English
Related papers

Related papers: Naturalness and Fisher Information

200 papers

Natural Gradient Descent, a second-degree optimization method motivated by the information geometry, makes use of the Fisher Information Matrix instead of the Hessian which is typically used. However, in many cases, the Fisher Information…

Machine Learning · Computer Science 2023-03-10 Rajesh Shrestha

An approach based on the Fisher information (FI) is developed to quantify the maximum information gain and optimal experimental design in neutron reflectometry experiments. In these experiments, the FI can be analytically calculated and…

Data Analysis, Statistics and Probability · Physics 2021-08-03 James H. Durant , Lucas Wilkins , Keith Butler , Joshaniel F. K. Cooper

Fisher information, lies at the heart of parameter estimation theory, was recently found to have a close relation with multipartite entanglement (Pezz\'{e} and Smerzi, Phys. Rev. Lett. 102, 100401). We use Fisher information to distinguish…

Quantum Physics · Physics 2009-05-05 Jian Ma , Xiaoguang Wang

This paper studies semiparametric Fisher information in models parametrized by general normed spaces. The main contribution is to establish that positive semiparametric Fisher information is equivalent to the gradient of the parameter of…

Statistics Theory · Mathematics 2026-04-02 Telmo Pérez-Izquierdo

Information theory is a powerful framework to capture aspects of dynamical systems with multiple degrees of freedom. Mathematically, the dynamics can be represented as a continuous curve $\mathcal{C}$ on a suitable hyperplane in flat space…

Information Theory · Computer Science 2026-04-28 Mattia Carrino , Stefan Hohenegger

The Fisher information matrix (FIM) plays an important role in the analysis of parameter inference and system design problems. In a number of cases, however, the statistical data distribution and its associated information matrix are either…

Statistics Theory · Mathematics 2016-11-24 Dave Zachariah , Petre Stoica

The Fisher information matrix can be used to characterize the local geometry of the parameter space of neural networks. It elucidates insightful theories and useful tools to understand and optimize neural networks. Given its high…

Machine Learning · Computer Science 2024-10-31 Alexander Soen , Ke Sun

We review recent results that provide a new approach to the old problem of naturalness in supersymmetric models, without relying on subjective definitions for the fine-tuning associated with {\it fixing} the EW scale (to its measured value)…

High Energy Physics - Phenomenology · Physics 2013-08-12 D. M. Ghilencea

Local information objectivity, that local, independent observers can infer the same information about a model upon exchange of independently acquired experimental data, is fundamental to science. It is mathematically encoded via Cencov's…

General Relativity and Quantum Cosmology · Physics 2026-05-19 Per Berglund , Andrew Geraci , Tristan Hubsch , David Mattingly , Djordje Minic

Fisher information is a lower bound on the uncertainty in the statistical estimation of classical and quantum mechanical parameters. While some deterministic dynamical systems are not subject to random fluctuations, they do still have a…

Classical Physics · Physics 2023-10-06 Mohamed Sahbani , Swetamber Das , Jason R. Green

The Fisher information matrix provides a way to measure the amount of information given observed data based on parameters of interest. Many applications of the FIM exist in statistical modeling, system identification, and parameter…

Computation · Statistics 2021-04-16 Xuan Wu

Motivated by the information bound for the asymptotic variance of M-estimates for scale, we define Fisher information of scale of any distribution function F on the real line as a suitable supremum. In addition, we enforce equivariance by a…

Statistics Theory · Mathematics 2015-03-17 Peter Ruckdeschel , Helmut Rieder

The quantum Fisher information is a Riemannian metric, defined on the state space of a quantum system, which is symmetric and decreasing under stochastic mappings. Contrary to the classical case such a metric is not unique. We complete the…

Mathematical Physics · Physics 2007-05-23 Frank Hansen

The Fisher-matrix formalism is used routinely in the literature on gravitational-wave detection to characterize the parameter-estimation performance of gravitational-wave measurements, given parametrized models of the waveforms, and…

General Relativity and Quantum Cosmology · Physics 2008-11-26 Michele Vallisneri

The exceptional points of non-Hermitian systems, where $n$ different energy eigenstates merge into an identical one, have many intriguing properties that have no counterparts in Hermitian systems. In particular, the $\epsilon^{1/n}$…

Quantum Physics · Physics 2019-09-04 Chong Chen , Liang Jin , Ren-Bao Liu

Morozova and Chentsov (Morozova and Chentsov 90) studied Riemannian metrics on the set of probability measures. They showed that, up to a constant factor, the Fisher information is the only Riemannian metric which is monotone under…

Quantum Physics · Physics 2008-05-02 Caleb J O'Loan

Shannon information entropy is a natural measure of probability (de)localization and thus (un)predictability in various procedures of data analysis for model systems. We pay particular attention to links between the Shannon entropy and the…

Statistical Mechanics · Physics 2007-05-23 Piotr Garbaczewski

Optical metrology has progressed beyond the Abbe-Rayleigh limit, unlocking (sub)atomic precision by leveraging nonlinear phenomena, statistical accumulation, and AI estimators trained on measurand variations. Here, we show that Fisher…

Chentsov's theorem characterizes the Fisher information metric on statistical models as essentially the only Riemannian metric that is invariant under sufficient statistics. This implies that each statistical model is naturally equipped…

Statistics Theory · Mathematics 2017-05-23 James G. Dowty

The efficacy of mathematical models heavily depends on the quality of the training data, yet collecting sufficient data is often expensive and challenging. Many modeling applications require inferring parameters only as a means to predict…