English
Related papers

Related papers: Fisher Information and Dynamical Sampling I

200 papers

Statistical Inference is the process of determining a probability distribution over the space of parameters of a model given a data set. As more data becomes available this probability distribution becomes updated via the application of…

Disordered Systems and Neural Networks · Physics 2022-04-28 David S. Berman , Jonathan J. Heckman , Marc Klinger

In this chapter, a statistical measure of complexity and the Fisher-Shannon information product are introduced and their properties are discussed. These measures are based on the interplay between the Shannon information, or a function of…

Chaotic Dynamics · Physics 2012-01-13 Ricardo Lopez-Ruiz , Jaime Sanudo , Elvira Romera , Xavier Calbet

A modelling framework, based on the theory of signal processing, for characterising the dynamics of systems driven by the unravelling of information is outlined, and is applied to describe the process of decision making. The model input of…

Theoretical Economics · Economics 2022-04-14 Dorje C. Brody

Identifying the origin of nonequilibrium characteristics in a generic interacting system having multiple degrees of freedom is a challenging task. In this context, information theoretic measures such as mutual information and related…

Statistical Mechanics · Physics 2025-07-24 Biswajit Das , Sreekanth K Manikandan , Ayan Banerjee

We prove that two well-known measures of information are interrelated in interesting and useful ways when applied to nonequilibrium circumstances. A nontrivial form of the lower bound for the Fisher information measure is derived in…

Statistical Mechanics · Physics 2012-04-06 Takuya Yamano

Information theory is a practical and theoretical framework developed for the study of communication over noisy channels. Its probabilistic basis and capacity to relate statistical structure to function make it ideally suited for studying…

Neurons and Cognition · Quantitative Biology 2015-01-09 Robin A. A. Ince , Simon R. Schultz , Stefano Panzeri

Reconstruction techniques are commonly used in cosmology to reduce complicated nonlinear behaviours to a more tractable linearized system. We study a new reconstruction technique that uses the Moving-Mesh algorithm to estimate the…

Cosmology and Nongalactic Astrophysics · Physics 2017-06-21 Qiaoyin Pan , Ue-Li Pen , Derek Inman , Hao-Ran Yu

Traditional machine learning relies on explicit models and domain assumptions, limiting flexibility and interpretability. We introduce a model-free framework using surprisal (information theoretic uncertainty) to directly analyze and…

Cognitive biases are widespread in humans and animals alike, and can sometimes be reinforced by social interactions. One prime bias in judgment and decision-making is the human tendency to underestimate large quantities. Previous research…

Physics and Society · Physics 2022-01-12 Bertrand Jayles , Clément Sire , Ralf H. J. M Kurvers

We present a method to generate probability distributions that correspond to metrics obeying partial differential equations generated by extremizing a functional $J[g^{\mu\nu}(\theta^i)]$, where $g^{\mu\nu}(\theta^i)$ is the Fisher metric.…

Statistical Mechanics · Physics 2009-11-10 Xavier Calmet , Jacques Calmet

This paper deals with the problem of estimating the coupling constant $\theta$ of a mixing quantum Markov chain. For a repeated measurement on the chain's output we show that the outcomes' time average has an asymptotically normal…

Quantum Physics · Physics 2011-06-23 Madalin Guta

Motivated by the increasing connections between information theory and high-energy physics, particularly in the context of the AdS/CFT correspondence, we explore the information geometry associated to a variety of simple systems. By…

High Energy Physics - Theory · Physics 2020-05-06 Johanna Erdmenger , Kevin T. Grosvenor , Ro Jefferson

We derive upper bounds on the quantum Fisher information in interferometry with $N$ subsystems, e.g. two-level atoms or Gaussian modes, in the presence of arbitrarily correlated Gaussian dephasing including independent and collective…

Quantum Physics · Physics 2014-03-06 Katarzyna Macieszczak

Finding interdependency relations between (possibly multivariate) time series provides valuable knowledge about the processes that generate the signals. Information theory sets a natural framework for non-parametric measures of several…

Information Theory · Computer Science 2016-02-09 German Gomez-Herrero , Wei Wu , Kalle Rutanen , Miguel C. Soriano , Gordon Pipa , Raul Vicente

Motivated by the growing interest in quantum machine learning, in particular quantum neural networks (QNNs), we study how recently introduced evaluation metrics based on the Fisher information matrix (FIM) are effective for predicting their…

Machine Learning · Computer Science 2025-10-09 Lorenzo Pastori , Veronika Eyring , Mierk Schwabe

The eigenvalues and eigenvectors of the Fisher information matrix (FIM) can reveal the most and least sensitive directions of a system and it has wide application across science and engineering. We present a symplectic variant of the…

Information Theory · Computer Science 2023-07-04 Jiannan Yang

We prove two lower bounds for the complexity of non-log-concave sampling within the framework of Balasubramanian et al. (2022), who introduced the use of Fisher information (FI) bounds as a notion of approximate first-order stationarity in…

Machine Learning · Statistics 2022-10-07 Sinho Chewi , Patrik Gerber , Holden Lee , Chen Lu

We derive a general upper bound to mutual information in terms of the Fisher information. The bound may be further used to derive a lower bound for the Bayesian quadratic cost. These two provide alternatives to other inequalities in the…

Quantum Physics · Physics 2025-05-16 Wojciech Górecki , Xi Lu , Chiara Macchiavello , Lorenzo Maccone

Fisher-information inequalities have recently been used as operational witnesses of nonclassical metrological behavior, but their physical meaning is often tied to a particular narrative, such as, segmented dynamics or discrete…

Quantum Physics · Physics 2026-05-20 Jeongho Bang , Su-Yong Lee

This paper presents expression of mutual information that defines the information gain in planning of sensing resources, when the goal is to reduce the forecast uncertainty of some quantities of interest and the system dynamics is described…

Systems and Control · Computer Science 2013-08-02 Han-Lim Choi