English
Related papers

Related papers: Estimating Fisher Information Matrix in Latent Var…

200 papers

The Gaussian graphical model (GGM) incorporates an undirected graph to represent the conditional dependence between variables, with the precision matrix encoding partial correlation between pair of variables given the others. To achieve…

Methodology · Statistics 2023-07-03 Yueqi Qian , Xianghong Hu , Can Yang

The Fisher information approximation (FIA) is an implementation of the minimum description length principle for model selection. Unlike information criteria such as AIC or BIC, it has the advantage of taking the functional form of a model…

Methodology · Statistics 2018-08-02 Daniel W. Heck , Morten Moshagen , Edgar Erdfelder

We present a numerical method to evaluate mutual information (MI) in nonlinear Gaussian noise channels by using denoising score matching (DSM) learning for estimating the score function of channel output. Via de Bruijn's identity, Fisher…

Information Theory · Computer Science 2026-01-06 Tadashi Wadayama

The conventional formulation of quantum sensing is based on the assumption that the probe is reset to its initial state after each measurement. In a very distinct approach, one can also pursue a sequential measurement scheme in which…

Quantum Physics · Physics 2023-08-08 Yaoling Yang , Victor Montenegro , Abolfazl Bayat

Likelihood-based inference in stochastic non-linear dynamical systems, such as those found in chemical reaction networks and biological clock systems, is inherently complex and has largely been limited to small and unrealistically simple…

Computation · Statistics 2024-07-08 Ben Swallow , David A. Rand , Giorgos Minas

Many imaging systems are used to estimate a vector of parameters associated with the object being imaged. In many cases there are other parameters in the model for the imaging data that are not of interest for the task at hand. We refer to…

Information Theory · Computer Science 2019-02-14 Eric Clarkson

Optimum designs for parameter estimation in generalized regression models are standardly based on the Fisher information matrix (cf. Atkinson et al (2014) for a recent exposition). The corresponding optimality criteria are related to the…

Statistics Theory · Mathematics 2015-07-28 Katarína Burclová , Andrej Pázman

For a known weak signal in additive white noise, the asymptotic performance of a locally optimum processor (LOP) is shown to be given by the Fisher information (FI) of a standardized even probability density function (PDF) of noise in three…

Data Analysis, Statistics and Probability · Physics 2011-11-28 Fabing Duan , Francois Chapeau-Blondeau , Derek Abbott

Estimating and detecting faults is crucial in ensuring safe and efficient automated systems. In the presence of disturbances, noise or varying system dynamics, such estimation is even more challenging. To address this challenge, this…

Optimization and Control · Mathematics 2021-12-13 Chris van der Ploeg , Emilia Silvas , Nathan van de Wouw , Peyman Mohajerin Esfahani

We consider the impact that temporal correlations in the measurement statistics can have on the achievable precision in a sequential metrological protocol. In this setting, and for a single quantum probe, we establish that it is the…

Quantum Physics · Physics 2024-04-02 Eoin O'Connor , Steve Campbell , Gabriel T. Landi

In this paper, a two-step strategy for parametric sensitivity analysis for such systems is proposed, exploiting advantages and synergies between two recently proposed sensitivity analysis methodologies for stochastic dynamics. The first…

Molecular Networks · Quantitative Biology 2016-02-17 Georgios Arampatzis , Markos A. Katsoulakis , Yannis Pantazis

In many practical situations we would like to estimate the covariance matrix of a set of variables from an insufficient amount of data. More specifically, if we have a set of $N$ independent, identically distributed measurements of an $M$…

Probability · Mathematics 2010-10-05 Thomas L. Marzetta , Gabriel H. Tucci , Steven H. Simon

In quantum multi-parameter estimation, the precision of estimating unknown parameters is bounded by the Cramer-Rao bound (CRB), defined via the inverse of the Fisher information matrix (FIM). However, in certain scenarios such as…

Quantum Physics · Physics 2025-11-18 Min Namkung , Changhyoup Lee , Hyang-Tag Lim

A robust prediction model invoking the Takens embedding theorem, whose \textit{working hypothesis} is obtained via an inference procedure based on the minimum Fisher information principle, is presented. The coefficients of the ansatz,…

Methodology · Statistics 2017-04-26 R. C. Venkatesan , A. Plastino

Information theory is a powerful framework to capture aspects of dynamical systems with multiple degrees of freedom. Mathematically, the dynamics can be represented as a continuous curve $\mathcal{C}$ on a suitable hyperplane in flat space…

Information Theory · Computer Science 2026-04-28 Mattia Carrino , Stefan Hohenegger

In the context of linear regression, we construct a data-driven convex loss function with respect to which empirical risk minimisation yields optimal asymptotic variance in the downstream estimation of the regression coefficients. At the…

Statistics Theory · Mathematics 2025-05-29 Oliver Y. Feng , Yu-Chun Kao , Min Xu , Richard J. Samworth

Quantum Fisher information matrix (QFIM) is a core concept in theoretical quantum metrology due to the significant importance of quantum Cram\'{e}r-Rao bound in quantum parameter estimation. However, studies in recent years have revealed…

Quantum Physics · Physics 2020-03-27 Jing Liu , Haidong Yuan , Xiao-Ming Lu , Xiaoguang Wang

Physics-Informed Neural Networks (PINNs) have emerged as a powerful tool for solving differential equations and modeling physical systems by embedding physical laws into the learning process. However, rigorously quantifying how well a PINN…

Machine Learning · Computer Science 2026-01-21 Josafat Ribeiro Leal Filho , Antônio Augusto Fröhlich

The design of informatively rich input signals is essential for accurate system identification, yet classical Fisher-information-based methods are inherently local and often inadequate in the presence of significant model uncertainty and…

Statistics Theory · Mathematics 2025-12-15 Piotr Bania , Anna Wójcik

We present a toolbox of new techniques and concepts for the efficient forecasting of experimental sensitivities. These are applicable to a large range of scenarios in (astro-)particle physics, and based on the Fisher information formalism.…

Instrumentation and Methods for Astrophysics · Physics 2018-02-28 Thomas D. P. Edwards , Christoph Weniger