English
Related papers

Related papers: Inferring an optimal Fisher measure

200 papers

I present several new relations between mutual information (MI) and statistical estimation error for a system that can be regarded simultaneously as a communication channel and as an estimator of an input parameter. I first derive a…

Applications · Statistics 2010-10-08 Sudhakar Prasad

The Fisher Information Metric (FIM) and the associated Cram\'er-Rao Bound (CRB) are fundamental tools in statistical signal processing, which inform the efficient design of experiments and algorithms for estimating the underlying…

Signal Processing · Electrical Eng. & Systems 2025-05-20 Shiraz Khan , Gregory S. Chirikjian

We propose the generalised Fisher information or the one-parameter extended class of the Fisher information for the case of one random variable. This new form of the Fisher information is obtained from the intriguing connection between the…

Statistics Theory · Mathematics 2022-08-25 Worachet Bukaew , Sikarin Yoo-Kong

Quantum Fisher information is the principal tool used to give the ultimate precision bound on the estimation of parameters for quantum channels. In this work, we present analytical expressions for the quantum Fisher information with three…

Quantum Physics · Physics 2023-03-08 Lorenzo M. Procopio

Fast Incremental Expectation Maximization (FIEM) is a version of the EM framework for large datasets. In this paper, we first recast FIEM and other incremental EM type algorithms in the {\em Stochastic Approximation within EM} framework.…

Machine Learning · Computer Science 2021-01-01 Gersende Fort , P. Gach , E. Moulines

We study the time-dependent quantum Fisher information (QFI) in an open quantum system satisfying the Gorini-Kossakowski-Sudarshan-Lindblad master equation. We also study the dynamics of the system from an effective non-Hermitian dynamics…

Quantum Physics · Physics 2023-06-12 Zain H. Saleem , Anil Shaji , Stephen K. Gray

It is shown that the diffusion equation and its adjoint (time reversed) equation can be derived with only a few assumptions, using an information-theoretic approach based on the principle of minimum Fisher information

Statistical Mechanics · Physics 2007-05-23 Marcel Reginatto , Florian Lengyel

This paper proposes a unifying variational approach for proving and extending some fundamental information theoretic inequalities. Fundamental information theory results such as maximization of differential entropy, minimization of Fisher…

Information Theory · Computer Science 2016-02-05 Sangwoo Park , Erchin Serpedin , Khalid Qaraqe

We present a new efficient hybrid parameter estimation method based on the idea, that if nonlinear dynamic models are stated in terms of a system of equations that is linear in terms of the parameters, then regularized ordinary least…

This work investigates the impact of imperfect statistical information in the uplink of massive MIMO systems. In particular, we first show why covariance information is needed and then propose two schemes for covariance matrix estimation. A…

Information Theory · Computer Science 2017-03-21 Emil Björnson , Luca Sanguinetti , Merouane Debbah

Variational extremization of the relative Fisher information (RFI, hereafter) is performed. Reciprocity relations, akin to those of thermodynamics are derived, employing the extremal results of the RFI expressed in terms of probability…

Statistical Mechanics · Physics 2015-06-18 R. C. Venkatesan , A. Plastino

The $(i)$ reciprocity relations for the relative Fisher information (RFI, hereafter) and $(ii)$ a generalized RFI-Euler theorem, are self-consistently derived from the Hellmann-Feynman theorem. These new reciprocity relations generalize the…

Statistical Mechanics · Physics 2015-05-12 R. C. Venkatesan , A. Plastino

List-mode data is increasingly being uesd in SPECT and PET imaging, among other imaging modalities. However, there are still many imaging designs that effectively bin list-mode data before image reconstruction or other estimation tasks are…

Information Theory · Computer Science 2020-03-18 Eric Clarkson

The expected decrease in system inertia and frequency stability motivates the development and maintenance of dynamic system models by Transmission System Operators. However, some dynamic model parameters can be unavailable due to market…

Signal Processing · Electrical Eng. & Systems 2025-05-27 Dawn Virginillo , Asja Derviškadić , Mario Paolone

Simulation-based inference enables learning the parameters of a model even when its likelihood cannot be computed in practice. One class of methods uses data simulated with different parameters to infer models of the likelihood-to-evidence…

Machine Learning · Computer Science 2022-06-08 Giulio Isacchini , Natanael Spisak , Armita Nourmohammad , Thierry Mora , Aleksandra M. Walczak

Parameter inference with an estimated covariance matrix systematically loses information due to the remaining uncertainty of the covariance matrix. Here, we quantify this loss of precision and develop a framework to hypothetically restore…

Cosmology and Nongalactic Astrophysics · Physics 2017-03-16 Elena Sellentin , Alan F. Heavens

We study the problem of estimating the magnitude of a Gaussian beam displacement using a two pixel or 'split' detector. We calculate the maximum likelihood estimator, and compute its asymptotic mean-squared-error via the Fisher information.…

Instrumentation and Detectors · Physics 2015-09-11 George C. Knee , William J. Munro

In this contribution, quantum Fisher information is utilized to estimate the parameters of a central qubit interacting with a single-spin qubit. The effect of the longitudinal, transverse and the rotating strengths of the magnetic field on…

Quantum Physics · Physics 2018-04-04 N. Metwally

Side information is being used extensively to improve the effectiveness of sequential recommendation models. It is said to help capture the transition patterns among items. Most previous work on sequential recommendation that uses side…

Information Retrieval · Computer Science 2023-02-22 Yujie Lin , Zhumin Chen , Zhaochun Ren , Chenyang Wang , Qiang Yan , Maarten de Rijke , Xiuzhen Cheng , Pengjie Ren

Circular dichroism (CD) is a widely used technique for investigating optically chiral molecules, especially for biomolecules. It is thus of great importance that these parameters be estimated precisely so that the molecules with desired…

Quantum Physics · Physics 2021-12-28 Jiaxuan Wang , Girish S. Agarwal