Related papers: Fisher Information for Inverse Problems and Trace …
The principle of minimum Fisher information states that in the set of acceptable probability distributions characterizing the given system, it is best done by the one that minimizes the corresponding Fisher information. This principle can…
The Fisher-matrix formalism is used routinely in the literature on gravitational-wave detection to characterize the parameter-estimation performance of gravitational-wave measurements, given parametrized models of the waveforms, and…
We employ a unified framework for computing the information capacity of biological signaling systems using Fisher Information. By deriving closed-form or easily computable information capacity formulas, we quantify how well different…
The Fisher Information Matrix formalism is extended to cases where the data is divided into two parts (X,Y), where the expectation value of Y depends on X according to some theoretical model, and X and Y both have errors with arbitrary…
We prove that the reciprocal of Fisher information of a log-concave probability density $X$ in ${\bf{R}}^n$ is concave in $t$ with respect to the addition of a Gaussian noise $Z_t = N(0, tI_n)$. As a byproduct of this result we show that…
A deep neural network is a hierarchical nonlinear model transforming input signals to output signals. Its input-output relation is considered to be stochastic, being described for a given input by a parameterized conditional probability…
Bayesian inversion is central to the quantification of uncertainty within problems arising from numerous applications in science and engineering. To formulate the approach, four ingredients are required: a forward model mapping the unknown…
A common approach to analyzing categorical correlated time series data is to fit a generalized linear model (GLM) with past data as covariate inputs. There remain challenges to conducting inference for short time series length. By treating…
The Bayesian approach to inverse problems is of paramount importance in quantifying uncertainty about the input to and the state of a system of interest given noisy observations. Herein we consider the forward problem of the forced 2D…
We study the problem of estimating the magnitude of a Gaussian beam displacement using a two pixel or 'split' detector. We calculate the maximum likelihood estimator, and compute its asymptotic mean-squared-error via the Fisher information.…
In this study, we model the dark matter and baryon matter distribution in the Cosmic Web by means of highly nonlinear Schr\"{o}dinger type and reaction diffusion wave mechanical descriptions. The construction of these wave mechanical models…
We show that Grover's algorithm defines a geodesic in quantum Hilbert space with the Fubini-Study metric. From statistical point of view Grover's algorithm is characterized by constant Fisher's function. Quantum algorithms changing…
We derive a general upper bound to mutual information in terms of the Fisher information. The bound may be further used to derive a lower bound for the Bayesian quadratic cost. These two provide alternatives to other inequalities in the…
Consider the centered Gaussian vector $X$ in $\R^n$ with covariance matrix $ \Sigma.$ Randomize $\Sigma$ such that $ \Sigma^{-1}$ has a Wishart distribution with shape parameter $p>(n-1)/2$ and mean $p\sigma.$ We compute the density…
Structured optical beams possess rich spatial features that are commonly characterized using entropic measures of field complexity. However, such measures do not directly quantify the operational usefulness of optical structure for…
In the estimation for a parametric family of quantum state on a Hilbert space $\mathcal{H}$, the Gill and Massar bound is known as a lower bound of weighted traces of covariances of unbiased estimators. The Gill and Massar bound is derived…
Second-order information -- such as curvature or data covariance -- is critical for optimisation, diagnostics, and robustness. However, in many modern settings, only the gradients are observable. We show that the gradients alone can reveal…
In these notes, we investigate the tail behaviour of the norm of subgaussian vectors in a Hilbert space. The subgaussian variance proxy is given as a trace class operator, allowing for a precise control of the moments along each dimension…
The net Fisher information measure, defined as the product of position and momentum Fisher information measures and derived from the non-relativistic Hartree-Fock wave functions for atoms with Z=1-102, is found to correlate well with the…
For linear inverse problems with Gaussian priors and Gaussian observation noise, the posterior is Gaussian, with mean and covariance determined by the conditioning formula. The covariance is the central object for uncertainty…