English
Related papers

Related papers: Quantifying lost information due to covariance mat…

200 papers

The covariance matrix of the matter power spectrum is a key element of the statistical analysis of galaxy clustering data. Independent realisations of observational measurements can be used to sample the covariance, nevertheless statistical…

Cosmology and Nongalactic Astrophysics · Physics 2016-04-14 Linda Blot , Pier Stefano Corasaniti , Luca Amendola , Thomas D. Kitching

The Fisher information matrix (FIM) is a key quantity in statistics as it is required for example for evaluating asymptotic precisions of parameter estimates, for computing test statistics or asymptotic distributions in statistical testing,…

Methodology · Statistics 2023-02-07 Maud Delattre , Estelle Kuhn

The Fisher Information matrix is a widely used measure for applications ranging from statistical inference, information geometry, experiment design, to the study of criticality in biological systems. Yet there is no commonly accepted…

Computation · Statistics 2016-02-17 Omri Har Shemesh , Rick Quax , Borja Miñano , Alfons G. Hoekstra , Peter M. A. Sloot

Fisher Information is a key notion in the whole field of quantum metrology. It allows for a direct quantification of maximal achievable precision of estimation of parameters encoded in quantum states using the most general quantum…

Quantum Physics · Physics 2023-04-25 Stanislaw Kurdzialek , Rafal Demkowicz-Dobrzanski

The properties of the normal distribution under linear transformation, as well the easy way to compute the covariance matrix of marginals and conditionals, offer a unique opportunity to get an insight about several aspects of uncertainties…

Data Analysis, Statistics and Probability · Physics 2018-02-12 Giulio D'Agostini

Current and forthcoming cosmological data analyses share the challenge of huge datasets alongside increasingly tight requirements on the precision and accuracy of extracted cosmological parameters. The community is becoming increasingly…

Instrumentation and Methods for Astrophysics · Physics 2014-12-17 Benjamin Joachimi , Andy Taylor

Data analysis in cosmology requires reliable covariance matrices. Covariance matrices derived from numerical simulations often require a very large number of realizations to be accurate. When a theoretical model for the covariance matrix…

Cosmology and Nongalactic Astrophysics · Physics 2022-12-21 Alessandra Fumagalli , Matteo Biagetti , Alexandro Saro , Emiliano Sefusatti , Anže Slosar , Pierluigi Monaco , Alfonso Veropalumbo

Although a majority of the theoretical literature in high-dimensional statistics has focused on settings which involve fully-observed data, settings with missing values and corruptions are common in practice. We consider the problems of…

Machine Learning · Statistics 2017-11-06 Yining Wang , Jialei Wang , Sivaraman Balakrishnan , Aarti Singh

The Fisher information matrix is a quantity of fundamental importance for information geometry and asymptotic statistics. In practice, it is widely used to quickly estimate the expected information available in a data set and guide…

Methodology · Statistics 2023-06-06 William R. Coulton , Benjamin D. Wandelt

The possible methodologies to handle the uncertain parameter are reviewed. The core idea of the desensitized Kalman filter is introduced. A new cost function consisting of a posterior covariance trace and trace of a weighted norm of the…

Information Theory · Computer Science 2015-04-21 Taishan Lou

In this paper, we study the problem of high-dimensional approximately low-rank covariance matrix estimation with missing observations. We propose a simple procedure computationally tractable in high-dimension and that does not require…

Statistics Theory · Mathematics 2012-05-14 Karim Lounici

AIMS. The maximum-likelihood method is the standard approach to obtain model fits to observational data and the corresponding confidence regions. We investigate possible sources of bias in the log-likelihood function and its subsequent…

Astrophysics · Physics 2009-11-11 J. Hartlap , P. Simon , P. Schneider

The eigendecomposition of a matrix is the central procedure in probabilistic models based on matrix factorization, for instance principal component analysis and topic models. Quantifying the uncertainty of such a decomposition based on a…

Statistics Theory · Mathematics 2022-08-26 Teodora Popordanoska , Aleksei Tiulpin , Wacha Bounliphone , Matthew B. Blaschko

We consider the problem of precision matrix estimation where, due to extraneous confounding of the underlying precision matrix, the data are independent but not identically distributed. While such confounding occurs in many scientific…

Machine Learning · Statistics 2019-07-01 Sinong Geng , Mladen Kolar , Oluwasanmi Koyejo

The covariance matrix plays a fundamental role in many modern exploratory and inferential statistical procedures, including dimensionality reduction, hypothesis testing, and regression. In low-dimensional regimes, where the number of…

Methodology · Statistics 2024-11-12 Philippe Boileau , Nima S. Hejazi , Mark J. van der Laan , Sandrine Dudoit

We derive a maximum a posteriori estimator for the linear observation model, where the signal and noise covariance matrices are both uncertain. The uncertainties are treated probabilistically by modeling the covariance matrices with prior…

Statistics Theory · Mathematics 2014-03-12 Dave Zachariah , Nafiseh Shariati , Mats Bengtsson , Magnus Jansson , Saikat Chatterjee

In quantum metrology, the parameter estimation accuracy is bounded by quantum Fisher information. In this paper, we present coherence measures in terms of (quantum) Fisher information by directly considering the post-selective non-unitary…

Quantum Physics · Physics 2023-07-06 Deng-hui Yu , Chang-shui Yu

We propose a novel iterative algorithm for estimating a deterministic but unknown parameter vector in the presence of model uncertainties. This iterative algorithm is based on a system model where an overall noise term describes both, the…

Statistics Theory · Mathematics 2017-11-27 Oliver Lang , Michael Lunglmayr , Mario Huemer

Data analysis from upcoming large galaxy redshift surveys, such as Euclid and DESI will significantly improve constraints on cosmological parameters. To optimally extract the information from these galaxy surveys, it is important to control…

Cosmology and Nongalactic Astrophysics · Physics 2025-01-22 S. Gouyou Beauchamps , P. Baratta , S. Escoffier , W. Gillard , J. Bel , J. Bautista , C. Carbone

Structured covariance matrix estimation in the presence of missing data is addressed in this paper with emphasis on radar signal processing applications. After a motivation of the study, the array model is specified and the problem of…

Signal Processing · Electrical Eng. & Systems 2022-12-09 Augusto Aubry , Antonio De Maio , Stefano Marano , Massimo Rosamilia