English
Related papers

Related papers: Quantifying lost information due to covariance mat…

200 papers

The efficacy of mathematical models heavily depends on the quality of the training data, yet collecting sufficient data is often expensive and challenging. Many modeling applications require inferring parameters only as a means to predict…

Evolving feature densities across batches of training data bias cross-validation, making model selection and assessment unreliable (\cite{sugiyama2012machine}). This work takes a distributed density estimation angle to the training setting…

Machine Learning · Computer Science 2025-02-25 Behraj Khan , Behroz Mirza , Tahir Syed

In many astrophysical settings covariance matrices of large datasets have to be determined empirically from a finite number of mock realisations. The resulting noise degrades inference and precludes it completely if there are fewer…

Instrumentation and Methods for Astrophysics · Physics 2017-01-11 Benjamin Joachimi

We consider high-dimensional measurement errors with high-frequency data. Our objective is on recovering the high-dimensional cross-sectional covariance matrix of the random errors with optimality. In this problem, not all components of the…

Statistics Theory · Mathematics 2024-04-03 Jinyuan Chang , Qiao Hu , Cheng Liu , Cheng Yong Tang

We consider the problem of estimating a low-dimensional parameter in high-dimensional linear regression. Constructing an approximately unbiased estimate of the parameter of interest is a crucial step towards performing statistical…

Statistics Theory · Mathematics 2021-07-30 Michael Celentano , Andrea Montanari

We study how well the Gaussian approximation is valid for computing the covariance matrices of the convergence power and bispectrum in weak gravitational lensing analyses. We focus on its impact on the cosmological parameter estimations by…

Cosmology and Nongalactic Astrophysics · Physics 2015-06-12 Masanori Sato , Takahiro Nishimichi

Covariance matrices are important tools for obtaining reliable parameter constraints. Advancements in cosmological surveys lead to larger data vectors and, consequently, increasingly complex covariance matrices, whose number of elements…

Cosmology and Nongalactic Astrophysics · Physics 2022-05-31 Tassia Ferreira , Valerio Marra

Quantum Fisher information matrices (QFIMs) are fundamental to estimation theory: they encode the ultimate limit for the sensitivity with which a set of parameters can be estimated using a given probe. Since the limit invokes the inverse of…

Quantum Physics · Physics 2022-09-16 Aaron Z. Goldberg , José L. Romero , Ángel S. Sanz , Luis L. Sánchez-Soto

We propose methodology for statistical inference for low-dimensional parameters of sparse precision matrices in a high-dimensional setting. Our method leads to a non-sparse estimator of the precision matrix whose entries have a Gaussian…

Statistics Theory · Mathematics 2015-08-13 Jana Jankova , Sara van de Geer

Using mathematical models to assist in the interpretation of experiments is becoming increasingly important in research across applied mathematics, and in particular in biology and ecology. In this context, accurate parameter estimation is…

Statistics Theory · Mathematics 2025-04-29 Jie Qi , Ruth E. Baker

In unconstrained maximum a posteriori (MAP) and maximum likelihood estimation, the inverse of minus the merit-function Hessian matrix is an approximation of the estimate covariance matrix. In the Bayesian context of MAP estimation, it is…

Methodology · Statistics 2020-03-17 Dimas Abreu Archanjo Dutra

Missing data occur frequently in a wide range of applications. In this paper, we consider estimation of high-dimensional covariance matrices in the presence of missing observations under a general missing completely at random model in the…

Methodology · Statistics 2016-05-17 T. Tony Cai , Anru Zhang

This paper tackles the problem of robust covariance matrix estimation when the data is incomplete. Classical statistical estimation methodologies are usually built upon the Gaussian assumption, whereas existing robust estimation ones assume…

We address the characterization of dissipative bosonic channels and show that estimation of the loss rate by Gaussian probes (coherent or squeezed) is improved in the presence of Kerr nonlinearity. In particular, enhancement of precision…

Quantum Physics · Physics 2016-05-11 Matteo A. C. Rossi , Francesco Albarelli , Matteo G. A. Paris

Accurate and precise covariance matrices will be important in enabling planned cosmological surveys to detect new physics. Standard methods imply either the need for many N-body simulations in order to obtain an accurate estimate, or a…

Cosmology and Nongalactic Astrophysics · Physics 2018-12-13 Alex Hall , Andy Taylor

Noise affects the performance of quantum technologies, hence the importance of elaborating operative figures of merit that can capture its impact in exact terms. In quantum metrology, the introduction of the Fisher information measurement…

Quantum Physics · Physics 2024-09-30 Francesco Albarelli , Ilaria Gianani , Marco G. Genoni , Marco Barbieri

Missing exposure information is a very common feature of many observational studies. Here we study identifiability and efficient estimation of causal effects on vector outcomes, in such cases where treatment is unconfounded but partially…

Methodology · Statistics 2020-02-04 Edward H. Kennedy

Uncertainty estimation is a key factor that makes deep learning reliable in practical applications. Recently proposed evidential neural networks explicitly account for different uncertainties by treating the network's outputs as evidence to…

Machine Learning · Computer Science 2023-07-03 Danruo Deng , Guangyong Chen , Yang Yu , Furui Liu , Pheng-Ann Heng

In this study, we investigate the impact of covariance within uncertainties on the inference of cosmological and astrophysical parameters, specifically focusing on galaxy stellar mass functions derived from the CAMELS simulation suite.…

Cosmology and Nongalactic Astrophysics · Physics 2024-10-30 Yongseok Jo , Shy Genel , Joel Leja , Benjamin Wandelt

We discuss a parameter estimation problem using quantum decoherece in the double-slit interferometer. We consider a particle coupled to a massive scalar field after the particle passing through the double slit and solve the dynamics…

Quantum Physics · Physics 2018-07-18 Akira Matsumura , Taishi Ikeda , Shingo Kukita