English
Related papers

Related papers: Fitting covariance matrix models to simulations

200 papers

Reliable extraction of cosmological information from clustering measurements of galaxy surveys requires estimation of the error covariance matrices of observables. The accuracy of covariance matrices is limited by our ability to generate…

Cosmology and Nongalactic Astrophysics · Physics 2017-08-29 Mohammadjavad Vakili , Francisco-Shu Kitaura , Yu Feng , Gustavo Yepes , Cheng Zhao , Chia-Hsun Chuang , ChangHoon Hahn

We consider estimation of the covariance matrix of a multivariate random vector under the constraint that certain covariances are zero. We first present an algorithm, which we call Iterative Conditional Fitting, for computing the maximum…

Statistics Theory · Mathematics 2010-03-04 Sanjay Chaudhuri , Mathias Drton , Thomas S. Richardson

The final step of most large-scale structure analyses involves the comparison of power spectra or correlation functions to theoretical models. It is clear that the theoretical models have parameter dependence, but frequently the…

Cosmology and Nongalactic Astrophysics · Physics 2016-01-13 Martin White , Nikhil Padmanabhan

The variance--covariance matrix plays a central role in the inferential theories of high-dimensional factor models in finance and economics. Popular regularization methods of directly exploiting sparsity are not directly applicable to many…

Methodology · Statistics 2012-03-15 Jianqing Fan , Yuan Liao , Martina Mincheva

Current and forthcoming cosmological data analyses share the challenge of huge datasets alongside increasingly tight requirements on the precision and accuracy of extracted cosmological parameters. The community is becoming increasingly…

Instrumentation and Methods for Astrophysics · Physics 2014-12-17 Benjamin Joachimi , Andy Taylor

When inferring parameters from a Gaussian-distributed data set by computing a likelihood, a covariance matrix is needed that describes the data errors and their correlations. If the covariance matrix is not known a priori, it may be…

Cosmology and Nongalactic Astrophysics · Physics 2016-01-27 Elena Sellentin , Alan F. Heavens

This paper is the first in a set that analyses the covariance matrices of clustering statistics obtained from several approximate methods for gravitational structure formation. We focus here on the covariance matrices of anisotropic…

Testing the equality of the covariance matrices of two high-dimensional samples is a fundamental inference problem in statistics. Several tests have been proposed but they are either too liberal or too conservative when the required…

Statistics Theory · Mathematics 2023-01-04 Jin-Ting Zhang , Jingyi Wang , Tianming Zhu

We study the properties of galaxy cluster 2-point correlation function covariance matrices estimated using the linear-construction (LC) method, which is computationally up to 20 times faster than the standard sample-covariance method. Our…

Cosmology and Nongalactic Astrophysics · Physics 2026-03-12 V. Lindholm , E. Sihvola , J. Valiviita , A. Fumagalli , B. Altieri , S. Andreon , N. Auricchio , C. Baccigalupi , M. Baldi , S. Bardelli , P. Battaglia , A. Biviano , E. Branchini , M. Brescia , S. Camera , V. Capobianco , C. Carbone , V. F. Cardone , J. Carretero , S. Casas , M. Castellano , G. Castignani , S. Cavuoti , K. C. Chambers , A. Cimatti , C. Colodro-Conde , G. Congedo , L. Conversi , Y. Copin , F. Courbin , H. M. Courtois , A. Da Silva , H. Degaudenzi , G. De Lucia , H. Dole , F. Dubath , X. Dupac , S. Dusini , S. Escoffier , M. Farina , R. Farinelli , S. Ferriol , F. Finelli , P. Fosalba , S. Fotopoulou , M. Frailis , E. Franceschi , M. Fumana , S. Galeotta , K. George , B. Gillis , C. Giocoli , J. Gracia-Carpio , A. Grazian , F. Grupp , S. V. H. Haugan , W. Holmes , F. Hormuth , A. Hornstrup , K. Jahnke , M. Jhabvala , S. Kermiche , A. Kiessling , B. Kubik , M. Kunz , H. Kurki-Suonio , A. M. C. Le Brun , S. Ligori , P. B. Lilje , I. Lloro , G. Mainetti , E. Maiorano , O. Mansutti , S. Marcin , O. Marggraf , M. Martinelli , N. Martinet , F. Marulli , R. J. Massey , E. Medinaceli , S. Mei , M. Melchior , M. Meneghetti , E. Merlin , G. Meylan , A. Mora , M. Moresco , L. Moscardini , R. Nakajima , C. Neissner , S. -M. Niemi , C. Padilla , S. Paltani , F. Pasian , K. Pedersen , V. Pettorino , S. Pires , G. Polenta , M. Poncet , L. A. Popa , F. Raison , A. Renzi , J. Rhodes , G. Riccio , E. Romelli , M. Roncarelli , C. Rosset , R. Saglia , Z. Sakr , A. G. Sánchez , D. Sapone , P. Schneider , T. Schrabback , A. Secroun , G. Seidel , P. Simon , C. Sirignano , G. Sirri , L. Stanco , P. Tallada-Crespí , A. N. Taylor , I. Tereno , S. Toft , R. Toledo-Moreo , F. Torradeflot , I. Tutusaus , T. Vassallo , G. Verdoes Kleijn , Y. Wang , J. Weller , G. Zamorani , E. Zucca , T. Castro , J. Martín-Fleitas , P. Monaco , A. Pezzotta , V. Scottez , M. Sereno , M. Viel , D. Sciotti

We introduce a new method for estimating the covariance matrix for the galaxy correlation function in surveys of large-scale structure. Our method combines simple theoretical results with a realistic characterization of the survey to…

Cosmology and Nongalactic Astrophysics · Physics 2016-08-31 Ross O'Connell , Daniel Eisenstein , Mariana Vargas , Shirley Ho , Nikhil Padmanabhan

In many practical situations we would like to estimate the covariance matrix of a set of variables from an insufficient amount of data. More specifically, if we have a set of $N$ independent, identically distributed measurements of an $M$…

Probability · Mathematics 2010-10-05 Thomas L. Marzetta , Gabriel H. Tucci , Steven H. Simon

The global minimum-variance portfolio is a typical choice for investors because of its simplicity and broad applicability. Although it requires only one input, namely the covariance matrix of asset returns, estimating the optimal solution…

Portfolio Management · Quantitative Finance 2021-01-08 Sven Husmann , Antoniya Shivarova , Rick Steinert

The classic likelihood ratio test for testing the equality of two covariance matrices breakdowns due to the singularity of the sample covariance matrices when the data dimension $p$ is larger than the sample size $n$. In this paper, we…

Methodology · Statistics 2015-11-06 Tung-Lung Wu , Ping Li

Complex phenomena in engineering and the sciences are often modeled with computationally intensive feed-forward simulations for which a tractable analytic likelihood does not exist. In these cases, it is sometimes necessary to estimate an…

Methodology · Statistics 2020-06-18 Niccolò Dalmasso , Ann B. Lee , Rafael Izbicki , Taylor Pospisil , Ilmun Kim , Chieh-An Lin

Relying on recent advances in statistical estimation of covariance distances based on random matrix theory, this article proposes an improved covariance and precision matrix estimation for a wide family of metrics. The method is shown to…

Machine Learning · Statistics 2021-02-03 Malik Tiomoko , Florent Bouchard , Guillaume Ginholac , Romain Couillet

This work presents a detailed covariance and correlation matrix analysis for experimentally measured cross sections obtained using the activation technique. Both statistical and systematic contributions to the covariance matrix were…

Nuclear Theory · Physics 2026-04-01 Tanmoy Bar

Covariance matrix estimation concerns the problem of estimating the covariance matrix from a collection of samples, which is of extreme importance in many applications. Classical results have shown that $O(n)$ samples are sufficient to…

Information Theory · Computer Science 2019-03-19 Wei Cui , Xu Zhang , Yulong Liu

We describe an approximate statistical model for the sample variance distribution of the non-linear matter power spectrum that can be calibrated from limited numbers of simulations. Our model retains the common assumption of a multivariate…

In this paper, we propose a new test for testing the equality of two population covariance matrices in the ultra-high dimensional setting that the dimension is much larger than the sizes of both of the two samples. Our proposed methodology…

Methodology · Statistics 2023-12-19 Xiucai Ding , Yichen Hu , Zhenggang Wang

In this study, we investigate the impact of covariance within uncertainties on the inference of cosmological and astrophysical parameters, specifically focusing on galaxy stellar mass functions derived from the CAMELS simulation suite.…

Cosmology and Nongalactic Astrophysics · Physics 2024-10-30 Yongseok Jo , Shy Genel , Joel Leja , Benjamin Wandelt