English
Related papers

Related papers: Fitting covariance matrix models to simulations

200 papers

Factor modeling is an essential tool for exploring intrinsic dependence structures among high-dimensional random variables. Much progress has been made for estimating the covariance matrix from a high-dimensional factor model. However, the…

Statistics Theory · Mathematics 2016-10-26 Quefeng Li , Guang Cheng , Jianqing Fan , Yuyan Wang

In many astrophysical settings covariance matrices of large datasets have to be determined empirically from a finite number of mock realisations. The resulting noise degrades inference and precludes it completely if there are fewer…

Instrumentation and Methods for Astrophysics · Physics 2017-01-11 Benjamin Joachimi

Weak lensing has become a powerful tool for probing the matter distribution in the Universe and constraining cosmological parameters. This paper aims to explore the fast mock generation pipeline to obtain the covariance matrix of the…

Cosmology and Nongalactic Astrophysics · Physics 2025-06-17 Yiming Hu , Yu Yu

We consider estimation of covariance matrices and their inverses (a.k.a. precision matrices) for high-dimensional stationary and locally stationary time series. In the latter case the covariance matrices evolve smoothly in time, thus…

Statistics Theory · Mathematics 2014-01-07 Xiaohui Chen , Mengyu Xu , Wei Biao Wu

The gravitationally-driven evolution of cold dark matter dominates the formation of structure in the Universe over a wide range of length scales. While the longest scales can be treated by perturbation theory, a fully quantitative…

Astrophysics · Physics 2009-11-10 Katrin Heitmann , Paul M. Ricker , Michael S. Warren , Salman Habib

We consider high-dimensional measurement errors with high-frequency data. Our objective is on recovering the high-dimensional cross-sectional covariance matrix of the random errors with optimality. In this problem, not all components of the…

Statistics Theory · Mathematics 2024-04-03 Jinyuan Chang , Qiao Hu , Cheng Liu , Cheng Yong Tang

We measure the 3PCF of 300 halo catalogs from the Minerva simulations covering a total volume of $~1000 h^{-3} \mathrm{Gpc}^3$. Each 3PCF measurement includes all possible triangular configurations with sides between 20 and…

Cosmology and Nongalactic Astrophysics · Physics 2022-09-21 A. Veropalumbo , A. Binetti , E. Branchini , M. Moresco , P. Monaco , A. Oddo , A. G. Sánchez , E. Sefusatti

Estimating large covariance and precision matrices are fundamental in modern multivariate analysis. The problems arise from statistical analysis of large panel economics and finance data. The covariance matrix reveals marginal correlations…

Methodology · Statistics 2015-04-17 Jianqing Fan , Yuan Liao , Han Liu

In this thesis, a Bayes linear methodology for the adjustment of covariance matrices is presented and discussed. A geometric framework for quantifying uncertainties about covariance matrices is set up, and an inner-product for spaces of…

bayes-an · Physics 2016-08-31 Darren J Wilkinson

We propose two tests for the equality of covariance matrices between two high-dimensional populations. One test is on the whole variance--covariance matrices, and the other is on off-diagonal sub-matrices, which define the covariance…

Statistics Theory · Mathematics 2012-06-06 Jun Li , Song Xi Chen

Super sample covariance (SSC) is important when estimating covariance matrices using a set of mock catalogues for galaxy surveys. If the underlying cosmological simulations do not include the variation in background parameters appropriate…

Cosmology and Nongalactic Astrophysics · Physics 2025-03-05 Greg Schreiner , Alex Krolewski , Shahab Joudaki , Will J. Percival

AIMS. The maximum-likelihood method is the standard approach to obtain model fits to observational data and the corresponding confidence regions. We investigate possible sources of bias in the log-likelihood function and its subsequent…

Astrophysics · Physics 2009-11-11 J. Hartlap , P. Simon , P. Schneider

An accurate covariance matrix is essential for obtaining reliable cosmological results when using a Gaussian likelihood. In this paper we study the covariance of pseudo-$C_\ell$ estimates of tomographic cosmic shear power spectra. Using two…

Estimating a covariance matrix is central to high-dimensional data analysis. Empirical analyses of high-dimensional biomedical data, including genomics, proteomics, microbiome, and neuroimaging, among others, consistently reveal strong…

Methodology · Statistics 2024-12-05 Yifan Yang , Chixiang Chen , Shuo Chen

Weak gravitational lensing is a powerful probe of cosmology, with second-order shear statistics commonly used to constrain parameters such as the matter density $\Omega_\mathrm{m}$ and the clustering amplitude $S_8$. However, parameter…

Cosmology and Nongalactic Astrophysics · Physics 2025-09-26 Niek Wielders , Laila Linke , Pierre A. Burger , Sven Heydenreich , Lucas Porth , Peter Schneider

Covariance matrices of random vectors contain information that is crucial for modelling. Specific structures and patterns of the covariances (or correlations) may be used to justify parametric models, e.g., autoregressive models. Until now,…

Methodology · Statistics 2025-02-11 Paavo Sattler , Dennis Dobler

We propose efficient computational methods to fit multivariate Gaussian additive models, where the mean vector and the covariance matrix are allowed to vary with covariates, in an empirical Bayes framework. To guarantee the…

Computation · Statistics 2025-04-07 Vincenzo Gioia , Matteo Fasiolo , Ruggero Bellio , Simon N. Wood

This paper investigates a statistical procedure for testing the equality of two independent estimated covariance matrices when the number of potentially dependent data vectors is large and proportional to the size of the vectors, that is,…

Statistics Theory · Mathematics 2020-06-01 Rémy Mariétan , Stephan Morgenthaler

Model merging provides a way of cheaply combining individual models to produce a model that inherits each individual's capabilities. While some merging methods can approach the performance of multitask training, they are often heuristically…

Machine Learning · Computer Science 2026-04-03 Marawan Gamal Abdel Hameed , Derek Tam , Pascal Jr Tikeng Notsawo , Colin Raffel , Guillaume Rabusseau

We introduce OneCovariance, an open-source software designed to accurately compute covariance matrices for an arbitrary set of two-point summary statistics across a variety of large-scale structure tracers. Utilising the halo model, we…