English
Related papers

Related papers: Large Covariance Matrices: Accurate Models Without…

200 papers

Cosmological $N$-body simulations provide numerical predictions of the structure of the Universe against which to compare data from ongoing and future surveys, but the growing volume of the Universe mapped by surveys requires…

We present correction terms that allow delete-one Jackknife and Bootstrap methods to be used to recover unbiased estimates of the data covariance matrix of the two-point correlation function $\xi\left(\mathbf{r}\right)$. We demonstrate the…

Cosmology and Nongalactic Astrophysics · Physics 2022-06-14 Faizan G. Mohammad , Will J. Percival

This article studies the limiting behavior of a class of robust population covariance matrix estimators, originally due to Maronna in 1976, in the regime where both the number of available samples and the population size grow large. Using…

Information Theory · Computer Science 2016-11-18 Romain Couillet , Frederic Pascal , Jack W. Silverstein

We consider estimation of covariance matrices and their inverses (a.k.a. precision matrices) for high-dimensional stationary and locally stationary time series. In the latter case the covariance matrices evolve smoothly in time, thus…

Statistics Theory · Mathematics 2014-01-07 Xiaohui Chen , Mengyu Xu , Wei Biao Wu

Cosmological covariance matrices are fundamental for parameter inference, since they are responsible for propagating uncertainties from the data down to the model parameters. However, when data vectors are large, in order to estimate…

Cosmology and Nongalactic Astrophysics · Physics 2022-09-13 Natalí S. M. de Santi , L. Raul Abramo

Computing the inverse covariance matrix (or precision matrix) of large data vectors is crucial in weak lensing (and multi-probe) analyses of the large scale structure of the universe. Analytically computed covariances are noise-free and…

Instrumentation and Methods for Astrophysics · Physics 2017-12-06 Oliver Friedrich , Tim Eifler

In cosmic shear likelihood analyses the covariance is most commonly assumed to be constant in parameter space. Therefore, when calculating the covariance matrix (analytically or from simulations), its underlying cosmology should not…

Astrophysics · Physics 2015-05-13 Tim Eifler , Peter Schneider , Jan Hartlap

Model merging provides a way of cheaply combining individual models to produce a model that inherits each individual's capabilities. While some merging methods can approach the performance of multitask training, they are often heuristically…

Machine Learning · Computer Science 2026-04-03 Marawan Gamal Abdel Hameed , Derek Tam , Pascal Jr Tikeng Notsawo , Colin Raffel , Guillaume Rabusseau

We consider estimation of the covariance matrix of a multivariate random vector under the constraint that certain covariances are zero. We first present an algorithm, which we call Iterative Conditional Fitting, for computing the maximum…

Statistics Theory · Mathematics 2010-03-04 Sanjay Chaudhuri , Mathias Drton , Thomas S. Richardson

We investigate the complexity of covariance matrix estimation for Gibbs distributions based on dependent samples from a Markov chain. We show that when $\pi$ satisfies a Poincar\'e inequality and the chain possesses a spectral gap, we can…

Statistics Theory · Mathematics 2024-10-23 Yunbum Kook , Matthew S. Zhang

Accurate and precise covariance matrices will be important in enabling planned cosmological surveys to detect new physics. Standard methods imply either the need for many N-body simulations in order to obtain an accurate estimate, or a…

Cosmology and Nongalactic Astrophysics · Physics 2018-12-13 Alex Hall , Andy Taylor

Covariance matrices are essential cosmological probes of fundamental physics, providing information on numerous fundamental physical parameters and varying with any change in the underlying cosmology. However, this cosmology dependence,…

Cosmology and Nongalactic Astrophysics · Physics 2026-01-21 Theodore Steele , Robert Smith , Roisin O'Connor

We develop a method to simulate galaxy-galaxy weak lensing by utilizing all-sky, light-cone simulations and their inherent halo catalogs. Using the mock catalog to study the error covariance matrix of galaxy-galaxy weak lensing, we compare…

Cosmology and Nongalactic Astrophysics · Physics 2017-07-26 Masato Shirasaki , Masahiro Takada , Hironao Miyatake , Ryuichi Takahashi , Takashi Hamana , Takahiro Nishimichi , Ryoma Murata

To understand the universe and to interpret the cosmological parameters governing its evolution it is necessary to contrast the data from galaxy surveys with simulation. Typically it entails using computationally expensive N -body…

Cosmology and Nongalactic Astrophysics · Physics 2019-05-02 Tolga Yapici , Zachery Brown , Regina Demina , Segev BenZvi

Focusing on the well motivated aperture mass statistics $\Map$, we study the possibility of constraining cosmological parameters using future space based SNAP class weak lensing missions. Using completely analytical results we construct the…

Astrophysics · Physics 2007-05-23 Dipak Munshi , Patrick Valageas

Reliable extraction of cosmological information from clustering measurements of galaxy surveys requires estimation of the error covariance matrices of observables. The accuracy of covariance matrices is limited by our ability to generate…

Cosmology and Nongalactic Astrophysics · Physics 2017-08-29 Mohammadjavad Vakili , Francisco-Shu Kitaura , Yu Feng , Gustavo Yepes , Cheng Zhao , Chia-Hsun Chuang , ChangHoon Hahn

There is a great need for robust techniques in data mining and machine learning contexts where many standard techniques such as principal component analysis and linear discriminant analysis are inherently susceptible to outliers.…

Methodology · Statistics 2015-09-28 Garth Tarr , Samuel Müller , Neville C. Weber

The determination of the covariance matrix and its inverse, the precision matrix, is critical in the statistical analysis of cosmological measurements. The covariance matrix is typically estimated with a limited number of simulations at…

Cosmology and Nongalactic Astrophysics · Physics 2025-01-22 Marnix J. Looijmans , Mike Shengbo Wang , Florian Beutler

We consider the problem of estimating high-dimensional covariance matrices of $K$-populations or classes in the setting where the sample sizes are comparable to the data dimension. We propose estimating each class covariance matrix as a…

Methodology · Statistics 2022-02-08 Elias Raninen , David E. Tyler , Esa Ollila

Cosmological large-scale structure analyses based on two-point correlation functions often assume a Gaussian likelihood function with a fixed covariance matrix. We study the impact on cosmological parameter estimation of ignoring the…

Cosmology and Nongalactic Astrophysics · Physics 2019-03-21 Darsh Kodwani , David Alonso , Pedro Ferreira