English
Related papers

Related papers: Precision matrix expansion - efficient use of nume…

200 papers

(Abridged) We investigate and quantify the impact of finite simulation volume on weak lensing two- and four-point statistics. These {\it finite support} (FS) effects are modelled for several estimators, simulation box sizes and source…

Cosmology and Nongalactic Astrophysics · Physics 2015-05-27 Joachim Harnois-Deraps , Ludovic van Waerbeke

In this work we construct an optimal shrinkage estimator for the precision matrix in high dimensions. We consider the general asymptotics when the number of variables $p\rightarrow\infty$ and the sample size $n\rightarrow\infty$ so that…

Statistics Theory · Mathematics 2023-04-19 Taras Bodnar , Arjun K. Gupta , Nestor Parolya

An accurate covariance matrix is essential for obtaining reliable cosmological results when using a Gaussian likelihood. In this paper we study the covariance of pseudo-$C_\ell$ estimates of tomographic cosmic shear power spectra. Using two…

We propose a nonconvex estimator for joint multivariate regression and precision matrix estimation in the high dimensional regime, under sparsity constraints. A gradient descent algorithm with hard thresholding is developed to solve the…

Machine Learning · Statistics 2016-06-03 Jinghui Chen , Quanquan Gu

In this paper, we present several estimators of the diagonal elements of the inverse of the covariance matrix, called precision matrix, of a sample of iid random vectors. The focus is on high dimensional vectors having a sparse precision…

Statistics Theory · Mathematics 2017-07-31 Samuel Balmand , Arnak S. Dalalyan

The power spectrum of density fluctuations is a foundational source of cosmological information. Precision cosmological probes targeted primarily at investigations of dark energy require accurate theoretical determinations of the power…

Cosmology and Nongalactic Astrophysics · Physics 2010-08-26 Katrin Heitmann , David Higdon , Martin White , Salman Habib , Brian J. Williams , Christian Wagner

Estimation of covariance matrices or their inverses plays a central role in many statistical methods. For these methods to work reliably, estimated matrices must not only be invertible but also well-conditioned. In this paper we present an…

Methodology · Statistics 2014-08-06 Eric C. Chi , Kenneth Lange

Covariance matrix estimation is a persistent challenge for cosmology. We focus on a class of model covariance matrices that can be generated with high accuracy and precision, using a tiny fraction of the computational resources that would…

Cosmology and Nongalactic Astrophysics · Physics 2019-05-29 Ross O'Connell , Daniel J. Eisenstein

Accurately estimating the statistical properties of noise is important in data analysis for space-based gravitational wave detectors. Noise in different time-delay interferometry channels correlates with each other. Many studies often…

Instrumentation and Methods for Astrophysics · Physics 2025-06-18 Ya-Nan Li , Yi-Ming Hu , En-Kun Li

The accurate computation of the covariance matrix of fitted model parameters is a somewhat neglected task in Statistics. Algorithms are given for computing accurate covariance matrices derived from computing the Hessian matrix by numerical…

Computation · Statistics 2021-05-12 Rose Baker

The dependency structure of multivariate data can be analyzed using the covariance matrix $\Sigma$. In many fields the precision matrix $\Sigma^{-1}$ is even more informative. As the sample covariance estimator is singular in…

Methodology · Statistics 2015-06-04 Viktoria Öllerer , Christophe Croux

Estimating covariance matrices with high-dimensional complex data presents significant challenges, particularly concerning positive definiteness, sparsity, and numerical stability. Existing robust sparse estimators often fail to guarantee…

Methodology · Statistics 2025-12-30 Shaoxin Wang , Ziyun Ma

Constraining cosmology using weak gravitational lensing consists of comparing a measured feature vector of dimension $N_b$ with its simulated counterpart. An accurate estimate of the $N_b\times N_b$ feature covariance matrix $\mathbf{C}$ is…

Cosmology and Nongalactic Astrophysics · Physics 2016-03-28 Andrea Petri , Zoltán Haiman , Morgan May

Studying the impact of systematic effects, optimizing survey strategies, assessing tensions between different probes and exploring synergies of different data sets require a large number of simulated likelihood analyses, each of which cost…

Cosmology and Nongalactic Astrophysics · Physics 2022-12-07 Supranta S. Boruah , Tim Eifler , Vivian Miranda , Sai Krishanth P. M

In recent years forecasting activities have become a very important tool for designing and optimising large scale structure surveys. To predict the performance of such surveys, the Fisher matrix formalism is frequently used as a fast and…

Cosmology and Nongalactic Astrophysics · Physics 2021-05-12 S. Yahia-Cherif , A. Blanchard , S. Camera , S. Ilić , K. Markovič , A. Pourtsidou , Z. Sakr , D. Sapone , I. Tutusaus

One of the primary sources of uncertainties in modeling the cosmic-shear power spectrum on small scales is the effect of baryonic physics. Accurate cosmology for Stage-IV surveys requires knowledge of the matter power spectrum deep in the…

Cosmology and Nongalactic Astrophysics · Physics 2021-09-15 Maria G. Moreira , Felipe Andrade-Oliveira , Xiao Fang , Hung-Jin Huang , Elisabeth Krause , Vivian Miranda , Rogerio Rosenfeld , Marko Simonović

We describe an efficient algorithm for calculating the statistics of weak lensing by large-scale structure based on a tiled set of independent particle-mesh N-body simulations which telescope in resolution along the line of sight. This…

Astrophysics · Physics 2008-11-26 Martin White , Wayne Hu

We describe an approximate statistical model for the sample variance distribution of the non-linear matter power spectrum that can be calibrated from limited numbers of simulations. Our model retains the common assumption of a multivariate…

The complexity and accuracy of current and future precision cosmology observational campaigns has made it essential to develop an efficient technique for directly combining simulation and observational datasets to determine cosmological and…

Astrophysics · Physics 2009-11-11 Katrin Heitmann , David Higdon , Charles Nakhleh , Salman Habib

Future galaxy surveys will provide accurate measurements of the matter power spectrum across an unprecedented range of scales and redshifts. The analysis of these data will require one to accurately model the imprint of non-linearities of…

Cosmology and Nongalactic Astrophysics · Physics 2020-11-11 Linda Blot , Pier-Stefano Corasaniti , Yann Rasera , Shankar Agarwal