English
Related papers

Related papers: Precision matrix expansion - efficient use of nume…

200 papers

In the field of statistical learning and data analysis, estimating precision matrices (i.e., the inverse of covariance matrices) is a critical task, particularly for understanding dependency structures among variables. However, traditional…

Methodology · Statistics 2026-05-15 Zhongfeng Qin , Hao Xu , Wenhao Cui , Wan Tian

Relying on recent advances in statistical estimation of covariance distances based on random matrix theory, this article proposes an improved covariance and precision matrix estimation for a wide family of metrics. The method is shown to…

Machine Learning · Statistics 2021-02-03 Malik Tiomoko , Florent Bouchard , Guillaume Ginholac , Romain Couillet

Empirical estimates of the band power covariance matrix are commonly used in cosmic microwave background (CMB) power spectrum analyses. While this approach easily captures correlations in the data, noise in the resulting covariance estimate…

Cosmology and Nongalactic Astrophysics · Physics 2022-03-14 L. Balkenhol , C. L. Reichardt

Next-generation optical imaging surveys will revolutionise the observations of weak gravitational lensing by galaxy clusters and provide stringent constraints on growth of structure and cosmic acceleration. In these experiments, accurate…

Cosmology and Nongalactic Astrophysics · Physics 2019-10-17 Hao-Yi Wu , David H. Weinberg , Andrés N. Salcedo , Benjamin D. Wibking , Ying Zu

Creating accurate and low-noise covariance matrices represents a formidable challenge in modern-day cosmology. We present a formalism to compress arbitrary observables into a small number of bins by projection into a model-specific subspace…

Cosmology and Nongalactic Astrophysics · Physics 2021-02-10 Oliver H. E. Philcox , Mikhail M. Ivanov , Matias Zaldarriaga , Marko Simonovic , Marcel Schmittfull

Using 1000 ray-tracing simulations for a {\Lambda}-dominated cold dark model in Sato et al. (2009), we study the covariance matrix of cosmic shear correlation functions, which is the standard statistics used in the previous measurements.…

Cosmology and Nongalactic Astrophysics · Physics 2015-05-19 Masanori Sato , Masahiro Takada , Takashi Hamana , Takahiko Matsubara

A precision matrix is the inverse of a covariance matrix. In this paper, we study the problem of estimating the precision matrix with a known graphical structure under high-dimensional settings. We propose a simple estimator of the…

Statistics Theory · Mathematics 2021-07-15 Thien-Minh Le , Ping-Shou Zhong

Focusing on the well motivated aperture mass statistics $\Map$, we study the possibility of constraining cosmological parameters using future space based SNAP class weak lensing missions. Using completely analytical results we construct the…

Astrophysics · Physics 2007-05-23 Dipak Munshi , Patrick Valageas

We use analytic covariance matrices to carry out a full-shape analysis of the galaxy power spectrum multipoles from the Baryon Oscillation Spectroscopic Survey (BOSS). We obtain parameter estimates that agree well with those based on the…

Cosmology and Nongalactic Astrophysics · Physics 2020-12-29 Digvijay Wadekar , Mikhail M. Ivanov , Roman Scoccimarro

There is a great need for robust techniques in data mining and machine learning contexts where many standard techniques such as principal component analysis and linear discriminant analysis are inherently susceptible to outliers.…

Methodology · Statistics 2015-09-28 Garth Tarr , Samuel Müller , Neville C. Weber

The upcoming generation of galaxy surveys will probe the distribution of matter in the universe with unprecedented accuracy. Measurements of the matter power spectrum at different scales and redshifts will provide stringent constraints on…

Cosmology and Nongalactic Astrophysics · Physics 2014-11-25 Linda Blot , Pier Stefano Corasaniti , Jean-Michel Alimi , Vincent Reverdy , Yann Rasera

Super sample covariance (SSC) is important when estimating covariance matrices using a set of mock catalogues for galaxy surveys. If the underlying cosmological simulations do not include the variation in background parameters appropriate…

Cosmology and Nongalactic Astrophysics · Physics 2025-03-05 Greg Schreiner , Alex Krolewski , Shahab Joudaki , Will J. Percival

We present an algorithm for quickly generating multiple realizations of N-body simulations to be used, for example, for cosmological parameter estimation from surveys of large-scale structure. Our algorithm uses a new method to resample the…

Cosmology and Nongalactic Astrophysics · Physics 2015-05-27 Michael D. Schneider , Shaun Cole , Carlos S. Frenk , Istvan Szapudi

Estimation of a precision matrix (i.e., inverse covariance matrix) is widely used to exploit conditional independence among continuous variables. The influence of abnormal observations is exacerbated in a high dimensional setting as the…

Methodology · Statistics 2021-05-17 Peng Tang , Huijing Jiang , Heeyoung Kim , Xinwei Deng

Data re-sampling methods such as the delete-one jackknife are a common tool for estimating the covariance of large scale structure probes. In this paper we investigate the concepts of internal covariance estimation in the context of cosmic…

Cosmology and Nongalactic Astrophysics · Physics 2017-01-10 O. Friedrich , S. Seitz , T. F. Eifler , D. Gruen

The statistical properties of estimator using covariance matrix for the account of point-to-point correlations due to systematic errors are analyzed. It is shown that the covariance matrix estimator (CME) is consistent for the realistic…

High Energy Physics - Experiment · Physics 2007-05-23 Alekhin Sergey

Cosmological parameter inference from galaxy clustering relies critically on accurate estimates of the covariance and precision matrices. These are often obtained from a limited number of mock catalogs, introducing noise and bias in the…

Cosmology and Nongalactic Astrophysics · Physics 2026-04-16 Antonio Farina , Massimo Guidi , Alfonso Veropalumbo , Claudio Guida

Several cosmological measurements have attained significant levels of maturity and accuracy over the last decade. Continuing this trend, future observations promise measurements of the statistics of the cosmic mass distribution at an…

Astrophysics · Physics 2008-11-26 Salman Habib , Katrin Heitmann , David Higdon , Charles Nakhleh , Brian Williams

We address the problem of robust sparse estimation of the precision matrix for heavy-tailed distributions in high-dimensional settings. In such high-dimensional contexts, we observe that the covariance matrix can be approximated by a…

Methodology · Statistics 2025-03-06 Zhengke Lu , Long Feng

We present a comparison between various algorithms of inference of covariance and precision matrices in small datasets of real vectors, of the typical length and dimension of human brain activity time series retrieved by functional Magnetic…

Statistical Mechanics · Physics 2023-02-07 Miguel Ibáñez-Berganza , Carlo Lucibello , Francesca Santucci , Tommaso Gili , Andrea Gabrielli