English
Related papers

Related papers: Large Covariance Matrices: Accurate Models Without…

200 papers

Let $X_1,..., X_n \in \mathbb{R}^d$ be independent Gaussian random vectors with independent entries and variance profile $(b_{ij})_{i \in [d],j \in [n]}$. A major question in the study of covariance estimation is to give precise control on…

Statistics Theory · Mathematics 2023-07-19 Patrick Oliveira Santos

Computing eigenvalues of very large matrices is a critical task in many machine learning applications, including the evaluation of log-determinants, the trace of matrix functions, and other important metrics. As datasets continue to grow in…

Machine Learning · Statistics 2025-06-16 Siavash Ameli , Chris van der Heide , Liam Hodgkinson , Michael W. Mahoney

Large datasets are often affected by cell-wise outliers in the form of missing or erroneous data. However, discarding any samples containing outliers may result in a dataset that is too small to accurately estimate the covariance matrix.…

Statistics Theory · Mathematics 2023-11-13 Karim Lounici , Grégoire Pacreau

We provide computationally attractive methods to obtain jackknife-based cluster-robust variance matrix estimators (CRVEs) for linear regression models estimated by least squares. We also propose several new variants of the wild cluster…

Econometrics · Economics 2023-02-14 James G. MacKinnon , Morten Ørregaard Nielsen , Matthew D. Webb

We use analytic covariance matrices to carry out a full-shape analysis of the galaxy power spectrum multipoles from the Baryon Oscillation Spectroscopic Survey (BOSS). We obtain parameter estimates that agree well with those based on the…

Cosmology and Nongalactic Astrophysics · Physics 2020-12-29 Digvijay Wadekar , Mikhail M. Ivanov , Roman Scoccimarro

High dimensionality comparable to sample size is common in many statistical problems. We examine covariance matrix estimation in the asymptotic framework that the dimensionality $p$ tends to $\infty$ as the sample size $n$ increases.…

Statistics Theory · Mathematics 2007-06-13 Jianqing Fan , Yingying Fan , Jinchi Lv

In dealing with high-dimensional data sets, factor models are often useful for dimension reduction. The estimation of factor models has been actively studied in various fields. In the first part of this paper, we present a new approach to…

Statistical Finance · Quantitative Finance 2017-11-27 Joongyeub Yeo , George Papanicolaou

The likelihood function for cosmological parameters, given by e.g. weak lensing shear measurements, depends on contributions to the covariance induced by the nonlinear evolution of the cosmic web. As nonlinear clustering to date has only…

Cosmology and Nongalactic Astrophysics · Physics 2019-02-26 Robert Reischke , Alina Kiessling , Björn Malte Schäfer

Upcoming and existing large-scale surveys of galaxies require accurate theoretical predictions of the dark matter clustering statistics for thousands of mock galaxy catalogs. We demonstrate that this goal can be achieve with our new…

Cosmology and Nongalactic Astrophysics · Physics 2018-06-13 Anatoly Klypin , Francisco Prada

We propose a determinant-free approach for simulation-based Bayesian inference in high-dimensional Gaussian models. We introduce auxiliary variables with covariance equal to the inverse covariance of the model. The joint probability of the…

Computation · Statistics 2017-09-12 Louis Ellam , Heiko Strathmann , Mark Girolami , Iain Murray

We study how sampling geometry contributes to uncertainty in modeling spatial geophysical observations as sampled random fields characterized by stationary, isotropic, parametric covariance functions. We incorporate the signature of…

Methodology · Statistics 2026-04-03 Olivia L. Walbert , Frederik J. Simons , Arthur P. Guillaumin , Sofia C. Olhede

Statistical inference of the dependence between objects often relies on covariance matrices. Unless the number of features (e.g. data points) is much larger than the number of objects, covariance matrix cleaning is necessary to reduce…

Risk Management · Quantitative Finance 2021-06-09 Christian Bongiorno , Damien Challet

Compositional data arise in many areas of research in the natural and biomedical sciences. One prominent example is in the study of the human gut microbiome, where one can measure the relative abundance of many distinct microorganisms in a…

Methodology · Statistics 2024-04-26 Aaron J. Molstad , Karl Oskar Ekvall , Piotr M. Suder

In the field of statistical learning and data analysis, estimating precision matrices (i.e., the inverse of covariance matrices) is a critical task, particularly for understanding dependency structures among variables. However, traditional…

Methodology · Statistics 2026-05-15 Zhongfeng Qin , Hao Xu , Wenhao Cui , Wan Tian

Estimation of a precision matrix (i.e., inverse covariance matrix) is widely used to exploit conditional independence among continuous variables. The influence of abnormal observations is exacerbated in a high dimensional setting as the…

Methodology · Statistics 2021-05-17 Peng Tang , Huijing Jiang , Heeyoung Kim , Xinwei Deng

Estimating the eigenvalues of a population covariance matrix from a sample covariance matrix is a problem of fundamental importance in multivariate statistics; the eigenvalues of covariance matrices play a key role in many widely…

Statistics Theory · Mathematics 2007-06-13 Noureddine El Karoui

Complex scientific models where the likelihood cannot be evaluated present a challenge for statistical inference. Over the past two decades, a wide range of algorithms have been proposed for learning parameters in computationally feasible…

Computation · Statistics 2021-12-16 Aden Forrow , Ruth E. Baker

Multivariate time series present many challenges, especially when they are high dimensional. The paper's focus is twofold. First, we address the subject of consistently estimating the autocovariance sequence; this is a sequence of matrices…

Statistics Theory · Mathematics 2015-06-03 Carsten Jentsch , Dimitris N. Politis

Several cosmological measurements have attained significant levels of maturity and accuracy over the last decade. Continuing this trend, future observations promise measurements of the statistics of the cosmic mass distribution at an…

Astrophysics · Physics 2008-11-26 Salman Habib , Katrin Heitmann , David Higdon , Charles Nakhleh , Brian Williams

Accurate estimation of the covariance matrix of cosmic shear statistics is essential for cosmological analyses using current and upcoming wide-area weak lensing surveys. In this work, we investigate analytical methods for computing the…

Cosmology and Nongalactic Astrophysics · Physics 2026-05-18 Kosuke Nagura , Ryo Terasawa , Taisei Terawaki , Masahiro Takada