中文
相关论文

相关论文: Large Covariance Matrices: Accurate Models Without…

200 篇论文

Let $X_1,..., X_n \in \mathbb{R}^d$ be independent Gaussian random vectors with independent entries and variance profile $(b_{ij})_{i \in [d],j \in [n]}$. A major question in the study of covariance estimation is to give precise control on…

统计理论 · 数学 2023-07-19 Patrick Oliveira Santos

Computing eigenvalues of very large matrices is a critical task in many machine learning applications, including the evaluation of log-determinants, the trace of matrix functions, and other important metrics. As datasets continue to grow in…

机器学习 · 统计学 2025-06-16 Siavash Ameli , Chris van der Heide , Liam Hodgkinson , Michael W. Mahoney

Large datasets are often affected by cell-wise outliers in the form of missing or erroneous data. However, discarding any samples containing outliers may result in a dataset that is too small to accurately estimate the covariance matrix.…

统计理论 · 数学 2023-11-13 Karim Lounici , Grégoire Pacreau

We provide computationally attractive methods to obtain jackknife-based cluster-robust variance matrix estimators (CRVEs) for linear regression models estimated by least squares. We also propose several new variants of the wild cluster…

计量经济学 · 经济学 2023-02-14 James G. MacKinnon , Morten Ørregaard Nielsen , Matthew D. Webb

We use analytic covariance matrices to carry out a full-shape analysis of the galaxy power spectrum multipoles from the Baryon Oscillation Spectroscopic Survey (BOSS). We obtain parameter estimates that agree well with those based on the…

宇宙学与河外天体物理 · 物理学 2020-12-29 Digvijay Wadekar , Mikhail M. Ivanov , Roman Scoccimarro

High dimensionality comparable to sample size is common in many statistical problems. We examine covariance matrix estimation in the asymptotic framework that the dimensionality $p$ tends to $\infty$ as the sample size $n$ increases.…

统计理论 · 数学 2007-06-13 Jianqing Fan , Yingying Fan , Jinchi Lv

In dealing with high-dimensional data sets, factor models are often useful for dimension reduction. The estimation of factor models has been actively studied in various fields. In the first part of this paper, we present a new approach to…

统计金融 · 定量金融 2017-11-27 Joongyeub Yeo , George Papanicolaou

The likelihood function for cosmological parameters, given by e.g. weak lensing shear measurements, depends on contributions to the covariance induced by the nonlinear evolution of the cosmic web. As nonlinear clustering to date has only…

宇宙学与河外天体物理 · 物理学 2019-02-26 Robert Reischke , Alina Kiessling , Björn Malte Schäfer

Upcoming and existing large-scale surveys of galaxies require accurate theoretical predictions of the dark matter clustering statistics for thousands of mock galaxy catalogs. We demonstrate that this goal can be achieve with our new…

宇宙学与河外天体物理 · 物理学 2018-06-13 Anatoly Klypin , Francisco Prada

We propose a determinant-free approach for simulation-based Bayesian inference in high-dimensional Gaussian models. We introduce auxiliary variables with covariance equal to the inverse covariance of the model. The joint probability of the…

统计计算 · 统计学 2017-09-12 Louis Ellam , Heiko Strathmann , Mark Girolami , Iain Murray

We study how sampling geometry contributes to uncertainty in modeling spatial geophysical observations as sampled random fields characterized by stationary, isotropic, parametric covariance functions. We incorporate the signature of…

统计方法学 · 统计学 2026-04-03 Olivia L. Walbert , Frederik J. Simons , Arthur P. Guillaumin , Sofia C. Olhede

Statistical inference of the dependence between objects often relies on covariance matrices. Unless the number of features (e.g. data points) is much larger than the number of objects, covariance matrix cleaning is necessary to reduce…

风险管理 · 定量金融 2021-06-09 Christian Bongiorno , Damien Challet

Compositional data arise in many areas of research in the natural and biomedical sciences. One prominent example is in the study of the human gut microbiome, where one can measure the relative abundance of many distinct microorganisms in a…

统计方法学 · 统计学 2024-04-26 Aaron J. Molstad , Karl Oskar Ekvall , Piotr M. Suder

In the field of statistical learning and data analysis, estimating precision matrices (i.e., the inverse of covariance matrices) is a critical task, particularly for understanding dependency structures among variables. However, traditional…

统计方法学 · 统计学 2026-05-15 Zhongfeng Qin , Hao Xu , Wenhao Cui , Wan Tian

Estimation of a precision matrix (i.e., inverse covariance matrix) is widely used to exploit conditional independence among continuous variables. The influence of abnormal observations is exacerbated in a high dimensional setting as the…

统计方法学 · 统计学 2021-05-17 Peng Tang , Huijing Jiang , Heeyoung Kim , Xinwei Deng

Estimating the eigenvalues of a population covariance matrix from a sample covariance matrix is a problem of fundamental importance in multivariate statistics; the eigenvalues of covariance matrices play a key role in many widely…

统计理论 · 数学 2007-06-13 Noureddine El Karoui

Complex scientific models where the likelihood cannot be evaluated present a challenge for statistical inference. Over the past two decades, a wide range of algorithms have been proposed for learning parameters in computationally feasible…

统计计算 · 统计学 2021-12-16 Aden Forrow , Ruth E. Baker

Multivariate time series present many challenges, especially when they are high dimensional. The paper's focus is twofold. First, we address the subject of consistently estimating the autocovariance sequence; this is a sequence of matrices…

统计理论 · 数学 2015-06-03 Carsten Jentsch , Dimitris N. Politis

Several cosmological measurements have attained significant levels of maturity and accuracy over the last decade. Continuing this trend, future observations promise measurements of the statistics of the cosmic mass distribution at an…

天体物理学 · 物理学 2008-11-26 Salman Habib , Katrin Heitmann , David Higdon , Charles Nakhleh , Brian Williams

Accurate estimation of the covariance matrix of cosmic shear statistics is essential for cosmological analyses using current and upcoming wide-area weak lensing surveys. In this work, we investigate analytical methods for computing the…

宇宙学与河外天体物理 · 物理学 2026-05-18 Kosuke Nagura , Ryo Terasawa , Taisei Terawaki , Masahiro Takada