English
Related papers

Related papers: Core Shrinkage Covariance Estimation for Matrix-va…

200 papers

Nonsingular estimation of high dimensional covariance matrices is an important step in many statistical procedures like classification, clustering, variable selection an future extraction. After a review of the essential background…

Statistics Theory · Mathematics 2015-03-19 Deniz Akdemir

This paper revisits the problem of decomposing a positive semidefinite matrix as a sum of a matrix with a given rank plus a sparse matrix. An immediate application can be found in portfolio optimization, when the matrix to be decomposed is…

Optimization and Control · Mathematics 2021-06-16 Michel Baes , Calypso Herrera , Ariel Neufeld , Pierre Ruyssen

Sparse principal component analysis (sparse PCA) is a widely used technique for dimensionality reduction in multivariate analysis, addressing two key limitations of standard PCA. First, sparse PCA can be implemented in high-dimensional low…

Methodology · Statistics 2025-10-07 Jan O. Bauer

Shrunk sample covariance matrix is a factor model of a special form combining some (typically, style) risk factor(s) and principal components with a (block-)diagonal factor covariance matrix. As such, shrinkage, which essentially inherits…

Portfolio Management · Quantitative Finance 2016-08-02 Zura Kakushadze

This paper investigates the cross-correlations across multiple climate model errors. We build a Bayesian hierarchical model that accounts for the spatial dependence of individual models as well as cross-covariances across different climate…

Applications · Statistics 2012-03-02 Huiyan Sang , Mikyoung Jun , Jianhua Z. Huang

Estimating a covariance matrix is central to high-dimensional data analysis. Empirical analyses of high-dimensional biomedical data, including genomics, proteomics, microbiome, and neuroimaging, among others, consistently reveal strong…

Methodology · Statistics 2024-12-05 Yifan Yang , Chixiang Chen , Shuo Chen

In many practical situations we would like to estimate the covariance matrix of a set of variables from an insufficient amount of data. More specifically, if we have a set of $N$ independent, identically distributed measurements of an $M$…

Probability · Mathematics 2010-10-05 Thomas L. Marzetta , Gabriel H. Tucci , Steven H. Simon

In this work we present full Bayesian inference for a new flexible nonseparable class of cross-covariance functions for multivariate spatial data. A Bayesian test is proposed for separability of covariance functions which is much more…

Methodology · Statistics 2017-07-24 Rafael S. Erbisti , Thais C. O. Fonseca , Mariane B. Alves

Many statistical applications require an estimate of a covariance matrix and/or its inverse. When the matrix dimension is large compared to the sample size, which happens frequently, the sample covariance matrix is known to perform poorly…

Statistics Theory · Mathematics 2012-07-24 Olivier Ledoit , Michael Wolf

We present a method for estimating sparse high-dimensional inverse covariance and partial correlation matrices, which exploits the connection between the inverse covariance matrix and linear regression. The method is a two-stage estimation…

Machine Learning · Statistics 2025-05-13 Samuel Erickson , Tobias Rydén

Statistical inference for sparse covariance matrices is crucial to reveal dependence structure of large multivariate data sets, but lacks scalable and theoretically supported Bayesian methods. In this paper, we propose beta-mixture…

Statistics Theory · Mathematics 2021-01-13 Kyoungjae Lee , Seongil Jo , Jaeyong Lee

Covariance matrix estimation is one of the most important problems in statistics. To accommodate the complexity of modern datasets, it is desired to have estimation procedures that not only can incorporate the structural assumptions of…

Statistics Theory · Mathematics 2017-06-13 Mengjie Chen , Chao Gao , Zhao Ren

Many inference techniques for multivariate data analysis assume that the rows of the data matrix are realizations of independent and identically distributed random vectors. Such an assumption will be met, for example, if the rows of the…

Statistics Theory · Mathematics 2015-12-31 Peter D. Hoff

The state-of-the-art methods for estimating high-dimensional covariance matrices all shrink the eigenvalues of the sample covariance matrix towards a data-insensitive shrinkage target. The underlying shrinkage transformation is either…

Machine Learning · Statistics 2025-11-25 Man-Chung Yue , Yves Rychener , Daniel Kuhn , Viet Anh Nguyen

In this paper we propose a perturbative method for the reconstruction of the covariance matrix of a multinormal distribution, under the assumption that the only available information amounts to the covariance matrix of a spherically…

Statistics Theory · Mathematics 2019-07-19 Filippo Palombi , Simona Toti

We present a data analysis pipeline for CMB polarization experiments, running from multi-frequency maps to the power spectra. We focus mainly on component separation and, for the first time, we work out the covariance matrix accounting for…

Cosmology and Nongalactic Astrophysics · Physics 2010-06-14 S. Ricciardi , A. Bonaldi , P. Natoli , G. Polenta , C. Baccigalupi , E. Salerno , K. Kayabol , L. Bedini , G. De Zotti

Estimating covariance matrices is a problem of fundamental importance in multivariate statistics. In practice it is increasingly frequent to work with data matrices $X$ of dimension $n\times p$, where $p$ and $n$ are both large. Results…

Statistics Theory · Mathematics 2009-01-22 Noureddine El Karoui

The statistical properties of estimator using covariance matrix for the account of point-to-point correlations due to systematic errors are analyzed. It is shown that the covariance matrix estimator (CME) is consistent for the realistic…

High Energy Physics - Experiment · Physics 2007-05-23 Alekhin Sergey

Reduced-rank regression recognises the possibility of a rank-deficient matrix of coefficients. We propose a novel Bayesian model for estimating the rank of the coefficient matrix, which obviates the need for post-processing steps and allows…

Methodology · Statistics 2024-02-14 Maria F. Pintado , Matteo Iacopini , Luca Rossini , Alexander Y. Shestopaloff

Motivated by graphical models, we consider the "Sparse Plus Low-rank" decomposition of a positive definite concentration matrix -- the inverse of the covariance matrix. This is a classical problem for which a rich theory and numerical…

Optimization and Control · Mathematics 2019-01-31 Valentina Ciccone , Augusto Ferrante , Mattia Zorzi