English
Related papers

Related papers: Core Shrinkage Covariance Estimation for Matrix-va…

200 papers

Generative models, like large language models, are becoming increasingly relevant in our daily lives, yet a theoretical framework to assess their generalization behavior and uncertainty does not exist. Particularly, the problem of…

Machine Learning · Computer Science 2024-07-11 Sebastian G. Gruber , Florian Buettner

Estimation of the covariance matrix of asset returns is crucial to portfolio construction. As suggested by economic theories, the correlation structure among assets differs between emerging markets and developed countries. It is therefore…

Methodology · Statistics 2021-09-28 Xin Chen , Dan Yang , Yan Xu , Yin Xia , Dong Wang , Haipeng Shen

The accurate computation of the covariance matrix of fitted model parameters is a somewhat neglected task in Statistics. Algorithms are given for computing accurate covariance matrices derived from computing the Hessian matrix by numerical…

Computation · Statistics 2021-05-12 Rose Baker

Human mortality data sets can be expressed as multiway data arrays, the dimensions of which correspond to categories by which mortality rates are reported, such as age, sex, country and year. Regression models for such data typically assume…

Methodology · Statistics 2014-04-15 Bailey K. Fosdick , Peter D. Hoff

We develop a method for estimating well-conditioned and sparse covariance and inverse covariance matrices from a sample of vectors drawn from a sub-gaussian distribution in high dimensional setting. The proposed estimators are obtained by…

Statistics Theory · Mathematics 2016-11-21 Ashwini Maurya

We consider the problem of estimating high-dimensional covariance matrices of $K$-populations or classes in the setting where the sample sizes are comparable to the data dimension. We propose estimating each class covariance matrix as a…

Methodology · Statistics 2022-02-08 Elias Raninen , David E. Tyler , Esa Ollila

Estimation of large sparse covariance matrices is of great importance for statistical analysis, especially in the high-dimensional settings. The traditional approach such as the sample covariance matrix performs poorly due to the high…

Statistics Theory · Mathematics 2023-08-21 Xiaoning Kang , Xinwei Deng

High dimensional covariance estimation and graphical models is a contemporary topic in statistics and machine learning having widespread applications. An important line of research in this regard is to shrink the extreme spectrum of the…

Methodology · Statistics 2016-06-28 Sang-Yun Oh , Bala Rajaratnam , Joong-Ho Won

We study covariance matrix estimation for the case of partially observed random vectors, where different samples contain different subsets of vector coordinates. Each observation is the product of the variable of interest with a $0-1$…

Machine Learning · Statistics 2018-04-06 Eduardo Pavez , Antonio Ortega

Analyses of array-valued datasets often involve reduced-rank array approximations, typically obtained via least-squares or truncations of array decompositions. However, least-squares approximations tend to be noisy in high-dimensional…

Methodology · Statistics 2013-12-24 Peter David Hoff

We propose an estimation procedure for covariation in wide compositional data sets. For compositions, widely-used logratio variables are interdependent due to a common reference. Logratio uncorrelated compositions are linearly independent…

Methodology · Statistics 2023-05-05 Suzanne Jin , Cedric Notredame , Ionas Erb

Common workflows in machine learning and statistics rely on the ability to partition the information in a data set into independent portions. Recent work has shown that this may be possible even when conventional sample splitting is not…

Methodology · Statistics 2025-12-16 Ameer Dharamshi , Anna Neufeld , Lucy L. Gao , Jacob Bien , Daniela Witten

Kronecker PCA involves the use of a space vs. time Kronecker product decomposition to estimate spatio-temporal covariances. In this work the addition of a sparse correction factor is considered, which corresponds to a model of the…

Methodology · Statistics 2016-11-17 Kristjan Greenewald , Alfred Hero

We consider estimating the population covariance matrix when the number of available samples is less than the size of the observations. The sample covariance matrix (SCM) being singular, regularization is mandatory in this case. For this…

Statistics Theory · Mathematics 2025-06-16 Olivier Besson

The present paper concerns large covariance matrix estimation via composite minimization under the assumption of low rank plus sparse structure. In this approach, the low rank plus sparse decomposition of the covariance matrix is recovered…

Methodology · Statistics 2019-12-16 Matteo Farnè , Angela Montanari

Linear regression models depend directly on the design matrix and its properties. Techniques that efficiently estimate model coefficients by partitioning rows of the design matrix are increasingly popular for large-scale problems because…

Machine Learning · Statistics 2019-07-23 Michael J. Kane , Bryan Lewis , Sekhar Tatikonda , Simon Urbanek

This paper investigates regularized estimation of Kronecker-structured covariance matrices (CM) for polarization radar in sea clutter scenarios where the data are assumed to follow the complex, elliptically symmetric (CES) distributions…

Signal Processing · Electrical Eng. & Systems 2022-02-08 Lei Xie , Zishu He , Jun Tong , Tianle Liu , Jun Li , Jiangtao Xi

Covariance matrices are important tools for obtaining reliable parameter constraints. Advancements in cosmological surveys lead to larger data vectors and, consequently, increasingly complex covariance matrices, whose number of elements…

Cosmology and Nongalactic Astrophysics · Physics 2022-05-31 Tassia Ferreira , Valerio Marra

Covariance matrix estimation is an important problem in multivariate data analysis, both from theoretical as well as applied points of view. Many simple and popular covariance matrix estimators are known to be severely affected by model…

Methodology · Statistics 2025-11-21 Soumya Chakraborty , Ayanendranath Basu , Abhik Ghosh

Estimating time-varying correlation matrices is challenging because existing methods may adapt slowly to structural changes, impose insufficient regularization, or produce diffuse posterior uncertainty. In moderate dimensions, an additional…

Methodology · Statistics 2026-05-11 Daniel Andrew Coulson , David S. Matteson , Martin T. Wells