English
Related papers

Related papers: Core Shrinkage Covariance Estimation for Matrix-va…

200 papers

Repeated measurements are common in many fields, where random variables are observed repeatedly across different subjects. Such data have an underlying hierarchical structure, and it is of interest to learn covariance/correlation at…

Methodology · Statistics 2023-06-13 Sunpeng Duan , Guo Yu , Juntao Duan , Yuedong Wang

In many astrophysical settings covariance matrices of large datasets have to be determined empirically from a finite number of mock realisations. The resulting noise degrades inference and precludes it completely if there are fewer…

Instrumentation and Methods for Astrophysics · Physics 2017-01-11 Benjamin Joachimi

This paper deals with the problem of estimating the covariance matrix of a series of independent multivariate observations, in the case where the dimension of each observation is of the same order as the number of observations. Although…

Information Theory · Computer Science 2015-06-03 Jianfeng Yao , Abla Kammoun , Jamal Najim

When shrinking a covariance matrix towards (a multiple) of the identity matrix, the trace of the covariance matrix arises naturally as the optimal scaling factor for the identity target. The trace also appears in other context, for example…

Methodology · Statistics 2020-09-01 Ansgar Steland

We present a framework for deciding whether a quantum state is separable or entangled using covariance matrices of locally measurable observables. This leads to the covariance matrix criterion as a general separability criterion. We…

Quantum Physics · Physics 2008-12-03 Oleg Gittsovich , Otfried Gühne , Philipp Hyllus , Jens Eisert

We propose an adjusted likelihood ratio test of two-factor separability (Kronecker product structure) for unbalanced multivariate repeated measures data. Here we address the particular case where the within subject correlation is believed…

Methodology · Statistics 2011-02-02 Sean L. Simpson

We seek to improve estimates of the power spectrum covariance matrix from a limited number of simulations by employing a novel statistical technique known as shrinkage estimation. The shrinkage technique optimally combines an empirical…

Astrophysics · Physics 2009-11-13 Adrian C. Pope , István Szapudi

Sparse covariance matrices play crucial roles by encoding the interdependencies between variables in numerous fields such as genetics and neuroscience. Despite substantial studies on sparse covariance matrices, existing methods face several…

Methodology · Statistics 2026-03-03 Rakheon Kim , Irina Gaynanova

Estimation of covariance matrices or their inverses plays a central role in many statistical methods. For these methods to work reliably, estimated matrices must not only be invertible but also well-conditioned. In this paper we present an…

Methodology · Statistics 2014-08-06 Eric C. Chi , Kenneth Lange

While a set of covariance matrices corresponding to different populations are unlikely to be exactly equal they can still exhibit a high degree of similarity. For example, some pairs of variables may be positively correlated across most…

Methodology · Statistics 2008-04-02 Peter Hoff

Many popular statistical models for complex phenomena are intractable, in the sense that the likelihood function cannot easily be evaluated. Bayesian estimation in this setting remains challenging, with a lack of computational methodology…

Computation · Statistics 2015-03-31 Nial Friel , Antonietta Mira , Chris. J. Oates

Estimating a covariance matrix is an important task in applications where the number of variables is larger than the number of observations. Shrinkage approaches for estimating a high-dimensional covariance matrix are often employed to…

Methodology · Statistics 2015-06-18 Anestis Touloumis

This paper introduces a subspace method for the estimation of an array covariance matrix. It is shown that when the received signals are uncorrelated, the true array covariance matrices lie in a specific subspace whose dimension is…

Numerical Analysis · Computer Science 2014-11-04 Mostafa Rahmani , George Atia

We develop a higher order generalization of the LQ decomposition and show that this decomposition plays an important role in likelihood-based estimation and testing for separable, or Kronecker structured, covariance models, such as the…

Statistics Theory · Mathematics 2018-06-20 David C. Gerard , Peter D. Hoff

Statistical inference of the dependence between objects often relies on covariance matrices. Unless the number of features (e.g. data points) is much larger than the number of objects, covariance matrix cleaning is necessary to reduce…

Risk Management · Quantitative Finance 2021-06-09 Christian Bongiorno , Damien Challet

We consider estimation of the covariance matrix of a multivariate random vector under the constraint that certain covariances are zero. We first present an algorithm, which we call Iterative Conditional Fitting, for computing the maximum…

Statistics Theory · Mathematics 2010-03-04 Sanjay Chaudhuri , Mathias Drton , Thomas S. Richardson

Covariance matrix estimation is a fundamental statistical task in many applications, but the sample covariance matrix is sub-optimal when the sample size is comparable to or less than the number of features. Such high-dimensional settings…

Methodology · Statistics 2022-06-06 Huiqin Xin , Sihai Dave Zhao

Based on a generalized cosine measure between two symmetric matrices, we propose a general framework for one-sample and two-sample tests of covariance and correlation matrices. We also develop a set of associated permutation algorithms for…

Methodology · Statistics 2018-12-05 Longyang Wu , Chengguo Weng , Xu Wang , Kesheng Wang , Xuefeng Liu

In some multivariate problems with missing data, pairs of variables exist that are never observed together. For example, some modern biological tools can produce data of this form. As a result of this structure, the covariance matrix is…

Methodology · Statistics 2013-08-13 Max Grazier G'Sell , Shai S. Shen-Orr , Robert Tibshirani

Low-rank matrix approximations are often used to help scale standard machine learning algorithms to large-scale problems. Recently, matrix coherence has been used to characterize the ability to extract global information from a subset of…

Machine Learning · Statistics 2010-09-07 Mehryar Mohri , Ameet Talwalkar