English
Related papers

Related papers: New challenges in covariance estimation: multiple …

200 papers

Covariance matrices are important tools for obtaining reliable parameter constraints. Advancements in cosmological surveys lead to larger data vectors and, consequently, increasingly complex covariance matrices, whose number of elements…

Cosmology and Nongalactic Astrophysics · Physics 2022-05-31 Tassia Ferreira , Valerio Marra

In many contexts it is extremely costly to perform enough high quality experimental measurements to accurately parameterize a predictive quantitative model. However, it is often much easier to carry out large numbers of experiments that…

Data Analysis, Statistics and Probability · Physics 2017-11-22 Alpha A. Lee , Michael P. Brenner , Lucy J. Colwell

Current and forthcoming cosmological data analyses share the challenge of huge datasets alongside increasingly tight requirements on the precision and accuracy of extracted cosmological parameters. The community is becoming increasingly…

Instrumentation and Methods for Astrophysics · Physics 2014-12-17 Benjamin Joachimi , Andy Taylor

Covariance matrices provide a valuable source of information about complex interactions and dependencies within the data. However, from a clustering perspective, this information has often been underutilized and overlooked. Indeed, commonly…

Methodology · Statistics 2024-09-02 Andrea Cappozzo , Alessandro Casa

Estimation of the covariance matrix of asset returns is crucial to portfolio construction. As suggested by economic theories, the correlation structure among assets differs between emerging markets and developed countries. It is therefore…

Methodology · Statistics 2021-09-28 Xin Chen , Dan Yang , Yan Xu , Yin Xia , Dong Wang , Haipeng Shen

Estimation of covariance matrices is a fundamental problem in multivariate statistics. Recently, growing efforts have focused on incorporating covariate effects into these matrices, facilitating subject-specific estimation. Despite these…

Methodology · Statistics 2026-04-10 Rakheon Kim , Emma Jingfei Zhang

This survey contains a selection of topics unified by the concept of positive semi-definiteness (of matrices or kernels), reflecting natural constraints imposed on discrete data (graphs or networks) or continuous objects (probability or…

Classical Analysis and ODEs · Mathematics 2019-11-13 Alexander Belton , Dominique Guillot , Apoorva Khare , Mihai Putinar

The covariance matrix of measurements of Markov random fields (processes) has useful properties that allow to develop effective computational algorithms for many problems in the study of Markov fields on the basis of field observations…

Information Theory · Computer Science 2018-04-04 Ulan N. Brimkulov , Chinara Jumabaeva , Kasym Baryktabasov

We consider the problem of estimating the principal components of a population correlation matrix from a limited number of measurement data. Using a combination of random matrix and information-theoretic tools, we show that all the…

Statistical Mechanics · Physics 2016-01-20 Rémi Monasson , Dario Villamaina

Due to the availability of large molecular data-sets, covariance models are increasingly used to describe the structure of genetic variation as an alternative to more heavily parametrised biological models. We focus here on a class of…

Applications · Statistics 2013-12-16 Gilles Guillot , René Schilling , Emilio Porcu , Moreno Bevilacqua

We shall present an elementary approach to extremal decompositions of (quantum) covariance matrices determined by densities. We give a new proof on former results and provide a sharp estimate of the ranks of the densities that appear in the…

Functional Analysis · Mathematics 2015-07-10 Zoltan Leka

Significant pattern mining, the problem of finding itemsets that are significantly enriched in one class of objects, is statistically challenging, as the large space of candidate patterns leads to an enormous multiple testing problem.…

Machine Learning · Statistics 2015-08-25 Felipe Llinares-Lopez , Laetitia Papaxanthos , Dean Bodenham , Karsten Borgwardt

We derive the form of the variance-covariance matrix for any affine equivariant matrix-valued statistics when sampling from complex elliptical distributions. We then use this result to derive the variance-covariance matrix of the sample…

Statistics Theory · Mathematics 2021-11-10 Elias Raninen , Esa Ollila , David E. Tyler

Automatically evaluating the coherence of summaries is of great significance both to enable cost-efficient summarizer evaluation and as a tool for improving coherence by selecting high-scoring candidate summaries. While many different…

Computation and Language · Computer Science 2022-09-16 Julius Steen , Katja Markert

Regularization has become a primary tool for developing reliable estimators of the covariance matrix in high-dimensional settings. To curb the curse of dimensionality, numerous methods assume that the population covariance (or inverse…

Methodology · Statistics 2018-02-19 Jacob Bien

This paper investigates limiting properties of eigenvalues of multivariate sample spatial-sign covariance matrices when both the number of variables and the sample size grow to infinity. The underlying p-variate populations are general…

Statistics Theory · Mathematics 2021-01-25 Weiming Li , Qinwen Wang , Jianfeng Yao , Wang Zhou

A major problem in numerical weather prediction (NWP) is the estimation of high-dimensional covariance matrices from a small number of samples. Maximum likelihood estimators cannot provide reliable estimates when the overall dimension is…

Methodology · Statistics 2023-01-13 Robert J. Webber , Matthias Morzfeld

The modeling and uncertainty quantification of closed curves is an important problem in the field of shape analysis, and can have significant ramifications for subsequent statistical tasks. Many of these tasks involve collections of closed…

Machine Learning · Statistics 2023-03-15 Hengrui Luo , Justin D. Strait

The estimation of large covariance matrices has a high dimensional bias. Correcting for this bias can be reformulated via the tool of Free Probability Theory as a free deconvolution. The goal of this work is a computational and statistical…

Probability · Mathematics 2023-05-10 Reda Chhaibi , Fabrice Gamboa , Slim Kammoun , Mauricio Velasco

We extend to the matrix setting a recent result of Srivastava-Vershynin about estimating the covariance matrix of a random vector. The result can be in- terpreted as a quantified version of the law of large numbers for positive…

Probability · Mathematics 2015-11-16 Pierre Youssef