English
Related papers

Related papers: Non-linear shrinkage estimation of large-scale str…

200 papers

This work addresses the issue of large covariance matrix estimation in high-dimensional statistical analysis. Recently, improved iterative algorithms with positive-definite guarantee have been developed. However, these algorithms cannot be…

Information Theory · Computer Science 2016-07-29 Fei Wen , Yuan Yang , Peilin Liu , Robert C. Qiu

We propose a general framework for nonasymptotic covariance matrix estimation making use of concentration inequality-based confidence sets. We specify this framework for the estimation of large sparse covariance matrices through…

Methodology · Statistics 2020-12-17 Adam B Kashlak , Linglong Kong

We extend to the matrix setting a recent result of Srivastava-Vershynin about estimating the covariance matrix of a random vector. The result can be in- terpreted as a quantified version of the law of large numbers for positive…

Probability · Mathematics 2015-11-16 Pierre Youssef

In a linear regression model with random design, we consider a family of candidate models from which we want to select a `good' model for prediction out-of-sample. We fit the models using block shrinkage estimators, and we focus on the…

Statistics Theory · Mathematics 2018-09-13 Hannes Leeb , Nina Senitschnig

Recent developments in engineering techniques for spatial data collection such as geographic information systems have resulted in an increasing need for methods to analyze large spatial data sets. These sorts of data sets can be found in…

Methodology · Statistics 2020-08-14 Toshihiro Hirano

We propose a data-driven way to reduce the noise of covariance matrices of nonstationary systems. In the case of stationary systems, asymptotic approaches were proved to converge to the optimal solutions. Such methods produce eigenvalues…

Applications · Statistics 2023-03-10 Christian Bongiorno , Damien Challet , Grégoire Loeper

Sparse regression and classification estimators that respect group structures have application to an assortment of statistical and machine learning problems, from multitask learning to sparse additive modeling to hierarchical selection.…

Methodology · Statistics 2024-03-11 Ryan Thompson , Farshid Vahid

We introduce PseudoNet, a new pseudolikelihood-based estimator of the inverse covariance matrix, that has a number of useful statistical and computational properties. We show, through detailed experiments with synthetic and also real-world…

Methodology · Statistics 2016-10-17 Alnur Ali , Kshitij Khare , Sang-Yun Oh , Bala Rajaratnam

The problem of estimating a spiked covariance matrix in high dimensions under Frobenius loss, and the parallel problem of estimating the noise in spiked PCA is investigated. We propose an estimator of the noise parameter by minimizing an…

Statistics Theory · Mathematics 2014-08-28 Didier Chételat , Martin T. Wells

Motivated by recent work involving the analysis of leveraging spatial correlations in sparsified mean estimation, we present a novel procedure for constructing covariance estimator. The proposed Random-knots (Random-knots-Spatial) and…

Methodology · Statistics 2025-11-25 Sijie Zheng , Fandong Meng , Jie Zhou

This work is concerned with the estimation of multidimensional regression and the asymptotic behaviour of the test involved in selecting models. The main problem with such models is that we need to know the covariance matrix of the noise to…

Statistics Theory · Mathematics 2008-02-20 Joseph Rynkiewicz

We study shrinkage estimation of the mean parameters of a class of multivariate distributions for which the diagonal entries of the corresponding covariance matrix are certain quadratic functions of the mean parameter. This class of…

Statistics Theory · Mathematics 2022-07-04 Nikolas Siapoutis , Donald Richards , Bharath K. Sriperumbudur

We investigate simulation-based bandpower covariance matrices commonly used in cosmological parameter inferences such as the estimation of the tensor-to-scalar ratio $r$. We find that upper limits on $r$ can be biased low by tens of…

Cosmology and Nongalactic Astrophysics · Physics 2022-07-06 Dominic Beck , Ari Cukierman , W. L. Kimmy Wu

We study the problem of estimating a large, low-rank matrix corrupted by additive noise of unknown covariance, assuming one has access to additional side information in the form of noise-only measurements. We study the Whiten-Shrink-reColor…

Statistics Theory · Mathematics 2023-07-18 Matan Gavish , William Leeb , Elad Romanov

Many data-analysis problems involve large dense matrices that describe the covariance of stationary noise processes; the computational cost of inverting these matrices, or equivalently of solving linear systems that contain them, is often a…

Instrumentation and Methods for Astrophysics · Physics 2015-06-22 Rutger van Haasteren , Michele Vallisneri

We propose a flexible yet interpretable model for high-dimensional data with time-varying second order statistics, motivated and applied to functional neuroimaging data. Motivated by the neuroscience literature, we factorize the covariances…

Machine Learning · Statistics 2021-07-20 Katherine Tsai , Mladen Kolar , Oluwasanmi Koyejo

Nonsingular estimation of high dimensional covariance matrices is an important step in many statistical procedures like classification, clustering, variable selection an future extraction. After a review of the essential background…

Statistics Theory · Mathematics 2015-03-19 Deniz Akdemir

We study the estimation of the high-dimensional covariance matrix andits eigenvalues under dynamic volatility models. Data under such modelshave nonlinear dependency both cross-sectionally and temporally. We firstinvestigate the empirical…

Statistics Theory · Mathematics 2022-11-22 Yi Ding , Xinghua Zheng

Accurate covariance matrices for two-point functions are critical for inferring cosmological parameters in likelihood analyses of large-scale structure surveys. Among various approaches to obtaining the covariance, analytic computation is…

Cosmology and Nongalactic Astrophysics · Physics 2021-02-23 Xiao Fang , Tim Eifler , Elisabeth Krause

In this paper, nonlinear model reduction for power systems is performed by the balancing of empirical controllability and observability covariances that are calculated around the operating region. Unlike existing model reduction methods,…

Systems and Control · Computer Science 2016-08-30 Junjian Qi , Jianhui Wang , Hui Liu , Aleksandar D. Dimitrovski