English
Related papers

Related papers: Optimal Shrinkage of Eigenvalues in the Spiked Cov…

200 papers

We propose a distributionally robust formulation for simultaneously estimating the covariance matrix and the precision matrix of a random vector.The proposed model minimizes the worst-case weighted sum of the Frobenius loss of the…

Machine Learning · Statistics 2025-11-19 Renjie Chen , Viet Anh Nguyen , Huifu Xu

We describe a puzzle involving the interactions between an optimization of a multivariate quadratic function and a "plug-in" estimator of a spiked covariance matrix. When the largest eigenvalues (i.e., the spikes) diverge with the…

Statistics Theory · Mathematics 2024-10-07 Hubeyb Gurdogan , Alex Shkolnik

This paper considers the problem of estimating a high-dimensional (HD) covariance matrix when the sample size is smaller, or not much larger, than the dimensionality of the data, which could potentially be very large. We develop a…

Methodology · Statistics 2019-05-22 Esa Ollila , Elias Raninen

Shrinkage methods are frequently used to improve the precision of least squares estimators of fixed effects. However, widely used shrinkage estimators guarantee improved precision only under strong distributional assumptions. I develop an…

Econometrics · Economics 2025-09-09 Soonwoo Kwon

We study Bayesian inference in the spiked covariance model, where a small number of spiked eigenvalues dominate the spectrum. Our goal is to infer the spiked eigenvalues, their corresponding eigenvectors, and the number of spikes, providing…

Statistics Theory · Mathematics 2025-08-20 Kwangmin Lee , Sewon Park , Seongmin Kim , Jaeyong Lee

We tackle covariance estimation in low-sample scenarios, employing a structured covariance matrix with shrinkage methods. These involve convexly combining a low-bias/high-variance empirical estimate with a biased regularization estimator,…

Instrumentation and Methods for Astrophysics · Physics 2024-06-28 Olivier Flasseur , Eric Thiébaut , Loïc Denis , Maud Langlois

This chapter reviews methods for linear shrinkage of the sample covariance matrix (SCM) and matrices (SCM-s) under elliptical distributions in single and multiple populations settings, respectively. In the single sample setting a popular…

Methodology · Statistics 2023-08-10 Esa Ollila

Portfolio managers faced with limited sample sizes must use factor models to estimate the covariance matrix of a high-dimensional returns vector. For the simplest one-factor market model, success rests on the quality of the estimated…

Computational Finance · Quantitative Finance 2021-09-14 Hubeyb Gurdogan , Alec Kercheval

We derive an optimal shrinkage sample covariance matrix (SCM) estimator which is suitable for high dimensional problems and when sampling from an unspecified elliptically symmetric distribution. Specifically, we derive the optimal (oracle)…

Methodology · Statistics 2017-07-03 Esa Ollila

In this paper, a new ridge-type shrinkage estimator for the precision matrix has been proposed. The asymptotic optimal shrinkage coefficients and the theoretical loss were derived. Data-driven estimators for the shrinkage coefficients were…

Methodology · Statistics 2019-09-04 Cheng Wang , Guangming Pan , Longbing Cao

Stein showed that the multivariate sample mean is outperformed by "shrinking" to a constant target vector. Ledoit and Wolf extended this approach to the sample covariance matrix and proposed a multiple of the identity as shrinkage target.…

Methodology · Statistics 2014-12-08 Daniel Bartz , Johannes Höhne , Klaus-Robert Müller

In portfolio risk minimization, the inverse covariance matrix of returns is often unknown and has to be estimated in practice. This inverse covariance matrix also prescribes the hedge trades in which a stock is hedged by all the other…

Portfolio Management · Quantitative Finance 2024-07-15 Lim Hao Shen Keith

We study the design of portfolios under a minimum risk criterion. The performance of the optimized portfolio relies on the accuracy of the estimated covariance matrix of the portfolio asset returns. For large portfolios, the number of…

Portfolio Management · Quantitative Finance 2016-01-20 Liusha Yang , Romain Couillet , Matthew R. McKay

In many astrophysical settings covariance matrices of large datasets have to be determined empirically from a finite number of mock realisations. The resulting noise degrades inference and precludes it completely if there are fewer…

Instrumentation and Methods for Astrophysics · Physics 2017-01-11 Benjamin Joachimi

This paper examines the usefulness of high frequency data in estimating the covariance matrix for portfolio choice when the portfolio size is large. A computationally convenient nonlinear shrinkage estimator for the integrated covariance…

Statistics Theory · Mathematics 2016-11-22 Cheng Liu , Ningning Xia , Jun Yu

The mean-variance model remains the most prevalent investment framework, built on diversification principles. However, it consistently struggles with estimation errors in expected returns and the covariance matrix, its core parameters. To…

Portfolio Management · Quantitative Finance 2026-01-29 Rupendra Yadav , Amita Sharma , Aparna Mehra

In this paper we estimate the mean-variance portfolio in the high-dimensional case using the recent results from the theory of random matrices. We construct a linear shrinkage estimator which is distribution-free and is optimal in the sense…

Statistical Finance · Quantitative Finance 2023-04-19 Taras Bodnar , Yarema Okhrin , Nestor Parolya

In this paper, a shrinkage estimator for the population mean is proposed under known quadratic loss functions with unknown covariance matrices. The new estimator is non-parametric in the sense that it does not assume a specific parametric…

Methodology · Statistics 2014-11-07 Cheng Wang , Tiejun Tong , Longbing Cao , Baiqi Miao

Portfolio optimization requires sophisticated covariance estimators that are able to filter out estimation noise. Non-linear shrinkage is a popular estimator based on how the Oracle eigenvalues can be computed using only data from the…

Portfolio Management · Quantitative Finance 2022-10-14 Christian Bongiorno , Damien Challet

Linear shrinkage estimators of a covariance matrix --- defined by a weighted average of the sample covariance matrix and a pre-specified shrinkage target matrix --- are popular when analysing high-throughput molecular data. However, their…

Methodology · Statistics 2018-09-24 Harry Gray , Gwenaël G. R. Leday , Catalina A. Vallejos , Sylvia Richardson