English
Related papers

Related papers: A Random Matrix--Theoretic Approach to Handling Si…

200 papers

Regression analysis with missing data is a long-standing and challenging problem, particularly when there are many missing variables with arbitrary missing patterns. Likelihood-based methods, although theoretically appealing, are often…

Methodology · Statistics 2024-10-16 Ngok Sang Kwok , Kin Yau Wong

Factor-based Structural Equation Modeling (SEM) relies on likelihood-based estimation assuming a nonsingular sample covariance matrix, which breaks down in small-sample settings with $p>n$. To address this, we propose a novel estimation…

Machine Learning · Computer Science 2026-04-21 Hiroki Hasegawa , Aoba Tamura , Yukihiko Okada

We propose an approach to the aggregation of risks which is based on estimation of simple quantities (such as covariances) associated to a vector of dependent random variables, and which avoids the use of parametric families of copulae. Our…

Risk Management · Quantitative Finance 2009-12-10 Brice Franke , Michael Stolz

We consider the classical problem of estimating the covariance matrix of a subgaussian distribution from i.i.d. samples in the novel context of coarse quantization, i.e., instead of having full knowledge of the samples, they are quantized…

Information Theory · Computer Science 2022-04-25 Sjoerd Dirksen , Johannes Maly , Holger Rauhut

This paper is concerned with optimizing the global minimum-variance portfolio's (GMVP) weights in high-dimensional settings where both observation and population dimensions grow at a bounded ratio. Optimizing the GMVP weights is highly…

Signal Processing · Electrical Eng. & Systems 2022-04-13 Maaz Mahadi , Tarig Ballal , Muhammad Moinuddin , Tareq Y. Al-Naffouri , Ubaid Al-Saggaf

We consider the problem of mean-variance portfolio optimization for a generic covariance matrix subject to the budget constraint and the constraint for the expected return, with the application of the replica method borrowed from the…

Portfolio Management · Quantitative Finance 2017-01-04 Istvan Varga-Haszonits , Fabio Caccioli , Imre Kondor

In this paper, we use a new approach to prove that the largest eigenvalue of the sample covariance matrix of a normally distributed vector is bigger than the true largest eigenvalue with probability 1 when the dimension is infinite. We…

Probability · Mathematics 2017-08-14 Soufiane Hayou

The problem of estimating a normal covariance matrix is considered from a decision-theoretic point of view, where the dimension of the covariance matrix is larger than the sample size. This paper addresses not only the nonsingular case but…

Statistics Theory · Mathematics 2015-06-03 Hisayuki Tsukuma

The task of estimating a matrix given a sample of observed entries is known as the \emph{matrix completion problem}. Most works on matrix completion have focused on recovering an unknown real-valued low-rank matrix from a random sample of…

Statistics Theory · Mathematics 2014-08-27 Olga Klopp , Jean Lafond , Eric Moulines , Joseph Salmon

This paper studies the problem of estimating a covariance matrix from correlated sub-Gaussian samples. We consider using the correlated sample covariance matrix estimator to approximate the true covariance matrix. We establish…

Information Theory · Computer Science 2019-10-17 Xu Zhang , Wei Cui , Yulong Liu

Computational capability often falls short when confronted with massive data, posing a common challenge in establishing a statistical model or statistical inference method dealing with big data. While subsampling techniques have been…

Methodology · Statistics 2024-10-31 Yixiao Ruan , Zan Li , Zhaohui Li , Dennis K. J. Lin , Qingpei Hu , Dan Yu

The variance--covariance matrix plays a central role in the inferential theories of high-dimensional factor models in finance and economics. Popular regularization methods of directly exploiting sparsity are not directly applicable to many…

Methodology · Statistics 2012-03-15 Jianqing Fan , Yuan Liao , Martina Mincheva

As is the case for many curved exponential families, the computation of maximum likelihood estimates in a multivariate normal model with a Kronecker covariance structure is typically carried out with an iterative algorithm, specifically, a…

Statistics Theory · Mathematics 2024-08-28 Mathias Drton , Alexandros Grosdos , Andrew McCormack

We introduce a covariance matrix estimator that both takes into account the heteroskedasticity of financial returns (by using an exponentially weighted moving average) and reduces the effective dimensionality of the estimation (and hence…

Statistical Mechanics · Physics 2008-12-02 Szilard Pafka , Marc Potters , Imre Kondor

Selecting the optimal Markowitz porfolio depends on estimating the covariance matrix of the returns of $N$ assets from $T$ periods of historical data. Problematically, $N$ is typically of the same order as $T$, which makes the sample…

Applications · Statistics 2020-12-29 Raj Agrawal , Uma Roy , Caroline Uhler

In several applications, one must estimate a real-valued (symmetric) Toeplitz covariance matrix, typically shifted by the conjugated diagonal matrices of phase progression and phase "calibration" errors. Unlike the Hermitian Toeplitz…

Signal Processing · Electrical Eng. & Systems 2025-07-03 Yuri Abramovich , Victor Abramovich , Tanit Pongsiri

When a linear model is adjusted to control for additional explanatory variables the sign of a fitted coefficient may reverse. Here these reversals are studied using coefficients of determination. The resulting theory can be used to…

Methodology · Statistics 2015-03-11 Brian Knaeble , Seth Dutter

Maximum likelihood estimation is a popular method in statistical inference. As a way of assessing the accuracy of the maximum likelihood estimate (MLE), the calculation of the covariance matrix of the MLE is of great interest in practice.…

Statistics Theory · Mathematics 2014-05-08 Xumeng Cao

Robust covariance estimation is the following, well-studied problem in high dimensional statistics: given $N$ samples from a $d$-dimensional Gaussian $\mathcal{N}(\boldsymbol{0}, \Sigma)$, but where an $\varepsilon$-fraction of the samples…

Data Structures and Algorithms · Computer Science 2020-06-25 Jerry Li , Guanghao Ye

In this work we construct an optimal linear shrinkage estimator for the covariance matrix in high dimensions. The recent results from the random matrix theory allow us to find the asymptotic deterministic equivalents of the optimal…

Statistics Theory · Mathematics 2014-10-28 Taras Bodnar , Arjun K. Gupta , Nestor Parolya