English
Related papers

Related papers: Cross-validated covariance estimators for high-dim…

200 papers

This paper studies the problem of estimating the covariance of a collection of vectors using only highly compressed measurements of each vector. An estimator based on back-projections of these compressive samples is proposed and analyzed. A…

Machine Learning · Statistics 2019-01-16 Martin Azizyan , Akshay Krishnamurthy , Aarti Singh

Portfolio managers faced with limited sample sizes must use factor models to estimate the covariance matrix of a high-dimensional returns vector. For the simplest one-factor market model, success rests on the quality of the estimated…

Computational Finance · Quantitative Finance 2021-09-14 Hubeyb Gurdogan , Alec Kercheval

We investigate and extend the result that an alpha-weight angle from unconstrained quadratic portfolio optimisations has an upper bound dependent on the condition number of the covariance matrix. This is known to imply that better…

Portfolio Management · Quantitative Finance 2024-12-03 Lara Dalmeyer , Tim Gebbie

The effectiveness and validity of applying variation partitioning methods in community ecology has been questioned. Here, using mathematical deduction and numerical simulation, we made an attempt to uncover the underlying mechanisms…

Populations and Evolution · Quantitative Biology 2014-02-17 Youhua Chen

Motivated by practical applications, we explore the constrained multi-period mean-variance portfolio selection problem within a market characterized by a dynamic factor model. This model captures predictability in asset returns driven by…

Portfolio Management · Quantitative Finance 2025-02-26 Jianjun Gao , Chengneng Jin , Yun Shi , Xiangyu Cui

According to recent findings [1,2], empirical covariance matrices deduced from financial return series contain such a high amount of noise that, apart from a few large eigenvalues and the corresponding eigenvectors, their structure can…

Statistical Mechanics · Physics 2009-11-07 Szilard Pafka , Imre Kondor

We introduce a $k$-fold boosted version of our Boostrapped Average Hierarchical Clustering cleaning procedure for correlation and covariance matrices. We then apply this method to global minimum variance portfolios for various values of $k$…

Portfolio Management · Quantitative Finance 2023-03-10 Christian Bongiorno , Damien Challet

The problem of estimating a normal covariance matrix is considered from a decision-theoretic point of view, where the dimension of the covariance matrix is larger than the sample size. This paper addresses not only the nonsingular case but…

Statistics Theory · Mathematics 2015-06-03 Hisayuki Tsukuma

We study operator-norm covariance estimation from heavy-tailed samples that may include a small fraction of arbitrary outliers. A simple and widely used safeguard is \emph{Euclidean norm clipping}, but its accuracy depends critically on an…

Machine Learning · Statistics 2026-02-17 Even He , Zaizai Yan

A typical assumption in supervised machine learning is that the train (source) and test (target) datasets follow completely the same distribution. This assumption is, however, often violated in uncertain real-world applications, which…

Machine Learning · Computer Science 2021-08-17 Masahiro Nomura , Yuta Saito

The comovement phenomenon in financial markets creates decision scenarios with positively correlated asset returns. This paper addresses covariance matrix estimation under such conditions, motivated by observations of significant positive…

Econometrics · Economics 2025-07-03 Weilong Liu , Yanchu Liu

Cluster-randomized experiments are increasingly used to evaluate interventions in routine practice conditions, and researchers often adopt model-based methods with covariate adjustment in the statistical analyses. However, the validity of…

Methodology · Statistics 2023-12-08 Bingkai Wang , Chan Park , Dylan S. Small , Fan Li

Despite ongoing theoretical research on cross-validation (CV), many theoretical questions remain widely open. This motivates our investigation into how properties of algorithm-distribution pairs can affect the choice for the number of folds…

Statistics Theory · Mathematics 2026-01-09 Ido Nachum , Rüdiger Urbanke , Thomas Weinberger

We introduce a novel approach to portfolio optimization that leverages hierarchical graph structures and the Schur complement method to systematically reduce computational complexity while preserving full covariance information. Inspired by…

Portfolio Management · Quantitative Finance 2025-03-18 Gamal Mograby

Value-at-Risk is one of the most popular risk management tools in the financial industry. Over the past 20 years several attempts to include VaR in the portfolio selection process have been proposed. However, using VaR as a risk measure in…

Portfolio Management · Quantitative Finance 2021-11-19 Francesco Cesarone , Manuel L Martino , Fabio Tardella

For a covariance matrix coming from a factor model of returns, we investigate the relationship between the long-only global minimum variance portfolio and the asset exposures to the factors. In the case of a 1-factor model, we provide a…

Mathematical Finance · Quantitative Finance 2026-03-10 Nick L. Gunther , Alec N. Kercheval , Ololade Sowunmi

We consider the $\mathcal{H}^2$-formatted compression and computational estimation of covariance functions on a compact set in $\mathbb{R}^d$. The classical sample covariance or Monte Carlo estimator is prohibitively expensive for many…

Numerical Analysis · Mathematics 2023-01-31 Jürgen Dölz

Least-squares models such as linear regression and Linear Discriminant Analysis (LDA) are amongst the most popular statistical learning techniques. However, since their computation time increases cubically with the number of features, they…

Machine Learning · Computer Science 2018-03-28 Matthias S. Treder

Covariance matrices estimated from short, noisy, and non-Gaussian financial time series are notoriously unstable. Empirical evidence suggests that such covariance structures often exhibit power-law scaling, reflecting complex, hierarchical…

Computational Finance · Quantitative Finance 2026-01-13 Andres Garcia-Medina

Cross-validation is a widely-used technique to estimate prediction error, but its behavior is complex and not fully understood. Ideally, one would like to think that cross-validation estimates the prediction error for the model at hand, fit…

Methodology · Statistics 2024-03-12 Stephen Bates , Trevor Hastie , Robert Tibshirani