English
Related papers

Related papers: High-dimensional covariance matrix estimators on s…

200 papers

We introduce a HD DCC-HEAVY class of hierarchical-type factor models for high-dimensional covariance matrices, employing the realized measures built from higher-frequency data. The modelling approach features straightforward estimation and…

Econometrics · Economics 2024-07-17 Emilija Dzuverovic , Matteo Barigozzi

The variance--covariance matrix plays a central role in the inferential theories of high-dimensional factor models in finance and economics. Popular regularization methods of directly exploiting sparsity are not directly applicable to many…

Methodology · Statistics 2012-03-15 Jianqing Fan , Yuan Liao , Martina Mincheva

We propose a combination of cluster analysis and stochastic process analysis to characterize high-dimensional complex dynamical systems by few dominating variables. As an example, stock market data are analyzed for which the dynamical…

Statistical Finance · Quantitative Finance 2015-03-10 Philip Rinn , Yuriy Stepanov , Joachim Peinke , Thomas Guhr , Rudi Schäfer

High dimensionality comparable to sample size is common in many statistical problems. We examine covariance matrix estimation in the asymptotic framework that the dimensionality $p$ tends to $\infty$ as the sample size $n$ increases.…

Statistics Theory · Mathematics 2007-06-13 Jianqing Fan , Yingying Fan , Jinchi Lv

We study empirical covariance matrices in finance. Due to the limited amount of available input information, these objects incorporate a huge amount of noise, so their naive use in optimization procedures, such as portfolio selection, may…

Physics and Society · Physics 2008-12-02 Gabor Papp , Szilard Pafka , Maciej A. Nowak , Imre Kondor

Covariance matrix estimation is an important problem in multivariate data analysis, both from theoretical as well as applied points of view. Many simple and popular covariance matrix estimators are known to be severely affected by model…

Methodology · Statistics 2025-11-21 Soumya Chakraborty , Ayanendranath Basu , Abhik Ghosh

The present paper provides a study of high-dimensional statistical arbitrage that combines factor models with the tools from stochastic control, obtaining closed-form optimal strategies which are both interpretable and computationally…

Mathematical Finance · Quantitative Finance 2021-06-25 Jorge Guijarro-Ordonez

This paper is concerned with the estimation of time-varying networks for high-dimensional nonstationary time series. Two types of dynamic behaviors are considered: structural breaks (i.e., abrupt change points) and smooth changes. To…

Statistics Theory · Mathematics 2020-02-19 Mengyu Xu , Xiaohui Chen , Wei Biao Wu

Beta-sorted portfolios -- portfolios comprised of assets with similar covariation to selected risk factors -- are a popular tool in empirical finance to analyze models of (conditional) expected returns. Despite their widespread use, little…

Econometrics · Economics 2024-11-12 Matias D. Cattaneo , Richard K. Crump , Weining Wang

We propose a data-driven way to reduce the noise of covariance matrices of nonstationary systems. In the case of stationary systems, asymptotic approaches were proved to converge to the optimal solutions. Such methods produce eigenvalues…

Applications · Statistics 2023-03-10 Christian Bongiorno , Damien Challet , Grégoire Loeper

Hierarchical categorical variables often exhibit many levels (high granularity) and many classes within each level (high dimensionality). This may cause overfitting and estimation issues when including such covariates in a predictive model.…

Methodology · Statistics 2024-08-20 Paul Wilsens , Katrien Antonio , Gerda Claeskens

In dealing with high-dimensional data, factor models are often used for reducing dimensions and extracting relevant information. The spectrum of covariance matrices from power data exhibits two aspects: 1) bulk, which arises from random…

Applications · Statistics 2019-10-22 Xin Shi , Robert Qiu

We discuss a weighted estimation of correlation and covariance matrices from historical financial data. To this end, we introduce a weighting scheme that accounts for similarity of previous market conditions to the present one. The…

Statistical Finance · Quantitative Finance 2010-07-01 Michael C. Münnix , Rudi Schäfer , Oliver Grothe

The major sources of abundant data are constantly expanding with the available data collection methodologies in various applications - medical, insurance, scientific, bio-informatics and business. These data sets may be distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-06-24 Aruna Govada , Sanjay K. Sahay

We propose a general procedure for estimating the variance-covariance matrix of two-step estimates of structural parameters in latent variable models. The method is partially simulation-based, in that it includes drawing simulated values of…

Methodology · Statistics 2025-07-23 Roberto Di Mari , Jouni Kuha

Covariance matrix estimation is a fundamental statistical task in many applications, but the sample covariance matrix is sub-optimal when the sample size is comparable to or less than the number of features. Such high-dimensional settings…

Methodology · Statistics 2022-06-06 Huiqin Xin , Sihai Dave Zhao

We consider the problem of optimizing a portfolio of financial assets, where the number of assets can be much larger than the number of observations. The optimal portfolio weights require estimating the inverse covariance matrix of excess…

Portfolio Management · Quantitative Finance 2021-09-29 Anik Burman , Sayantan Banerjee

Robust estimation for modern portfolio selection on a large set of assets becomes more important due to large deviation of empirical inference on big data. We propose a distributionally robust methodology for high-dimensional mean-variance…

Methodology · Statistics 2024-09-12 Ruike Wu , Yanrong Yang , Han Lin Shang , Huanjun Zhu

This paper examines the usefulness of high frequency data in estimating the covariance matrix for portfolio choice when the portfolio size is large. A computationally convenient nonlinear shrinkage estimator for the integrated covariance…

Statistics Theory · Mathematics 2016-11-22 Cheng Liu , Ningning Xia , Jun Yu

This paper studies the covariance matrix estimation for high-dimensional time series within a new framework that combines low-rank factor and latent variable-specific cluster structures. The popular methods based on assuming the sparse…

Methodology · Statistics 2025-02-25 Dong Li , Xinghao Qiao , Cheng Yu