English
Related papers

Related papers: Covariance Function Estimation for High-Dimensiona…

200 papers

We propose a novel estimation approach for the covariance matrix based on the $l_1$-regularized approximate factor model. Our sparse approximate factor (SAF) covariance estimator allows for the existence of weak factors and hence relaxes…

Econometrics · Economics 2019-06-14 Maurizio Daniele , Winfried Pohlmeier , Aygul Zagidullina

We address high dimensional covariance estimation for elliptical distributed samples, which are also known as spherically invariant random vectors (SIRV) or compound-Gaussian processes. Specifically we consider shrinkage methods that are…

Methodology · Statistics 2015-05-20 Yilun Chen , Ami Wiesel , Alfred O. Hero

We provide a novel -- and to the best of our knowledge, the first -- algorithm for high dimensional sparse regression with constant fraction of corruptions in explanatory and/or response variables. Our algorithm recovers the true sparse…

Machine Learning · Computer Science 2019-05-31 Liu Liu , Yanyao Shen , Tianyang Li , Constantine Caramanis

We propose a model selection approach for covariance estimation of a multi-dimensional stochastic process. Under very general assumptions, observing i.i.d replications of the process at fixed observation points, we construct an estimator of…

Statistics Theory · Mathematics 2009-09-29 Jérémie Bigot , Rolando Biscay , Jean-Michel Loubes , Lilian Muniz Alvarez

Multivariate functional data present theoretical and practical complications which are not found in univariate functional data. One of these is a situation where the component functions of multivariate functional data are positive and are…

Methodology · Statistics 2023-03-09 Cody Carroll , Hans-Georg Müller

Estimating covariance matrices with high-dimensional complex data presents significant challenges, particularly concerning positive definiteness, sparsity, and numerical stability. Existing robust sparse estimators often fail to guarantee…

Methodology · Statistics 2025-12-30 Shaoxin Wang , Ziyun Ma

Time evolving surfaces can be modeled as two-dimensional Functional time series, exploiting the tools of Functional data analysis. Leveraging this approach, a forecasting framework for such complex data is developed. The main focus revolves…

Methodology · Statistics 2023-07-19 Niccolò Ajroldi , Jacopo Diquigiovanni , Matteo Fontana , Simone Vantini

Estimating a covariance matrix is central to high-dimensional data analysis. Empirical analyses of high-dimensional biomedical data, including genomics, proteomics, microbiome, and neuroimaging, among others, consistently reveal strong…

Methodology · Statistics 2024-12-05 Yifan Yang , Chixiang Chen , Shuo Chen

We consider estimation of mean and covariance functions of functional snippets, which are short segments of functions possibly observed irregularly on an individual specific subinterval that is much shorter than the entire study interval.…

Methodology · Statistics 2020-06-08 Zhenhua Lin , Jane-Ling Wang

The covariance structure of multivariate functional data can be highly complex, especially if the multivariate dimension is large, making extensions of statistical methods for standard multivariate data to the functional data setting…

Methodology · Statistics 2022-02-04 Javier Zapata , Sang-Yun Oh , Alexander Petersen

Multivariate functional data from a complex system are naturally high-dimensional and have complex cross-correlation structure. The complexity of data structure can be observed as that (1) some functions are strongly correlated with similar…

Machine Learning · Statistics 2018-04-12 Chen Zhang , Hao Yan , Seungho Lee , Jianjun Shi

Covariance matrix estimation is a fundamental statistical task in many applications, but the sample covariance matrix is sub-optimal when the sample size is comparable to or less than the number of features. Such high-dimensional settings…

Methodology · Statistics 2022-06-06 Huiqin Xin , Sihai Dave Zhao

We present a method for estimating sparse high-dimensional inverse covariance and partial correlation matrices, which exploits the connection between the inverse covariance matrix and linear regression. The method is a two-stage estimation…

Machine Learning · Statistics 2025-05-13 Samuel Erickson , Tobias Rydén

We propose a model to forecast large realized covariance matrices of returns, applying it to the constituents of the S\&P 500 daily. To address the curse of dimensionality, we decompose the return covariance matrix using standard firm-level…

Statistical Finance · Quantitative Finance 2023-03-29 Rafael Alves , Diego S. de Brito , Marcelo C. Medeiros , Ruy M. Ribeiro

Sparse Bayesian factor models are routinely implemented for parsimonious dependence modeling and dimensionality reduction in high-dimensional applications. We provide theoretical understanding of such Bayesian procedures in terms of…

Statistics Theory · Mathematics 2014-06-03 Debdeep Pati , Anirban Bhattacharya , Natesh S. Pillai , David Dunson

Estimating the covariance structure of multivariate time series is a fundamental problem with a wide-range of real-world applications -- from financial modeling to fMRI analysis. Despite significant recent advances, current state-of-the-art…

Machine Learning · Computer Science 2021-02-12 Hrayr Harutyunyan , Daniel Moyer , Hrant Khachatrian , Greg Ver Steeg , Aram Galstyan

Functional principal component analysis (FPCA) is a fundamental tool and has attracted increasing attention in recent decades, while existing methods are restricted to data with a single or finite number of random functions (much smaller…

Methodology · Statistics 2021-01-22 Xiaoyu Hu , Fang Yao

The spatial random-effects model is flexible in modeling spatial covariance functions, and is computationally efficient for spatial prediction via fixed rank kriging. However, the success of this model depends on an appropriate set of basis…

Methodology · Statistics 2015-04-23 ShengLi Tzeng , Hsin-Cheng Huang

In finance, economics and many other fields, observations in a matrix form are often observed over time. For example, many economic indicators are obtained in different countries over time. Various financial characteristics of many…

Methodology · Statistics 2017-06-22 Dong Wang , Xialu Liu , Rong Chen

High-dimensional vector autoregressive (VAR) models are important tools for the analysis of multivariate time series. This paper focuses on high-dimensional time series and on the different regularized estimation procedures proposed for…

Machine Learning · Statistics 2020-06-11 Jonas Krampe , Efstathios Paparoditis