English
Related papers

Related papers: Large Covariance Estimation through Elliptical Fac…

200 papers

This paper presents a general framework for estimating high-dimensional conditional latent factor models via constrained nuclear norm regularization. We establish large sample properties of the estimators and provide efficient algorithms…

Econometrics · Economics 2025-12-09 Qihui Chen

We consider estimation of the covariance matrix of a multivariate random vector under the constraint that certain covariances are zero. We first present an algorithm, which we call Iterative Conditional Fitting, for computing the maximum…

Statistics Theory · Mathematics 2010-03-04 Sanjay Chaudhuri , Mathias Drton , Thomas S. Richardson

We study the problem of estimating the leading eigenvectors of a high-dimensional population covariance matrix based on independent Gaussian observations. We establish lower bounds on the rates of convergence of the estimators of the…

Statistics Theory · Mathematics 2012-02-07 Debashis Paul , Iain M. Johnstone

We introduce an estimation method of covariance matrices in a high-dimensional setting, i.e., when the dimension of the matrix, , is larger than the sample size . Specifically, we propose an orthogonally equivariant estimator. The…

Statistics Theory · Mathematics 2020-12-04 Samprit Banerjee , Stefano Monni

Several novel statistical methods have been developed to estimate large integrated volatility matrices based on high-frequency financial data. To investigate their asymptotic behaviors, they require a sub-Gaussian or finite high-order…

Statistics Theory · Mathematics 2023-08-15 Minseok Shin , Donggyu Kim , Jianqing Fan

In this work, we propose a novel Parameter-Efficient Fine-Tuning (PEFT) approach based on Gaussian Graphical Models (GGMs), marking the first application of GGMs to PEFT tasks, to the best of our knowledge. The proposed method utilizes the…

Machine Learning · Computer Science 2024-12-12 Jingjing Zheng , Yankai Cao

We propose a new estimator of high-dimensional spot volatility matrices satisfying a low-rank plus sparse structure from noisy and asynchronous high-frequency data collected for an ultra-large number of assets. The noise processes are…

Econometrics · Economics 2024-03-12 Degui Li , Oliver Linton , Haoxuan Zhang

Computer experiments involving both qualitative and quantitative (QQ) factors have attracted increasing attention. Gaussian process (GP) models have proven effective in this context by choosing specialized covariance functions for QQ…

Methodology · Statistics 2026-02-19 Linsui Deng , C. F. Jeff Wu

A powerful tool for the analysis of nonrandomized observational studies has been the potential outcomes model. Utilization of this framework allows analysts to estimate average treatment effects. This article considers the situation in…

Statistics Theory · Mathematics 2019-05-31 Debashis Ghosh , Efrén Cruz-Cortés

Factor-based Structural Equation Modeling (SEM) relies on likelihood-based estimation assuming a nonsingular sample covariance matrix, which breaks down in small-sample settings with $p>n$. To address this, we propose a novel estimation…

Machine Learning · Computer Science 2026-04-21 Hiroki Hasegawa , Aoba Tamura , Yukihiko Okada

Estimating a high-dimensional sparse covariance matrix from a limited number of samples is a fundamental problem in contemporary data analysis. Most proposals to date, however, are not robust to outliers or heavy tails. Towards bridging…

Statistics Theory · Mathematics 2020-08-04 John Goes , Gilad Lerman , Boaz Nadler

Current methods for learning graphical models with latent variables and a fixed structure estimate optimal values for the model parameters. Whereas this approach usually produces overfitting and suboptimal generalization performance,…

Machine Learning · Computer Science 2013-01-30 Hagai Attias

We introduce Gaussian orthogonal latent factor processes for modeling and predicting large correlated data. To handle the computational challenge, we first decompose the likelihood function of the Gaussian random field with a…

Methodology · Statistics 2021-11-30 Mengyang Gu , Hanmo Li

Latent factor models that integrate data from multiple sources/studies or modalities have garnered considerable attention across various disciplines. However, existing methods predominantly focus either on multi-study integration or…

Methodology · Statistics 2025-07-15 Wei Liu , Qingzhi Zhong

We study a general factor analysis framework where the $n$-by-$p$ data matrix is assumed to follow a general exponential family distribution entry-wise. While this model framework has been proposed before, we here further relax its…

Methodology · Statistics 2025-12-02 Liang Wang , Luis Carvalho

Causal inference in modern largescale systems faces growing challenges, including highdimensional covariates, multi-valued treatments, massive observational (OBS) data, and limited randomized controlled trial (RCT) samples due to cost…

Methodology · Statistics 2026-02-27 Yuxi Du , Zhiheng Zhang , Haoxuan Li , Cong Fang , Jixing Xu , Peng Zhen , Jiecheng Guo

In this paper, we propose a novel variable selection approach in the framework of multivariate linear models taking into account the dependence that may exist between the responses. It consists in estimating beforehand the covariance matrix…

Statistics Theory · Mathematics 2017-07-14 Marie Perrot-Dockès , Céline Lévy-Leduc , Laure Sansonnet , Julien Chiquet

Estimation of covariance matrices is a fundamental problem in multivariate statistics. Recently, growing efforts have focused on incorporating covariate effects into these matrices, facilitating subject-specific estimation. Despite these…

Methodology · Statistics 2026-04-10 Rakheon Kim , Emma Jingfei Zhang

Variational approximation methods have proven to be useful for scaling Bayesian computations to large data sets and highly parametrized models. Applying variational methods involves solving an optimization problem, and recent research in…

Methodology · Statistics 2017-01-13 Victor M. -H. Ong , David J. Nott , Michael S. Smith

Estimating covariance parameters for multivariate spatial Gaussian random fields is computationally challenging, as the number of parameters grows rapidly with the number of variables, and likelihood evaluation requires operations of order…

Methodology · Statistics 2026-04-10 Francisco Cuevas-Pacheco , Gabriel Riffo , Xavier Emery