中文
相关论文

相关论文: High-Dimensional Covariance Decomposition into Spa…

200 篇论文

In this paper, we consider multivariate response regression models with high dimensional predictor variables. One way to model the correlation among the response variables is through the low rank decomposition of the coefficient matrix,…

统计方法学 · 统计学 2015-08-06 Ruiyan Luo , Xin Qi

In this paper we consider the task of estimating the non-zero pattern of the sparse inverse covariance matrix of a zero-mean Gaussian random vector from a set of iid samples. Note that this is also equivalent to recovering the underlying…

机器学习 · 计算机科学 2012-02-28 Christopher C. Johnson , Ali Jalali , Pradeep Ravikumar

For data with high-dimensional covariates but small to moderate sample sizes, the analysis of single datasets often generates unsatisfactory results. The integrative analysis of multiple independent datasets provides an effective way of…

统计方法学 · 统计学 2015-01-19 Yuan Huang , Qingzhao Zhang , Sanguo Zhang , Jian Huang , Shuangge Ma

We study the estimation of the covariance matrix $\Sigma$ of a $p$-dimensional normal random vector based on $n$ independent observations corrupted by additive noise. Only a general nonparametric assumption is imposed on the distribution of…

统计理论 · 数学 2018-03-28 Denis Belomestny , Mathias Trabs , Alexandre B. Tsybakov

This paper proposes a bootstrap-assisted procedure to conduct simultaneous inference for high dimensional sparse linear models based on the recent de-sparsifying Lasso estimator (van de Geer et al. 2014). Our procedure allows the dimension…

统计理论 · 数学 2016-03-07 Xianyang Zhang , Guang Cheng

This paper provides the relevant literature with a complete toolkit for conducting robust estimation and inference about the parameters of interest involved in a high-dimensional panel data framework. Specifically, (1) we allow for…

计量经济学 · 经济学 2025-02-13 Jiti Gao , Fei Liu , Bin Peng , Yayi Yan

This paper develops an approach to inference in a linear regression model when the number of potential explanatory variables is larger than the sample size. The approach treats each regression coefficient in turn as the interest parameter,…

统计方法学 · 统计学 2022-11-14 Heather S. Battey , Nancy Reid

We develop a multi-level restricted Gaussian maximum likelihood method for estimating the covariance function parameters and computing the best unbiased predictor. Our approach produces a new set of multi-level contrasts where the…

统计计算 · 统计学 2016-03-29 Julio E. Castrillon-Candas , Marc G. Genton , Rio Yokota

Pairwise likelihood is a useful approximation to the full likelihood function for covariance estimation in high-dimensional context. It simplifies high-dimensional dependencies by combining marginal bivariate likelihood objects, thus making…

统计方法学 · 统计学 2024-07-25 Alessandro Casa , Davide Ferrari , Zhendong Huang

Deep latent generative models have attracted increasing attention due to the capacity of combining the strengths of deep learning and probabilistic models in an elegant way. The data representations learned with the models are often…

机器学习 · 计算机科学 2023-04-04 Zhao Xu , Daniel Onoro Rubio , Giuseppe Serra , Mathias Niepert

The paper proposes a method for constructing a sparse estimator for the inverse covariance (concentration) matrix in high-dimensional settings. The estimator uses a penalized normal likelihood approach and forces sparsity by using a…

统计理论 · 数学 2008-06-26 Adam J. Rothman , Peter J. Bickel , Elizaveta Levina , Ji Zhu

Performing statistical inference in high-dimension is an outstanding challenge. A major source of difficulty is the absence of precise information on the distribution of high-dimensional estimators. Here, we consider linear regression in…

统计理论 · 数学 2016-06-15 Adel Javanmard , Andrea Montanari

The varying-coefficient model is an important nonparametric statistical model that allows us to examine how the effects of covariates vary with exposure variables. When the number of covariates is big, the issue of variable selection…

统计理论 · 数学 2013-03-05 Jianqing Fan , Yunbei Ma , Wei Dai

We propose a general framework for nonasymptotic covariance matrix estimation making use of concentration inequality-based confidence sets. We specify this framework for the estimation of large sparse covariance matrices through…

统计方法学 · 统计学 2020-12-17 Adam B Kashlak , Linglong Kong

We study low-rank matrix regression in settings where matrix-valued predictors and scalar responses are observed across multiple individuals. Rather than assuming a fully homogeneous coefficient matrices across individuals, we accommodate…

统计方法学 · 统计学 2025-10-28 Di Wang , Xiaoyu Zhang , Guodong Li , Wenyang Zhang

Sparse linear (or generalized linear) models combine a standard likelihood function with a sparse prior on the unknown coefficients. These priors can conveniently be expressed as a maximization over zero-mean Gaussians with different…

机器学习 · 统计学 2012-07-11 David Wipf , Yi Wu

We study the high-dimensional linear regression problem with categorical predictors that have many levels. We propose a new estimation approach, which performs model compression via two mechanisms by simultaneously encouraging (a)…

统计方法学 · 统计学 2026-03-30 Kayhan Behdin , Riade Benbaki , Peter Radchenko , Rahul Mazumder

The iterations of many sparse estimation algorithms are comprised of a fixed linear filter cascaded with a thresholding nonlinearity, which collectively resemble a typical neural network layer. Consequently, a lengthy sequence of algorithm…

机器学习 · 计算机科学 2016-05-11 Bo Xin , Yizhou Wang , Wen Gao , David Wipf

Hilbert-Schmidt Independence Criterion (HSIC) has recently been used in the field of single-index models to estimate the directions. Compared with some other well-established methods, it requires relatively weaker conditions. However, its…

统计方法学 · 统计学 2021-05-19 Runxiong Wu , Chang Deng , Xin Chen

We propose dimension reduction methods for sparse, high-dimensional multivariate response regression models. Both the number of responses and that of the predictors may exceed the sample size. Sometimes viewed as complementary, predictor…

统计理论 · 数学 2013-02-14 Florentina Bunea , Yiyuan She , Marten H. Wegkamp