English
Related papers

Related papers: Covariance Regression based on Basis Expansion

200 papers

Classical regression analysis relates the expectation of a response variable to a linear combination of explanatory variables. In this article, we propose a covariance regression model that parameterizes the covariance matrix of a…

Methodology · Statistics 2011-03-01 Peter D. Hoff , Xiaoyue Niu

Regularization methods allow one to handle a variety of inferential problems where there are more covariates than cases. This allows one to consider a potentially enormous number of covariates for a problem. We exploit the power of these…

Methodology · Statistics 2012-10-03 Yoonkyung Lee , Steven N. MacEachern , Yoonsuh Jung

We develop an envelope model for joint mean and covariance regression in the large $p$, small $n$ setting. In contrast to existing envelope methods, which improve mean estimates by incorporating estimates of the covariance structure, we…

Methodology · Statistics 2020-10-02 Alexander Franks

This paper tackles the problem of robust covariance matrix estimation when the data is incomplete. Classical statistical estimation methodologies are usually built upon the Gaussian assumption, whereas existing robust estimation ones assume…

We propose an l1-regularized likelihood method for estimating the inverse covariance matrix in the high-dimensional multivariate normal model in presence of missing data. Our method is based on the assumption that the data are missing at…

Methodology · Statistics 2012-02-28 Nicolas Städler , Peter Bühlmann

Estimation of covariance matrices is a fundamental problem in multivariate statistics. Recently, growing efforts have focused on incorporating covariate effects into these matrices, facilitating subject-specific estimation. Despite these…

Methodology · Statistics 2026-04-10 Rakheon Kim , Emma Jingfei Zhang

In this paper, we propose a data-adaptive empirical likelihood-based approach for treatment effect estimation and inference, which overcomes the obstacle of the traditional empirical likelihood-based approaches in the high-dimensional…

Methodology · Statistics 2020-12-15 Wei Liang , Ying Yan

This manuscript presents an approach to perform generalized linear regression with multiple high dimensional covariance matrices as the outcome. Model parameters are proposed to be estimated by maximizing a pseudo-likelihood. When the data…

Methodology · Statistics 2020-07-28 Yi Zhao , Brian S. Caffo , Xi Luo

This paper studies the case of possibly high-dimensional covariates in the regression discontinuity design (RDD) analysis. In particular, we propose estimation and inference methods for the RDD models with covariate selection which perform…

Econometrics · Economics 2026-01-21 Yoichi Arai , Taisuke Otsu , Myung Hwan Seo

We propose generalized additive partial linear models for complex data which allow one to capture nonlinear patterns of some covariates, in the presence of linear components. The proposed method improves estimation efficiency and increases…

Statistics Theory · Mathematics 2014-05-26 Li Wang , Lan Xue , Annie Qu , Hua Liang

Structured additive distributional regression models offer a versatile framework for estimating complete conditional distributions by relating all parameters of a parametric distribution to covariates. Although these models efficiently…

Methodology · Statistics 2023-11-14 Jana Kleinemeier , Nadja Klein

We propose an $\ell_1$-penalized estimation procedure for high-dimensional linear mixed-effects models. The models are useful whenever there is a grouping structure among high-dimensional observations, i.e. for clustered data. We prove a…

Methodology · Statistics 2011-05-12 Jürg Schelldorfer , Peter Bühlmann , Sara van de Geer

The covariance matrix plays a fundamental role in many modern exploratory and inferential statistical procedures, including dimensionality reduction, hypothesis testing, and regression. In low-dimensional regimes, where the number of…

Methodology · Statistics 2024-11-12 Philippe Boileau , Nima S. Hejazi , Mark J. van der Laan , Sandrine Dudoit

This work addresses the issue of large covariance matrix estimation in high-dimensional statistical analysis. Recently, improved iterative algorithms with positive-definite guarantee have been developed. However, these algorithms cannot be…

Information Theory · Computer Science 2016-07-29 Fei Wen , Yuan Yang , Peilin Liu , Robert C. Qiu

We consider the problem of estimation of a covariance matrix for Gaussian data in a high dimensional setting. Existing approaches include maximum likelihood estimation under a pre-specified sparsity pattern, l_1-penalized loglikelihood…

Methodology · Statistics 2024-10-04 Luca Cibinel , Alberto Roverato , Veronica Vinciotti

Lasso is a popular and efficient approach to simultaneous estimation and variable selection in high-dimensional regression models. In this paper, a robust LAD-lasso method for multiple outcomes is presented that addresses the challenges of…

Methodology · Statistics 2022-12-02 Jyrki Möttönen , Tero Lähderanta , Janne Salonen , Mikko J. Sillanpää

In recent years, a rich variety of regularization procedures have been proposed for high dimensional regression problems. However, tuning parameter choice and computational efficiency in ultra-high dimensional problems remain vexing issues.…

Computation · Statistics 2012-01-18 Hua Zhou , Artin Armagan , David B. Dunson

This paper investigates correct variable selection in finite samples via $\ell_1$ and $\ell_1+\ell_2$ type penalization schemes. The asymptotic consistency of variable selection immediately follows from this analysis. We focus on logistic…

Statistics Theory · Mathematics 2008-12-16 Florentina Bunea

We propose a method for estimating a covariance matrix that can be represented as a sum of a low-rank matrix and a diagonal matrix. The proposed method compresses high-dimensional data, computes the sample covariance in the compressed…

Methodology · Statistics 2017-04-04 Gautam Sabnis , Debdeep Pati , Anirban Bhattacharya

The analysis of human microbiome data is often based on dimension-reduced graphical displays and clustering derived from vectors of microbial abundances in each sample. Common to these ordination methods is the use of biologically motivated…

Applications · Statistics 2017-01-11 Timothy W. Randolph , Sen Zhao , Wade Copeland , Meredith Hullar , Ali Shojaie